Provides a self-contained, comprehensive study of the main first-order methods that are frequently used in solving large-scale problems. The author has gathered, reorganized, and synthesized (in a unified manner) many results that are currently scattered throughout the literature, many of which cannot be typically found in optimization books.