Presents the main complexity theorems in convex optimization and their corresponding algorithms. The book begins with the fundamental theory of black-box optimization and proceeds to guide the reader through recent advances in structural optimization and stochastic optimization.