A rigorous yet accessible textbook covering both fundamental and advanced optimization topics. Covering both gradient-based and gradient-free algorithms, derivative computation, and numerous visualizations, examples and problems, it is ideal for graduate courses on optimization in aerospace, civil, and mechanical engineering departments.