Optimization techniques are at the core of data science. An understanding of the basic techniques and their fundamental properties provides important grounding for students, researchers, and practitioners. This compact, self-contained text covers the fundamentals of optimization algorithms, focusing on the techniques most relevant to data science.