This state-of-the-art overview describes how phase transitions occur and teaches appropriate methods for tackling the consequent problems. Weaving together fundamental aspects of computer science, statistical physics and machine learning, it provides sufficient mathematics and physics background to make the subject intelligible to researchers in AI and other computer science communities.