This book, meant for graduate students and researchers, explores the connections between numerical approximation and statistical inference from a game and decision theoretic perspective, and illustrates these interplays by addressing problems related to numerical homogenization, operator adapted wavelets, and fast solvers.