A thorough grounding in Markov chains and martingales is essential to dealing with the complex situations encountered in the study of discrete time stochastic processes. This book presents more than 100 exercises and problems related to martingales and Markov chains, each with a detailed solution.