This book covers the design, application and evaluation of computational models of motivation in reinforcement learning. The performance of these models is demonstrated by applications in simulated game scenarios and a live, open-ended, virtual world.