This book provides the essential theoretical tools for stochastic modeling. The authors address the most used models in applications such as Markov chains with discrete-time parameters, hidden Markov chains, Poisson processes, and birth and death processes.