Chapter 2: From Markov chains to stochastic games