From Markov chains to stochastic games