A Bellman Equations for Markov Games