Finding Correlated Equilibrium of Constrained Markov Game: A Primal-Dual Approach

Neural Information Processing Systems 

Lagrangian function has zero duality gap.