Scalable Constrained Policy Optimization for Safe Multi-agent Reinforcement Learning