Safe Multiagent Coordination via Entropic Exploration