Multi-Agent Reinforcement Learning with Communication-Constrained Priors