FACA: Fair and Agile Multi-Robot Collision Avoidance in Constrained Environments with Dynamic Priorities