Efficient Multi-agent Navigation with Lightweight DRL Policy