Fast and Accurate Multi-Agent Trajectory Prediction For Crowded Unknown Scenes