Beyond Features: How Dataset Design Influences Multi-Agent Trajectory Prediction Performance