Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Driving