Temporal Generalization: A Reality Check