FATE: Focal-modulated Attention Encoder for Temperature Prediction