APT: Affine Prototype-Timestamp For Time Series Forecasting Under Distribution Shift