Principled Operator Learning in Ocean Dynamics: The Role of Temporal Structure