Robust Online Residual Refinement via Koopman-Guided Dynamics Modeling