Augmented World Models Facilitate Zero-Shot Dynamics Generalization From a Single Offline Environment