Trajectory World Models for Heterogeneous Environments