Inter-environmental world modeling for continuous and compositional dynamics