Language Control Diffusion: Efficiently Scaling through Space, Time, and Tasks