Multi-task Manipulation Policy Modeling with Visuomotor Latent Diffusion