Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models