Hyper-Transforming Latent Diffusion Models