Contrastive Diffusion Guidance for Spatial Inverse Problems