Latent Feature-Guided Diffusion Models for Shadow Removal