Enhancing Diffusion Model Stability for Image Restoration via Gradient Management