Can Diffusion Models Provide Rigorous Uncertainty Quantification for Bayesian Inverse Problems?