Progressive Tempering Sampler with Diffusion