ConDiSim: Conditional Diffusion Models for Simulation Based Inference