Unlocking Point Processes through Point Set Diffusion