Adaptively Controllable Diffusion Model for Efficient Conditional Image Generation