Differentially Private Adaptation of Diffusion Models via Noisy Aggregated Embeddings