Language-Guided Manipulation with Diffusion Policies and Constrained Inpainting