Language-guided Task Adaptation for Imitation Learning