Policy Adaptation from Foundation Model Feedback