CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Concepts