CALICO: Conversational Agent Localization via Synthetic Data Generation