Can LLMs plan paths in the real world?

Chen, Wanyi, Su, Meng-Wen, Mehjabin, Nafisa, Cummings, Mary L.

arXiv.org Artificial Intelligence 

In addition, researchers have explored how LLMs can be In early 2024, Volkswagen premiered the first vehicle with used in vision-and-language navigation (VLN). In robotics, ChatGPT integrated into its voice assistant (Volkswagen VLN involves giving robots or agents verbal instructions on 2024). Volkswagen claimed that its ChatGPT-enabled voice how to navigate using visual cues and landmarks (Schumann assistant could be used to control the infotainment, navigation, et al. 2024). Challenges of VLN include visual and natural and air conditioning, or to answer general knowledge language understanding, as well as spatial and temporal questions (Volkswagen 2024).