Can LLMs Make Robots Smarter?

Advances in robotics have arrived at a fast and furious pace. Yet, for all their remarkable capabilities, these machines remain fairy dumb. They are unable to understand all but a few human commands, they cannot adapt to conditions that fall outside their rigid programming, and they are unable to adjust to events on the fly. These challenges are prompting researchers to explore ways to build large language models (LLMs) into robotic devices. These semantic frameworks, which would serve as something resembling a "brain," could imbue robotics with conversational skills, better reasoning, and an ability to process complex commands--whether a request to prepare an omelet or tend to a patient in a care facility.