The Near Future of AI is Action-Driven - by John McDonnell

In 2022, large language models (LLMs) finally got good. Specifically, Google and OpenAI have led the way in creating foundation models that respond to instructions more usefully. For OpenAI, this came in the form of Instruct-GPT (OpenAI blogpost), while for Google this was reflected in their FLAN training method (Wei et al. 2022, arxiv). Flan's which beat the Hypermind forecast for MMLU performance two years early: But the best is yet to come. The really exciting applications will be action-driven, where the model acts like an agent choosing actions.