Why games may not be the best benchmark for AI

Did you miss a session from the Future of Work Summit? In 2019, San Francisco-based AI research lab OpenAI held a tournament to tout the prowess of OpenAI Five, a system designed to play the multiplayer battle arena game Dota 2. OpenAI Five defeated a team of professional players -- twice. And when made publicly available, OpenAI Five managed to win against 99.4% of people who played against it online. OpenAI has invested heavily in games for research, developing libraries like CoinRun and Neural MMO, a simulator that plops AI in the middle of an RPG-like world. But that approach is changing.