How Ray, a Distributed AI Framework, Helps Power ChatGPT - The New Stack

According to Ion Stoica, co-founder of Databricks and Anyscale, and also a senior professor of computer science at Berkeley, 2023 will be the year of "distributed AI frameworks." Needless to say, he has already had a hand in creating such a tool, in the form of Anyscale's open source Ray platform. Among other uses, Ray helps power OpenAI's groundbreaking ChatGPT. I interviewed Stoica to find out what Ray does exactly and, more generally, what is needed to scale AI software in this new era of generative AI. We also discuss the latest in "sky computing," a term Stoica and his Berkeley team introduced in 2021, in a paper that proposed a new form of cloud computing based around interoperability and distributed computing.