AIhub coffee corner – foundation models

With the recent publication on arXiv of the article On the Opportunities and Risks of Foundation Models, this month our experts discuss the concept of such models. Joining the discussion this time are: Sanmay Das (George Mason University), Tom Dietterich (Oregon State University), Stephen Hanson (Rutgers University), Sabine Hauert (University of Bristol), Holger Hoos (Leiden University) and Carles Sierra (Artificial Intelligence Research Institute of the Spanish National Research Council). Sabine Hauert: This month we'll be discussing this paper on the opportunities and risks of foundation models. Could somebody give an explanation of what these models are and some of the issues? Tom Dietterich: So these foundation models, like BERT and GPT-3 are deep neural networks trained in an unsupervised fashion on huge collections of data.