Foundation models : Is it a new paradigm for statistics and machine learning?

A recent debate on so called Foundation models (CRFM) brings a real question of if we can build very large models on any specified domain, similar to current large language models, and replace our ...