In a two-part series, MIT News explores the environmental implications of generative AI. In this article, we look at why this technology is so resource-intensive. A second piece will investigate what experts are doing to reduce genAI's carbon footprint and other impacts. The excitement surrounding potential benefits of generative AI, from improving worker productivity to advancing scientific research, is hard to ignore. While the explosive growth of this new technology has enabled rapid deployment of powerful models in many industries, the environmental consequences of this generative AI "gold rush" remain difficult to pin down, let alone mitigate.

Industry releases more "significant" machine learning models than academia, with 32 released in 2022 compared with three. Until 2014, most significant machine learning models were released by academic institutions. Performance on traditional benchmarks is saturating. State-of-the-art results continue to be published, but year-over-year improvement on many benchmarks continues to be marginal. Training of AI models has environmental implications, with BLOOM's training run emitting 25 times more carbon than a single air traveller on a one-way trip from New York to San Francisco.

This paper explores the environmental impact of the super-linear growth trends for AI from a holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize the carbon footprint of AI computing by examining the model development cycle across industry-scale machine learning use cases and, at the same time, considering the life cycle of system hardware. Taking a step further, we capture the operational and manufacturing carbon footprint of AI computing and present an end-to-end analysis for what and how hardware-software design and at-scale optimization can help reduce the overall carbon footprint of AI. Based on the industry experience and lessons learned, we share the key challenges and chart out important development directions across the many dimensions of AI. We hope the key messages and insights presented in this paper can inspire the community to advance the field of AI in an environmentally-responsible manner.