In a first, Google has released data on how much energy an AI prompt uses

Earlier this year, MIT Technology Review published a comprehensive series on AI and energy, at which time none of the major AI companies would reveal their per-prompt energy usage. Google's new publication, at last, allows for a peek behind the curtain that researchers and analysts have long hoped for. The study focuses on a broad look at energy demand, including not only the power used by the AI chips that run models but also by all the other infrastructure needed to support that hardware. "We wanted to be quite comprehensive in all the things we included," said Jeff Dean, Google's chief scientist, in an exclusive interview with MIT Technology Review about the new report. Another large portion of the energy is used by equipment needed to support AI-specific hardware: The host machine's CPU and memory account for another 25% of the total energy used.