ecmwf
Statistical post-processing yields accurate probabilistic forecasts from Artificial Intelligence weather models
Trotta, Belinda, Johnson, Robert, de Burgh-Day, Catherine, Hudson, Debra, Abellan, Esteban, Canvin, James, Kelly, Andrew, Mentiplay, Daniel, Owen, Benjamin, Whelan, Jennifer
Bureau of Meteorology, Australia ABSTRACT: Artificial Intelligence (AI) weather models are now reaching operational-grade performance for some variables, but like traditional Numerical Weather Prediction (NWP) models, they exhibit systematic biases and reliability issues. We test the application of the Bureau of Meteorology's existing statistical post-processing system, IMPROVER, to ECMWF's deterministic Artificial Intelligence Forecasting System (AIFS), and compare results against post-processed outputs from the ECMWF HRES and ENS models. Without any modification to processing workflows, post-processing yields comparable accuracy improvements for AIFS as for traditional NWP forecasts, in both expected value and probabilistic outputs. We show that blending AIFS with NWP models improves overall forecast skill, even when AIFS alone is not the most accurate component. These findings show that statistical post-processing methods developed for NWP are directly applicable to AI models, enabling national meteorological centres to incorporate AI forecasts into existing workflows in a low-risk, incremental fashion. Notice This Work has been accepted by Artificial Intelligence for the Earth Systems. The AMS does not guarantee that the copy provided here is an accurate copy of the Version of Record (VoR).
- Oceania > Australia (0.48)
- North America > United States (0.14)
- Europe > United Kingdom (0.14)
Accurate typhoon intensity forecasts using a non-iterative spatiotemporal transformer model
Qu, Hongyu, Xu, Hongxiong, Dong, Lin, Xiang, Chunyi, Nie, Gaozhen
Accurate forecasting of tropical cyclone (TC) intensity - particularly during periods of rapid intensification and rapid weakening - remains a challenge for operational meteorology, with high-stakes implications for disaster preparedness and infrastructure resilience. Recent advances in machine learning have yielded notable progress in TC prediction; however, most existing systems provide forecasts that degrade rapidly in extreme regimes and lack long-range consistency. Here we introduce TIFNet, a transformer-based forecasting model that generates non-iterative, 5-day intensity trajectories by integrating high-resolution global forecasts with a historical-evolution fusion mechanism. Trained on reanalysis data and fine-tuned with operational data, TIFNet consistently outperforms operational numerical models across all forecast horizons, delivering robust improvements across weak, strong, and super typhoon categories. In rapid intensity change regimes - long regarded as the most difficult to forecast - TIFNet reduces forecast error by 29-43% relative to current operational baselines. These results represent a substantial advance in artificial-intelligence-based TC intensity forecasting, especially under extreme conditions where traditional models consistently underperform.
EPT-2 Technical Report
Molinaro, Roberto, Siegenheim, Niall, Poulsen, Niels, Daubinet, Jordan Dane, Martin, Henry, Frey, Mark, Thiart, Kevin, Dautel, Alexander Jakob, Schlueter, Andreas, Grigoryev, Alex, Danciu, Bogdan, Ekhtiari, Nikoo, Steunebrink, Bas, Wagner, Leonie, Gabler, Marvin Vincent
EPT -2 delivers substantial improvements over its predecessor, EPT -1.5, and sets a new state of the art in predicting energy-relevant variables-including 10m and 100m wind speed, 2m temperature, and surface solar radiation-across the full 0-240h forecast horizon. It consistently outperforms leading AI weather models such as Microsoft Aurora, as well as the operational numerical forecast system IFS HRES from the European Centre for Medium-Range Weather Forecasts (ECMWF). In parallel, we introduce a perturbation-based ensemble model of EPT -2 for probabilistic forecasting, called EPT -2e. Remarkably, EPT -2e significantly surpasses the ECMWF ENS mean-long considered the gold standard for medium-to long-range forecasting-while operating at a fraction of the computational cost. EPT models, as well as third-party forecasts, are accessible via the app.jua.ai
- Europe > Switzerland > Zürich > Zürich (0.05)
- Europe > Slovakia > Bratislava > Bratislava (0.04)
- Asia > Middle East > Jordan (0.04)
A multi-scale loss formulation for learning a probabilistic model with proper score optimisation
Lang, Simon, Leutbecher, Martin, Maciel, Pedro
Over the last few years, probabilistic machine-learned weather prediction models have begun to rival physics-based numerical weather prediction (NWP) systems in skill (Kochkov et al., 2024; Price et al., 2023; Lang et al., 2024c,b). AIFS-CRPS (Lang et al., 2024b) is based on the machined-learned weather forecasting model AIFS (Lang et al., 2024a), developed at the European Centre for Medium-Range Weather Forecasts (ECMWF). AIFS-CRPS produces skilful predictions by directly optimising a score based on a proper scoring rule, the almost fair continuous ranked probability score (afCRPS). The model learns to shape Gaussian noise to represent uncertainty in the atmospheric state and achieves ensemble forecast skill that is competitive with, or superior to, the physics-based IFS ensemble (Molteni et al., 1996; Leutbecher and Palmer, 2008; Lang et al., 2021, 2023) at ECMWF. The afCRPS loss function used in AIFS-CRPS is computed point-wise on the full output field. However, atmospheric processes are inherently multi-scale, and different scales contribute to a different degree to the loss function.
Skillful joint probabilistic weather forecasting from marginals
Alet, Ferran, Price, Ilan, El-Kadi, Andrew, Masters, Dominic, Markou, Stratis, Andersson, Tom R., Stott, Jacklynn, Lam, Remi, Willson, Matthew, Sanchez-Gonzalez, Alvaro, Battaglia, Peter
Machine learning (ML)-based weather models have rapidly risen to prominence due to their greater accuracy and speed than traditional forecasts based on numerical weather prediction (NWP), recently outperforming traditional ensembles in global probabilistic weather forecasting. This paper presents FGN, a simple, scalable and flexible modeling approach which significantly outperforms the current state-of-the-art models. FGN generates ensembles via learned model-perturbations with an ensemble of appropriately constrained models. It is trained directly to minimize the continuous rank probability score (CRPS) of per-location forecasts. It produces state-of-the-art ensemble forecasts as measured by a range of deterministic and probabilistic metrics, makes skillful ensemble tropical cyclone track predictions, and captures joint spatial structure despite being trained only on marginals.
- North America > United States > Massachusetts (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.04)
- Asia > China (0.04)
How to systematically develop an effective AI-based bias correction model?
Zhou, Xiao, Sun, Yuze, Wu, Jie, Huang, Xiaomeng
Numerical weather prediction (NWP) is crucial in weather forecasting, providing indispensable guidance across temporal scales from nowcasting to seasonal forecasting (Bauer et al., 2015). As society becomes more dependent on accurate forecasts, there is an increasing demand for high-quality predictions, particularly in extreme events such as heat waves and cold surges, which can have severe social and economic impacts(Br as et al., 2023; Miao et al., 2024). Furthermore, atmospheric forecasts serve as critical boundary conditions for coupled Earth system models, where their accuracy directly governs the predictive capabilities of oceanographic and cryospheric simulations through dynamic coupling mechanisms. While the ECMWF's Integrated Forecasting System (IFS) represents the state-of-the-art in global operational prediction (Molteni et al., 1996), persistent systematic biases still exist, which arise from three fundamental sources: (1) inadequate spatial resolution to resolve subgrid-scale processes (Mishra et al., 2021), (2) inherent limitations in physical parameterization schemes (Berner et al., 2017; Brenowitz & Bretherton, 2018), and (3) uncertainties in initial/boundary condition specification (Peng & Xie, 2006). Current bias correction paradigms predominantly employ statistical postprocessing techniques, including uni-variate regression frameworks (Turco et al., 2017), adaptive filtering techniques (Chandramouli et al., 2022), and probabilistic calibration methods (Yumnam et al., 2022).
- Asia > China > Beijing > Beijing (0.04)
- South America (0.04)
- North America (0.04)
- (4 more...)
AI can forecast the weather in seconds without needing supercomputers
An AI weather program running for a single second on a desktop can match the accuracy of traditional forecasts that take hours or days on powerful supercomputers, claim its creators. Weather forecasting has, since the 1950s, relied on physics-based models that extrapolate from observations made using satellites, balloons and weather stations. But these calculations, known as numerical weather prediction (NWP), are extremely intensive and rely on vast, expensive and energy-hungry supercomputers. Microsoft has a new quantum computer – but does it actually work? In recent years, researchers have tried to streamline this process by applying AI.
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.05)
- Europe > United Kingdom > England > Greater Manchester > Manchester (0.05)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.05)
- Asia > Indonesia (0.05)
AI-driven weather prediction breakthrough reported
A single researcher with a desktop computer will be able to deliver accurate weather forecasts using a new AI weather prediction approach that is tens of times faster and uses thousands of times less computing power than conventional systems. Weather forecasts are currently generated through a complex set of stages, each taking several hours to run on bespoke supercomputers, requiring large teams of experts to develop, maintain and deploy them. Aardvark Weather provides a blueprint to replace the entire process by training an AI on raw data from weather stations, satellites, weather balloons, ships and planes from around the world to enable it to make predictions. This offers the potential for vast improvements in forecast speed, accuracy and cost, according to research published on Thursday in Nature from the University of Cambridge, the Alan Turing Institute, Microsoft Research and the European Centre for Medium-Range Weather Forecasts (ECMWF). Richard Turner, a professor of machine learning at the University of Cambridge, said the approach could be used to quickly provide bespoke forecasts for specific industries or locations, for example predicting temperatures for African agriculture or wind speeds for a renewable energy company in Europe.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.50)
- North America > United States (0.33)
AI Models Still Lag Behind Traditional Numerical Models in Predicting Sudden-Turning Typhoons
Xu, Daosheng, Lu, Zebin, Leung, Jeremy Cheuk-Hin, Zhao, Dingchi, Li, Yi, Shi, Yang, Chen, Bin, Nie, Gaozhen, Wu, Naigeng, Tian, Xiangjun, Yang, Yi, Zhang, Shaoqing, Zhang, Banglin
Given the interpretability, accuracy, and stability of numerical weather prediction (NWP) models, current operational weather forecasting relies heavily on the NWP approach. In the past two years, the rapid development of Artificial Intelligence (AI) has provided an alternative solution for medium-range (1-10 days) weather forecasting. Bi et al. (2023) (hereafter Bi23) introduced the first AI-based weather prediction (AIWP) model in China, named Pangu-Weather, which offers fast prediction without compromising accuracy. In their work, Bi23 made notable claims regarding its effectiveness in extreme weather predictions. However, this claim lacks persuasiveness because the extreme nature of the two tropical cyclones (TCs) examples presented in Bi23, namely Typhoon Kong-rey and Typhoon Yutu, stems primarily from their intensities rather than their moving paths. Their claim may mislead into another meaning which is that Pangu-Weather works well in predicting unusual typhoon paths, which was not explicitly analyzed. Here, we reassess Pangu-Weather's ability to predict extreme TC trajectories from 2020-2024. Results reveal that while Pangu-Weather overall outperforms NWP models in predicting tropical cyclone (TC) tracks, it falls short in accurately predicting the rarely observed sudden-turning tracks, such as Typhoon Khanun in 2023. We argue that current AIWP models still lag behind traditional NWP models in predicting such rare extreme events in medium-range forecasts.
- Asia > China > Guangdong Province > Guangzhou (0.04)
- Asia > Japan (0.04)
- Asia > China > Gansu Province > Lanzhou (0.04)
- (5 more...)