earth system
Learning Coupled Earth System Dynamics with GraphDOP
Boucher, Eulalie, Alexe, Mihai, Lean, Peter, Pinnington, Ewan, Lang, Simon, Laloyaux, Patrick, Zampieri, Lorenzo, de Rosnay, Patricia, Bormann, Niels, McNally, Anthony
Interactions between different components of the Earth System (e.g. ocean, atmosphere, land and cryosphere) are a crucial driver of global weather patterns. Modern Numerical Weather Prediction (NWP) systems typically run separate models of the different components, explicitly coupled across their interfaces to additionally model exchanges between the different components. Accurately representing these coupled interactions remains a major scientific and technical challenge of weather forecasting. GraphDOP is a graph-based machine learning model that learns to forecast weather directly from raw satellite and in-situ observations, without reliance on reanalysis products or traditional physics-based NWP models. GraphDOP simultaneously embeds information from diverse observation sources spanning the full Earth system into a shared latent space. This enables predictions that implicitly capture cross-domain interactions in a single model without the need for any explicit coupling. Here we present a selection of case studies which illustrate the capability of GraphDOP to forecast events where coupled processes play a particularly key role. These include rapid sea-ice freezing in the Arctic, mixing-induced ocean surface cooling during Hurricane Ian and the severe European heat wave of 2022. The results suggest that learning directly from Earth System observations can successfully characterise and propagate cross-component interactions, offering a promising path towards physically consistent end-to-end data-driven Earth System prediction with a single model.
- North America > United States (0.68)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.14)
- Atlantic Ocean > North Atlantic Ocean > Baffin Bay (0.04)
- (12 more...)
- Government > Regional Government > North America Government > United States Government (0.47)
- Energy (0.46)
Regularization of ML models for Earth systems by using longer model timesteps
Parthipan, Raghul, Anand, Mohit, Christensen, Hannah M, Vitart, Frederic, Wischik, Damon J, Zscheischler, Jakob
Regularization is a technique to improve generalization of machine learning (ML) models. A common form of regularization in the ML literature is to train on data where similar inputs map to different outputs. This improves generalization by preventing ML models from becoming overconfident in their predictions. This paper shows how using longer timesteps when modelling chaotic Earth systems naturally leads to more of this regularization. We show this in two domains. We explain how using longer model timesteps can improve results and demonstrate that increased regularization is one of the causes. We explain why longer model timesteps lead to improved regularization in these systems and present a procedure to pick the model timestep. We also carry out a benchmarking exercise on ORAS5 ocean reanalysis data to show that a longer model timestep (28 days) than is typically used gives realistic simulations. We suggest that there will be many opportunities to use this type of regularization in Earth system problems because the Earth system is chaotic and the regularization is so easy to implement.
Using Generative Models to Produce Realistic Populations of UK Windstorms
Tsoi, Yee Chun, Hunt, Kieran M. R., Shaffrey, Len, Badii, Atta, Dixon, Richard, Nicotina, Ludovico
This study evaluates the potential of generative models, trained on historical ERA5 reanalysis data, for simulating windstorms over the UK. Four generative models, including a standard GAN, a WGAN-GP, a U-net diffusion model, and a diffusion-GAN were assessed based on their ability to replicate spatial and statistical characteristics of windstorms. Different models have distinct strengths and limitations. The standard GAN displayed broader variability and limited alignment on the PCA dimensions. The WGAN-GP had a more balanced performance but occasionally misrepresented extreme events. The U-net diffusion model produced high-quality spatial patterns but consistently underestimated windstorm intensities. The diffusion-GAN performed better than the other models in general but overestimated extremes. An ensemble approach combining the strengths of these models could potentially improve their overall reliability. This study provides a foundation for such generative models in meteorological research and could potentially be applied in windstorm analysis and risk assessment.
- Europe > North Sea (0.05)
- Atlantic Ocean > North Atlantic Ocean > North Sea (0.05)
- Europe > United Kingdom > Irish Sea (0.05)
- (10 more...)
- Research Report > New Finding (0.93)
- Research Report > Experimental Study (0.66)
Recommendations for Comprehensive and Independent Evaluation of Machine Learning-Based Earth System Models
Ullrich, Paul A., Barnes, Elizabeth A., Collins, William D., Dagon, Katherine, Duan, Shiheng, Elms, Joshua, Lee, Jiwoo, Leung, L. Ruby, Lu, Dan, Molina, Maria J., O'Brien, Travis A., Rebassoo, Finn O.
Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics-based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop forecasting models into Earth-system models (ESMs), capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes. Modeling the Earth system is a much more difficult problem than weather forecasting, not least because the model must represent the alternate (e.g., future) coupled states of the system for which there are no historical observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML-based models, demonstrating the credibility of ML-based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML-based ESMs to strengthen their credibility and promote their wider use.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.14)
- North America > United States > Indiana (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- (3 more...)
- Energy (1.00)
- Government > Regional Government > North America Government > United States Government (0.68)
Next-Generation Earth System Models: Towards Reliable Hybrid Models for Weather and Climate Applications
Beucler, Tom, Koch, Erwan, Kotlarski, Sven, Leutwyler, David, Michel, Adrien, Koh, Jonathan
Recommendation 1: Develop Hybrid AI-Physical Models: Emphasize the integration of AI and physical modeling for improved reliability, especially for longer prediction horizons, acknowledging the delicate balance between knowledge-based and data-driven components required for optimal performance. Recommendation 2: Emphasize Robustness in AI Downscaling Approaches, favoring techniques that respect physical laws, preserve inter-variable dependencies and spatial structures, and accurately represent extremes at the local scale. Recommendation 3: Promote Inclusive Model Development: Ensure Earth System Model development is open and accessible to diverse stakeholders, enabling forecasters, the public, and AI/statistics experts to use, develop, and engage with the model and its predictions/projections. Figure Caption: Advancements in data collection, data access, hybrid AI-physical Earth system modeling, and downscaling empower stakeholders with increased accessibility to local predictions and projections, encouraging collaborative efforts across disciplines to improve climate change preparedness. Here, we review how machine learning has interactions (Rosenfeld et al., 2014). In the ocean, uncertainties persist due that can be integrated forward in time, serve the to unresolved mesoscale eddies and turbulent double purpose of understanding and prediction processes (Couldrey et al., 2021).
- Europe > Switzerland > Vaud > Lausanne (0.04)
- Oceania > New Zealand (0.04)
- Europe > Switzerland > Bern > Bern (0.04)
- (4 more...)
TeleViT: Teleconnection-driven Transformers Improve Subseasonal to Seasonal Wildfire Forecasting
Prapas, Ioannis, Bountos, Nikolaos Ioannis, Kondylatos, Spyros, Michail, Dimitrios, Camps-Valls, Gustau, Papoutsis, Ioannis
Wildfires are increasingly exacerbated as a result of climate change, necessitating advanced proactive measures for effective mitigation. It is important to forecast wildfires weeks and months in advance to plan forest fuel management, resource procurement and allocation. To achieve such accurate long-term forecasts at a global scale, it is crucial to employ models that account for the Earth system's inherent spatio-temporal interactions, such as memory effects and teleconnections. We propose a teleconnection-driven vision transformer (TeleViT), capable of treating the Earth as one interconnected system, integrating fine-grained local-scale inputs with global-scale inputs, such as climate indices and coarse-grained global variables. Through comprehensive experimentation, we demonstrate the superiority of TeleViT in accurately predicting global burned area patterns for various forecasting windows, up to four months in advance. The gain is especially pronounced in larger forecasting windows, demonstrating the improved ability of deep learning models that exploit teleconnections to capture Earth system dynamics. Code available at https://github.com/Orion-Ai-Lab/TeleViT.
Global Extreme Heat Forecasting Using Neural Weather Models in: Artificial Intelligence for the Earth Systems - Ahead of print
Abstract Heat waves are projected to increase in frequency and severity with global warming. Improved warning systems would help reduce the associated loss of lives, wildfires, power disruptions, and reduction in crop yields. In this work, we explore the potential for deep learning systems trained on historical data to forecast extreme heat on short, medium and subseasonal timescales. To this purpose, we train a set of neural weather models (NWMs) with convolutional architectures to forecast surface temperature anomalies globally, 1 to 28 days ahead, at ~ 200 km resolution and on the cubed sphere. The NWMs are trained using the ERA5 reanalysis product and a set of candidate loss functions, including the mean squared error and exponential losses targeting extremes. We find that training models to minimize custom losses tailored to emphasize extremes leads to significant skill improvements in the heat wave prediction task, compared to NWMs trained on the mean squared error loss. This improvement is accomplished with almost no skill reduction in the general temperature prediction task, and it can be efficiently realized through transfer learning, by re-training NWMs with the custom losses for a few epochs. In addition, we find that the use of a symmetric exponential loss reduces the smoothing of NWM forecasts with lead time. Our best NWM is able to outperform persistence in a regressive sense for all lead times and temperature anomaly thresholds considered, and shows positive regressive skill compared to the ECMWF subseasonal-to-seasonal control forecast after two weeks.
ACM: Digital Library: Communications of the ACM
Forecasting rates of sea level change in polar ice shelves: Polar scientists, along with atmospheric and ocean scientists, face an urgent need to understand sea level rise around the globe. Ice-shelf environments represent extreme environments for sampling and sensing. Current efforts to collect sensed data are limited and use tethered robots with traditional sampling frequency and collection limitations. The ability to collect extensive data about conditions at or near the ice shelves will inform our understanding about changes in ocean circulation patterns, as well as feedbacks with wind circulation. New research on intelligent sensors would support selective data collection, onboard data analysis, and adaptive sensor steering.
- North America > United States > Massachusetts > Middlesex County > Lowell (0.24)
- Europe > Netherlands > South Holland > Rotterdam (0.14)
- North America > United States > Texas > Travis County > Austin (0.04)
- (2 more...)
- Energy (1.00)
- Government > Regional Government > North America Government > United States Government (0.70)
#ICML2021 invited talk round-up 1: drug discovery and cryospheric science
In this post, we summarise the first two invited talks from the International Conference on Machine Learning (ICML). These presentations covered the fascinating topics of drug discovery, and the cryosphere. In Daphne's talk, she outlined some of the work she has been doing on transforming drug discovery using digital biology. To introduce the topic, Daphne described drug discovery as an interesting space that one can view as glass half-full or glass half-empty. The half-full version is demonstrated by the amazing advances in new medicines, such as vaccines, cell therapies, genetically targeted therapies, and cancer immunotherapies.
- Health & Medicine > Pharmaceuticals & Biotechnology (1.00)
- Health & Medicine > Therapeutic Area > Oncology (0.35)