Girtsou, Stella
3D Cloud reconstruction through geospatially-aware Masked Autoencoders
Girtsou, Stella, Salas-Porras, Emiliano Diaz, Freischem, Lilli, Massant, Joppe, Bintsi, Kyriaki-Margarita, Castiglione, Guiseppe, Jones, William, Eisinger, Michael, Johnson, Emmanuel, Jungbluth, Anna
Clouds play a key role in Earth's radiation balance with complex effects that introduce large uncertainties into climate models. Real-time 3D cloud data is essential for improving climate predictions. This study leverages geostationary imagery from MSG/SEVIRI and radar reflectivity measurements of cloud profiles from CloudSat/CPR to reconstruct 3D cloud structures. We first apply self-supervised learning (SSL) methods-Masked Autoencoders (MAE) and geospatially-aware SatMAE on unlabelled MSG images, and then fine-tune our models on matched image-profile pairs. Our approach outperforms state-of-the-art methods like U-Nets, and our geospatial encoding further improves prediction results, demonstrating the potential of SSL for cloud reconstruction.
Next day fire prediction via semantic segmentation
Alexis, Konstantinos, Girtsou, Stella, Apostolakis, Alexis, Giannopoulos, Giorgos, Kontoes, Charalampos
In this paper we present a deep learning pipeline for next day fire prediction. The next day fire prediction task consists in learning models that receive as input the available information for an area up until a certain day, in order to predict the occurrence of fire for the next day. Starting from our previous problem formulation as a binary classification task on instances (daily snapshots of each area) represented by tabular feature vectors, we reformulate the problem as a semantic segmentation task on images; there, each pixel corresponds to a daily snapshot of an area, while its channels represent the formerly tabular training features. We demonstrate that this problem formulation, built within a thorough pipeline achieves state of the art results.