Oceania
Next-Generation Earth System Models: Towards Reliable Hybrid Models for Weather and Climate Applications
Beucler, Tom, Koch, Erwan, Kotlarski, Sven, Leutwyler, David, Michel, Adrien, Koh, Jonathan
Recommendation 1: Develop Hybrid AI-Physical Models: Emphasize the integration of AI and physical modeling for improved reliability, especially for longer prediction horizons, acknowledging the delicate balance between knowledge-based and data-driven components required for optimal performance. Recommendation 2: Emphasize Robustness in AI Downscaling Approaches, favoring techniques that respect physical laws, preserve inter-variable dependencies and spatial structures, and accurately represent extremes at the local scale. Recommendation 3: Promote Inclusive Model Development: Ensure Earth System Model development is open and accessible to diverse stakeholders, enabling forecasters, the public, and AI/statistics experts to use, develop, and engage with the model and its predictions/projections. Figure Caption: Advancements in data collection, data access, hybrid AI-physical Earth system modeling, and downscaling empower stakeholders with increased accessibility to local predictions and projections, encouraging collaborative efforts across disciplines to improve climate change preparedness. Here, we review how machine learning has interactions (Rosenfeld et al., 2014). In the ocean, uncertainties persist due that can be integrated forward in time, serve the to unresolved mesoscale eddies and turbulent double purpose of understanding and prediction processes (Couldrey et al., 2021).
ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models
Sung, Yi-Lin, Yoon, Jaehong, Bansal, Mohit
Large Vision-Language Models (LVLMs) can understand the world comprehensively by integrating rich information from different modalities, achieving remarkable advancements on various multimodal downstream tasks. However, deploying LVLMs is often problematic due to their massive computational/energy costs and carbon consumption. Such issues make it infeasible to adopt conventional iterative global pruning, which is costly due to computing the Hessian matrix of the entire large model for sparsification. Alternatively, several studies have recently proposed layer-wise pruning approaches to avoid the expensive computation of global pruning and efficiently compress model weights according to their importance within a layer. However, they often suffer from suboptimal model compression due to their lack of a global perspective. To address this limitation in recent efficient pruning methods for large models, we propose Efficient Coarse-to-Fine Layer-Wise Pruning (ECoFLaP), a two-stage coarse-to-fine weight pruning approach for LVLMs. We first determine the sparsity ratios of different layers or blocks by leveraging the global importance score, which is efficiently computed based on the zeroth-order approximation of the global model gradients. Then, the model performs local layer-wise unstructured weight pruning based on globally-informed sparsity ratios. We validate our proposed method across various multimodal and unimodal models and datasets, demonstrating significant performance improvements over prevalent pruning techniques in the high-sparsity regime.
TraCE: Trajectory Counterfactual Explanation Scores
Clark, Jeffrey N., Small, Edward A., Keshtmand, Nawid, Wan, Michelle W. L., Mayoral, Elena Fillola, Werner, Enrico, Bourdeaux, Christopher P., Santos-Rodriguez, Raul
Counterfactual explanations, and their associated algorithmic recourse, are typically leveraged to understand, explain, and potentially alter a prediction coming from a black-box classifier. In this paper, we propose to extend the use of counterfactuals to evaluate progress in sequential decision making tasks. To this end, we introduce a model-agnostic modular framework, TraCE (Trajectory Counterfactual Explanation) scores, which is able to distill and condense progress in highly complex scenarios into a single value. We demonstrate TraCE's utility across domains by showcasing its main properties in two case studies spanning healthcare and climate change.
ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal Events
Seo, Woosuk, Yang, Chanmo, Kim, Young-Ho
Children typically learn to identify and express emotions through sharing their stories and feelings with others, particularly their family. However, it is challenging for parents or siblings to have emotional communication with children since children are still developing their communication skills. We present ChaCha, a chatbot that encourages and guides children to share personal events and associated emotions. ChaCha combines a state machine and large language models (LLMs) to keep the dialogue on track while carrying on free-form conversations. Through an exploratory study with 20 children (aged 8-12), we examine how ChaCha prompts children to share personal events and guides them to describe associated emotions. Participants perceived ChaCha as a close friend and shared their stories on various topics, such as family trips and personal achievements. Based on the findings, we discuss opportunities for leveraging LLMs to design child-friendly chatbots to support children in sharing emotions.
OYXOY: A Modern NLP Test Suite for Modern Greek
Kogkalidis, Konstantinos, Chatzikyriakidis, Stergios, Giannikouri, Eirini Chrysovalantou, Katsouli, Vassiliki, Klironomou, Christina, Koula, Christina, Papadakis, Dimitris, Pasparaki, Thelka, Psaltaki, Erofili, Sakellariou, Efthymia, Soupiona, Hara
This paper serves as a foundational step towards the development of a linguistically motivated and technically relevant evaluation suite for Greek NLP. We initiate this endeavor by introducing four expert-verified evaluation tasks, specifically targeted at natural language inference, word sense disambiguation (through example comparison or sense selection) and metaphor detection. More than language-adapted replicas of existing tasks, we contribute two innovations which will resonate with the broader resource and evaluation community. Firstly, our inference dataset is the first of its kind, marking not just \textit{one}, but rather \textit{all} possible inference labels, accounting for possible shifts due to e.g. ambiguity or polysemy. Secondly, we demonstrate a cost-efficient method to obtain datasets for under-resourced languages. Using ChatGPT as a language-neutral parser, we transform the Dictionary of Standard Modern Greek into a structured format, from which we derive the other three tasks through simple projections. Alongside each task, we conduct experiments using currently available state of the art machinery. Our experimental baselines affirm the challenging nature of our tasks and highlight the need for expedited progress in order for the Greek NLP ecosystem to keep pace with contemporary mainstream research.
Dinosaurs evolved feathers to scare prey, suggests robot experiment
Feathers may have evolved on dinosaurs to frighten and flush out prey before they were used for flight, say researchers who built a winged robot and used it to scare grasshoppers. Pennaceous feathers, which are the stiff, non-downy feathers with a central quill, are seen in fossils of some dinosaurs such as Caudipteryx, which lived about 124 million years ago. These dinosaurs had wings that weren't strong enough for flight, so it is unclear how they were used. Jinseok Park at Seoul National University, South Korea, and his colleagues hypothesised that they were used to startle prey into fleeing from hiding places, so they could be caught more easily. This "flush-pursuit" hunting strategy is used by modern birds including the greater roadrunner (Geococcyx californianus) and the northern mockingbird (Mimus polyglottos).
Robot dinosaur tests surprising theory about the evolution of feathers
Feathers may have evolved on dinosaurs to frighten and flush out prey before they were used for flight, say researchers who built a winged robot and used it to scare grasshoppers. Pennaceous feathers, which are the stiff, non-downy feathers that have a central quill, are seen in fossils of some dinosaurs such as Caudipteryx, which lived about 124 million years ago. These dinosaurs had wings but they were not strong enough for flight, so it's unclear how they were used. Jinseok Park from Seoul National University, South Korea, and his colleagues hypothesised that they were used to startle prey into fleeing from hiding places, so they could be caught more easily. This "flush-pursuit" hunting strategy is used by modern birds including the greater roadrunner (Geococcyx californianus) and the northern mockingbird (Mimus polyglottos).
Chomp chomp: the curious history of Pac-Man snacks
This week, Oreo cookies announced a new tie-in with arcade legend Pac-Man. Fans can use their phones to scan any of the six different Pac-Man themed biscuits in the packet which gives them access to a neat mobile version of the classic maze game – each cookie provides a different maze layout. In the interests of research, I acquired three packets, and while the game is pretty good, it was tough to get my phone to recognise the cookie and it sometimes took so long I'd already eaten it. Anyway, the offer is a sign of how immensely popular Pac-Man remains, more than 40 years after his debut. At the time of the game's launch, the circular hero was almost unique, a lovable character in an industry dominated by spaceships, cars and guns.
Generating Likely Counterfactuals Using Sum-Product Networks
Nemecek, Jiri, Pevny, Tomas, Marecek, Jakub
Due to user demand and recent regulation (GDPR, AI Act), decisions made by AI systems need to be explained. These decisions are often explainable only post hoc, where counterfactual explanations are popular. The question of what constitutes the best counterfactual explanation must consider multiple aspects, where "distance from the sample" is the most common. We argue that this requirement frequently leads to explanations that are unlikely and, therefore, of limited value. Here, we present a system that provides high-likelihood explanations. We show that the search for the most likely explanations satisfying many common desiderata for counterfactual explanations can be modeled using mixed-integer optimization (MIO). In the process, we propose an MIO formulation of a Sum-Product Network (SPN) and use the SPN to estimate the likelihood of a counterfactual, which can be of independent interest. A numerical comparison against several methods for generating counterfactual explanations is provided.
Towards Global Glacier Mapping with Deep Learning and Open Earth Observation Data
Maslov, Konstantin A., Persello, Claudio, Schellenberger, Thomas, Stein, Alfred
Accurate global glacier mapping is critical for understanding climate change impacts. It is challenged by glacier diversity, difficult-to-classify debris and big data processing. Here we propose Glacier-VisionTransformer-U-Net (GlaViTU), a convolutional-transformer deep learning model, and five strategies for multitemporal global-scale glacier mapping using open satellite imagery. Assessing the spatial, temporal and cross-sensor generalisation shows that our best strategy achieves intersection over union >0.85 on previously unobserved images in most cases, which drops to >0.75 for debris-rich areas such as High-Mountain Asia and increases to >0.90 for regions dominated by clean ice. Additionally, adding synthetic aperture radar data, namely, backscatter and interferometric coherence, increases the accuracy in all regions where available. The calibrated confidence for glacier extents is reported making the predictions more reliable and interpretable. We also release a benchmark dataset that covers 9% of glaciers worldwide. Our results support efforts towards automated multitemporal and global glacier mapping.