Government
On-Demand Mobility Services for Infrastructure and Community Resilience: A Review toward Synergistic Disaster Response Systems
Mobility-on-demand (MOD) services have the potential to significantly improve the adaptiveness and recovery of urban systems, in the wake of disruptive events. But there lacks a comprehensive review on using MOD services for such purposes in addition to serving regular travel demand. This paper presents a review that suggests a noticeable increase within recent years on this topic across four main areas - resilient MOD services, novel usage of MOD services for improving infrastructure and community resilience, empirical impact evaluation, and enabling and augmenting technologies. The review shows that MOD services have been utilized to support anomaly detection, essential supply delivery, evacuation and rescue, on-site medical care, power grid stabilization, transit service substitution during downtime, and infrastructure and equipment repair. Such a versatility suggests a comprehensive assessment framework and modeling methodologies for evaluating system design alternatives that simultaneously serve different purposes. The review also reveals that integrating suitable technologies, business models, and long-term planning efforts offers significant synergistic benefits.
Crafting Large Language Models for Enhanced Interpretability
Sun, Chung-En, Oikarinen, Tuomas, Weng, Tsui-Wei
We introduce the Concept Bottleneck Large Language Model (CB-LLM), a pioneering approach to creating inherently interpretable Large Language Models (LLMs). Unlike traditional black-box LLMs that rely on post-hoc interpretation methods with limited neuron function insights, CB-LLM sets a new standard with its built-in interpretability, scalability, and ability to provide clear, accurate explanations. This innovation not only advances transparency in language models but also enhances their effectiveness. Our unique Automatic Concept Correction (ACC) strategy successfully narrows the performance gap with conventional black-box LLMs, positioning CB-LLM as a model that combines the high accuracy of traditional LLMs with the added benefit of clear interpretability -- a feature markedly absent in existing LLMs.
When LLMs Play the Telephone Game: Cumulative Changes and Attractors in Iterated Cultural Transmissions
Perez, Jérémy, Léger, Corentin, Kovač, Grgur, Colas, Cédric, Molinaro, Gaia, Derex, Maxime, Oudeyer, Pierre-Yves, Moulin-Frier, Clément
As large language models (LLMs) start interacting with each other and generating an increasing amount of text online, it becomes crucial to better understand how information is transformed as it passes from one LLM to the next. While significant research has examined individual LLM behaviors, existing studies have largely overlooked the collective behaviors and information distortions arising from iterated LLM interactions. Small biases, negligible at the single output level, risk being amplified in iterated interactions, potentially leading the content to evolve towards attractor states. In a series of telephone game experiments, we apply a transmission chain design borrowed from the human cultural evolution literature: LLM agents iteratively receive, produce, and transmit texts from the previous to the next agent in the chain. By tracking the evolution of text toxicity, positivity, difficulty, and length across transmission chains, we uncover the existence of biases and attractors, and study their dependence on the initial text, the instructions, language model, and model size. For instance, we find that more open-ended instructions lead to stronger attraction effects compared to more constrained tasks. We also find that different text properties display different sensitivity to attraction effects, with toxicity leading to stronger attractors than length. These findings highlight the importance of accounting for multi-step transmission dynamics and represent a first step towards a more comprehensive understanding of LLM cultural dynamics.
NASA prepares for International Space Station retirement
'Special Report' host Bret Baier reports on how NASA is preparing to decommission the ISS on'Special Report.' In October of 2000, a Soyuz Rocket carried the first expedition to the International Space Station and thus began the permanent residence aboard the laboratory. Humans have occupied a place in space ever since. NASA is now preparing for what's next for human presence in space with plans to de-orbit the International Space Station in 2031. "We constantly have maintenance on the space station. We constantly send our astronauts out on spacewalks and they are doing just that," NASA Administrator Bill Nelson said.
Hezbollah fires 200 rockets and drones into Israel
The Lebanese armed group Hezbollah has launched more than 200 rockets and attack drones into northern Israel, in response to the killing of one of its senior commanders. Israel's military said one of its officers was killed in the barrage, which started a number of fires. The military also said it had targeted Hezbollah "military structures" and other targets in southern Lebanon in response. Lebanese media reported that one person was killed in an Israeli drone strike in the town of Houla. The latest barrage, which followed one comprising 100 rockets on Wednesday afternoon, was one of the biggest so far in the nine months of cross-border violence which have raised fears of an all-out war.
Can the climate survive the insatiable energy demands of the AI arms race?
A recent UK government-backed report on AI safety said that the carbon intensity of the energy source used by tech firms is "a key variable" in working out the environmental cost of the technology. It adds, however, that a "significant portion" of AI model training still relies on fossil fuel-powered energy. Indeed, tech firms are hoovering up renewable energy contracts in an attempt to meet their environmental goals. Amazon, for instance, is the world's largest corporate purchaser of renewable energy. Some experts argue, though, that this pushes other energy users into fossil fuels because there is not enough clean energy to go round. "Energy consumption is not just growing, but Google is also struggling to meet this increased demand from sustainable energy sources," says Alex de Vries, the founder of Digiconomist, a website monitoring the environmental impact of new technologies.
Artificial Intelligence and Algorithmic Price Collusion in Two-sided Markets
Chica, Cristian, Guo, Yinglong, Lerman, Gilad
Algorithmic price collusion facilitated by artificial intelligence (AI) algorithms raises significant concerns. We examine how AI agents using Q-learning engage in tacit collusion in two-sided markets. Our experiments reveal that AI-driven platforms achieve higher collusion levels compared to Bertrand competition. Increased network externalities significantly enhance collusion, suggesting AI algorithms exploit them to maximize profits. Higher user heterogeneity or greater utility from outside options generally reduce collusion, while higher discount rates increase it. Tacit collusion remains feasible even at low discount rates. To mitigate collusive behavior and inform potential regulatory measures, we propose incorporating a penalty term in the Q-learning algorithm.
An Autoencoder Architecture for L-band Passive Microwave Retrieval of Landscape Freeze-Thaw Cycle
Kumawat, Divya, Ebtehaj, Ardeshir, Xu, Xiaolan, Colliander, Andreas, Kumar, Vipin
Estimating the landscape and soil freeze-thaw (FT) dynamics in the Northern Hemisphere is crucial for understanding permafrost response to global warming and changes in regional and global carbon budgets. A new framework is presented for surface FT-cycle retrievals using L-band microwave radiometry based on a deep convolutional autoencoder neural network. This framework defines the landscape FT-cycle retrieval as a time series anomaly detection problem considering the frozen states as normal and thawed states as anomalies. The autoencoder retrieves the FT-cycle probabilistically through supervised reconstruction of the brightness temperature (TB) time series using a contrastive loss function that minimizes (maximizes) the reconstruction error for the peak winter (summer). Using the data provided by the Soil Moisture Active Passive (SMAP) satellite, it is demonstrated that the framework learns to isolate the landscape FT states over different land surface types with varying complexities related to the radiometric characteristics of snow cover, lake-ice phenology, and vegetation canopy. The consistency of the retrievals is evaluated over Alaska, against in situ ground-based observations, showing reduced uncertainties compared to the traditional methods that use thresholding of the normalized polarization ratio.
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation
Zhu, Kun, Feng, Xiaocheng, Du, Xiyuan, Gu, Yuxuan, Yu, Weijiang, Wang, Haotian, Chen, Qianglong, Chu, Zheng, Chen, Jingchang, Qin, Bing
Retrieval-augmented generation integrates the capabilities of large language models with relevant information retrieved from an extensive corpus, yet encounters challenges when confronted with real-world noisy data. One recent solution is to train a filter module to find relevant content but only achieve suboptimal noise compression. In this paper, we propose to introduce the information bottleneck theory into retrieval-augmented generation. Our approach involves the filtration of noise by simultaneously maximizing the mutual information between compression and ground output, while minimizing the mutual information between compression and retrieved passage. In addition, we derive the formula of information bottleneck to facilitate its application in novel comprehensive evaluations, the selection of supervised fine-tuning data, and the construction of reinforcement learning rewards. Experimental results demonstrate that our approach achieves significant improvements across various question answering datasets, not only in terms of the correctness of answer generation but also in the conciseness with $2.5\%$ compression rate.
Entity-Level Sentiment: More than the Sum of Its Parts
Rønningstad, Egil, Klinger, Roman, Velldal, Erik, Øvrelid, Lilja
In sentiment analysis of longer texts, there may be a variety of topics discussed, of entities mentioned, and of sentiments expressed regarding each entity. We find a lack of studies exploring how such texts express their sentiment towards each entity of interest, and how these sentiments can be modelled. In order to better understand how sentiment regarding persons and organizations (each entity in our scope) is expressed in longer texts, we have collected a dataset of expert annotations where the overall sentiment regarding each entity is identified, together with the sentence-level sentiment for these entities separately. We show that the reader's perceived sentiment regarding an entity often differs from an arithmetic aggregation of sentiments at the sentence level. Only 70\% of the positive and 55\% of the negative entities receive a correct overall sentiment label when we aggregate the (human-annotated) sentiment labels for the sentences where the entity is mentioned. Our dataset reveals the complexity of entity-specific sentiment in longer texts, and allows for more precise modelling and evaluation of such sentiment expressions.