Energy
Detecting Abnormal Operations in Concentrated Solar Power Plants from Irregular Sequences of Thermal Images
Patra, Sukanya, Sournac, Nicolas, Taieb, Souhaib Ben
Concentrated Solar Power (CSP) plants store energy by heating a storage medium with an array of mirrors that focus sunlight onto solar receivers atop a central tower. Operating at high temperatures these receivers face risks such as freezing, deformation, and corrosion, leading to operational failures, downtime, or costly equipment damage. We study the problem of anomaly detection (AD) in sequences of thermal images collected over a year from an operational CSP plant. These images are captured at irregular intervals ranging from one to five minutes throughout the day by infrared cameras mounted on solar receivers. Our goal is to develop a method to extract useful representations from high-dimensional thermal images for AD. It should be able to handle temporal features of the data, which include irregularity, temporal dependency between images and non-stationarity due to a strong daily seasonal pattern. The co-occurrence of low-temperature anomalies that resemble normal images from the start and the end of the operational cycle with high-temperature anomalies poses an additional challenge. We first evaluate state-of-the-art deep image-based AD methods, which have been shown to be effective in deriving meaningful image representations for the detection of anomalies. Then, we introduce a forecasting-based AD method that predicts future thermal images from past sequences and timestamps via a deep sequence model. This method effectively captures specific temporal data features and distinguishes between difficult-to-detect temperature-based anomalies. Our experiments demonstrate the effectiveness of our approach compared to multiple SOTA baselines across multiple evaluation metrics. We have also successfully deployed our solution on five months of unseen data, providing critical insights for the maintenance of the CSP plant. Our code is available at: https://tinyurl.com/ForecastAD
Using Game Engines and Machine Learning to Create Synthetic Satellite Imagery for a Tabletop Verification Exercise
Hoster, Johannes, Al-Sayed, Sara, Biessmann, Felix, Glaser, Alexander, Hildebrand, Kristian, Moric, Igor, Nguyen, Tuong Vy
Satellite imagery is regarded as a great opportunity for citizen-based monitoring of activities of interest. Relevant imagery may however not be available at sufficiently high resolution, quality, or cadence -- let alone be uniformly accessible to open-source analysts. This limits an assessment of the true long-term potential of citizen-based monitoring of nuclear activities using publicly available satellite imagery. In this article, we demonstrate how modern game engines combined with advanced machine-learning techniques can be used to generate synthetic imagery of sites of interest with the ability to choose relevant parameters upon request; these include time of day, cloud cover, season, or level of activity onsite. At the same time, resolution and off-nadir angle can be adjusted to simulate different characteristics of the satellite. While there are several possible use-cases for synthetic imagery, here we focus on its usefulness to support tabletop exercises in which simple monitoring scenarios can be examined to better understand verification capabilities enabled by new satellite constellations and very short revisit times.
Accelerating Matrix Diagonalization through Decision Transformers with Epsilon-Greedy Optimization
Bhatta, Kshitij, Zollicoffer, Geigh, Bhattarai, Manish, Romero, Phil, Negre, Christian F. A., Niklasson, Anders M. N., Adedoyin, Adetokunbo
This paper introduces a novel framework for matrix diagonalization, recasting it as a sequential decision-making problem and applying the power of Decision Transformers (DTs). Our approach determines optimal pivot selection during diagonalization with the Jacobi algorithm, leading to significant speedups compared to the traditional max-element Jacobi method. To bolster robustness, we integrate an epsilon-greedy strategy, enabling success in scenarios where deterministic approaches fail. This work demonstrates the effectiveness of DTs in complex computational tasks and highlights the potential of reimagining mathematical operations through a machine learning lens. Furthermore, we establish the generalizability of our method by using transfer learning to diagonalize matrices of smaller sizes than those trained.
Preference Tuning For Toxicity Mitigation Generalizes Across Languages
Li, Xiaochen, Yong, Zheng-Xin, Bach, Stephen H.
We investigate the mechanisms enabling crosslingual generalization of safety preference tuning. While significant resources have been allocated Recent work (Lee et al., 2024) shows that models to enhance the safety of large language models trained via DPO do not lose the ability to generate (LLMs) for deployment, safety of multilingual toxic content; instead, they learn to suppress the LLMs remains underexplored (Yong et al., 2023a; neuron activations that lead to toxicity, focusing on Deng et al., 2024). Recent work has shown that the role of key and value vectors in Multi-Layer multilingual LLMs have significant toxicity levels Perceptrons (MLP). While these findings explain and therefore highlights the need for multilingual DPO's effectiveness in the training language, they toxicity mitigation (Jain et al., 2024). However, to do not address its cross-lingual generalization. To reduce toxicity in open-ended generations in a non-bridge this gap, we extend the analysis to a multilingual English language X, current solutions (Pozzobon context, and we demonstrate that both key et al., 2024; Liu et al., 2021; Pozzobon et al., 2023; Dementieva et al., 2024) are resource-intensive as
LSKNet: A Foundation Lightweight Backbone for Remote Sensing
Li, Yuxuan, Li, Xiang, Dai, Yimian, Hou, Qibin, Liu, Li, Liu, Yongxiang, Cheng, Ming-Ming, Yang, Jian
Remote sensing images pose distinct challenges for downstream tasks due to their inherent complexity. While a considerable amount of research has been dedicated to remote sensing classification, object detection and semantic segmentation, most of these studies have overlooked the valuable prior knowledge embedded within remote sensing scenarios. Such prior knowledge can be useful because remote sensing objects may be mistakenly recognized without referencing a sufficiently long-range context, which can vary for different objects. This paper considers these priors and proposes a lightweight Large Selective Kernel Network (LSKNet) backbone. LSKNet can dynamically adjust its large spatial receptive field to better model the ranging context of various objects in remote sensing scenarios. To our knowledge, large and selective kernel mechanisms have not been previously explored in remote sensing images. Without bells and whistles, our lightweight LSKNet sets new state-of-the-art scores on standard remote sensing classification, object detection and semantic segmentation benchmarks. Our comprehensive analysis further validated the significance of the identified priors and the effectiveness of LSKNet. The code is available at https://github.com/zcablii/LSKNet.
Chain-of-Probe: Examing the Necessity and Accuracy of CoT Step-by-Step
Wang, Zezhong, Zeng, Xingshan, Liu, Weiwen, Wang, Yufei, Li, Liangyou, Wang, Yasheng, Shang, Lifeng, Jiang, Xin, Liu, Qun, Wong, Kam-Fai
Current research found the issue of Early Answering in large language models (LLMs), where the models already have an answer before generating the Chain-of-Thought (CoT). This phenomenon suggests a potential lack of necessary dependency between the predicted answer and the reasoning process. Consequently, two important questions arise: (1) Is CoT still necessary if the model already has an answer? (2) Can the correctness of the answer serve as valid evidence for the correctness of CoT? To address these questions, we propose a method, namely Chain-of-Probe (CoP), to probe changes in the mind during the model's reasoning. The probing results show that in a significant number of question-answer cases, CoT appears to be unnecessary, and this necessity correlates with the simplicity of the task, defined by reasoning steps required. Furthermore, by analyzing patterns in mind change, we examine the correctness of the model's reasoning. Our validation reveals that many responses, although correct in their final answer, contain errors in their reasoning process. To this end, we propose a strategic approach based on CoP to prioritize answers with correct reasoning among multiple candidates, thereby bolstering the reliability of the model's reasoning.
Extending Token Computation for LLM Reasoning
Liao, Bingli, Vargas, Danilo Vasconcellos
Large Language Models (LLMs) are pivotal in advancing natural language processing but often struggle with complex reasoning tasks due to inefficient attention distributions. In this paper, we explore the effect of increased computed tokens on LLM performance and introduce a novel method for extending computed tokens in the Chain-of-Thought (CoT) process, utilizing attention mechanism optimization. By fine-tuning an LLM on a domain-specific, highly structured dataset, we analyze attention patterns across layers, identifying inefficiencies caused by non-semantic tokens with outlier high attention scores. To address this, we propose an algorithm that emulates early layer attention patterns across downstream layers to re-balance skewed attention distributions and enhance knowledge abstraction. Our findings demonstrate that our approach not only facilitates a deeper understanding of the internal dynamics of LLMs but also significantly improves their reasoning capabilities, particularly in non-STEM domains. Our study lays the groundwork for further innovations in LLM design, aiming to create more powerful, versatile, and responsible models capable of tackling a broad range of real-world applications.
Welcome to Glastonbury... of the future! From virtual reality tickets to cooling tents due to climate change, here's what the famous festival could look like in 2050
With almost 20 times as many fans flocking to Worthy Farm, Glastonbury has come a long way since its humble beginnings in 1971. And while many of those original festival-goers may hardly recognise the festival due to open next week, the festival of the future could be even stranger. From cooling tents to beat the summer heat to holographic performers and haptic dancefloors, experts reveal what it might be like to visit Glastonbury 2050. With climate change set to make summers hotter and wetter, festivals will need to find new ways to keep fans safe against the extremes of a changing climate. From virtual bands to cooling tents and lab-grown burgers, here's what the famous festival could be like in 2050 Cooling tents to beat climate change induced heatwaves.
Russia-Ukraine war: List of key events, day 848
Ukraine's energy ministry has said that overnight Russian drones and missiles have attacked the country's energy transmission systems in southern and western Ukraine. Two energy workers have been injured as a result of these attacks on Zaporizhia Oblast. Ukraine has said it was dispatching reinforcements to an embattled strategic hilltop town of Chasiv Yar in the eastern Donetsk region, a vital flashpoint whose capture could accelerate Russian advances deeper in the industrial territory. The Ukrainian military has launched a wave of drones that struck three oil refineries inside southern Russia overnight, a security official said on Friday. Russian regional authorities in the Krasnodar region said four people were injured, including oil refinery workers, as a result of drone strikes.
AI-Driven Approaches for Optimizing Power Consumption: A Comprehensive Survey
Biswas, Parag, Rashid, Abdur, Biswas, Angona, Nasim, Md Abdullah Al, Gupta, Kishor Datta, George, Roy
Reduced environmental effect, lower operating costs, and a stable and sustainable energy supply for current and future generations are the main reasons why power optimization is important. Power optimization makes ensuring that energy is used more effectively, cutting down on waste and optimizing the utilization of resources.In today's world, power optimization and artificial intelligence (AI) integration are essential to changing the way energy is produced, used, and distributed. Real-time monitoring and analysis of power usage trends is made possible by AI-driven algorithms and predictive analytics, which enable dynamic modifications to effectively satisfy demand. Efficiency and sustainability are increased when power consumption is optimized in different sectors thanks to the use of intelligent systems. This survey paper comprises an extensive review of the several AI techniques used for power optimization as well as a methodical analysis of the literature for the study of various intelligent system application domains across different disciplines of power consumption.This literature review identifies the performance and outcomes of 17 different research methods by assessing them, and it aims to distill valuable insights into their strengths and limitations. Furthermore, this article outlines future directions in the integration of AI for power consumption optimization.