Energy
Mitigating LLM Hallucinations with Knowledge Graphs: A Case Study
Li, Harry, Appleby, Gabriel, Alperin, Kenneth, Gomez, Steven R, Suh, Ashley
High-stakes domains like cyber operations need responsible and trustworthy AI methods. While large language models (LLMs) are becoming increasingly popular in these domains, they still suffer from hallucinations. This research paper provides learning outcomes from a case study with LinkQ, an open-source natural language interface that was developed to combat hallucinations by forcing an LLM to query a knowledge graph (KG) for ground-truth data during question-answering (QA). We conduct a quantitative evaluation of LinkQ using a well-known KGQA dataset, showing that the system outperforms GPT-4 but still struggles with certain question categories - suggesting that alternative query construction strategies will need to be investigated in future LLM querying systems. We discuss a qualitative study of LinkQ with two domain experts using a real-world cybersecurity KG, outlining these experts' feedback, suggestions, perceived limitations, and future opportunities for systems like LinkQ.
Standardization of Multi-Objective QUBOs
Lee, Loong Kuan, Gerlach, Thore Thassilo, Piatkowski, Nico
Multi-objective optimization involving Quadratic Unconstrained Binary Optimization (QUBO) problems arises in various domains. A fundamental challenge in this context is the effective balancing of multiple objectives, each potentially operating on very different scales. This imbalance introduces complications such as the selection of appropriate weights when scalarizing multiple objectives into a single objective function. In this paper, we propose a novel technique for scaling QUBO objectives that uses an exact computation of the variance of each individual QUBO objective. By scaling each objective to have unit variance, we align all objectives onto a common scale, thereby allowing for more balanced solutions to be found when scalarizing the objectives with equal weights, as well as potentially assisting in the search or choice of weights during scalarization. Finally, we demonstrate its advantages through empirical evaluations on various multi-objective optimization problems. Our results are noteworthy since manually selecting scalarization weights is cumbersome, and reliable, efficient solutions are scarce.
Towards an AI Observatory for the Nuclear Sector: A tool for anticipatory governance
Verma, Aditi, Williams, Elizabeth
AI models are rapidly becoming embedded in all aspects of nuclear energy research and work but the safety, security, and safeguards consequences of this embedding are not well understood. In this paper, we call for the creation of an anticipatory system of governance for AI in the nuclear sector as well as the creation of a global AI observatory as a means for operationalizing anticipatory governance. The paper explores the contours of the nuclear AI observatory and an anticipatory system of governance by drawing on work in science and technology studies, public policy, and foresight studies.
Meta-Evaluating Local LLMs: Rethinking Performance Metrics for Serious Games
Isaza-Giraldo, Andrรฉs, Bala, Paulo, Pereira, Lucas
The evaluation of open-ended responses in serious games presents a unique challenge, as correctness is often subjective. Large Language Models (LLMs) are increasingly being explored as evaluators in such contexts, yet their accuracy and consistency remain uncertain, particularly for smaller models intended for local execution. This study investigates the reliability of five small-scale LLMs when assessing player responses in \textit{En-join}, a game that simulates decision-making within energy communities. By leveraging traditional binary classification metrics (including accuracy, true positive rate, and true negative rate), we systematically compare these models across different evaluation scenarios. Our results highlight the strengths and limitations of each model, revealing trade-offs between sensitivity, specificity, and overall performance. We demonstrate that while some models excel at identifying correct responses, others struggle with false positives or inconsistent evaluations. The findings highlight the need for context-aware evaluation frameworks and careful model selection when deploying LLMs as evaluators. This work contributes to the broader discourse on the trustworthiness of AI-driven assessment tools, offering insights into how different LLM architectures handle subjective evaluation tasks.
Data Metabolism: An Efficient Data Design Schema For Vision Language Model
Zhang, Jingyuan, Zhang, Hongzhi, Haonan, Zhou, Sun, Chenxi, ji, Xingguang, Wang, Jiakang, Kong, Fanheng, Liu, Yahui, Wang, Qi, Zhang, Fuzheng
Data curation plays a crucial role in training powerful Visual Language Models (VLMs). In this work, we introduce the concept of Data Metabolism and present our data-centric framework to build VLMs throughout the development lifecycle. Starting from a standard model architecture, we discuss and provide insights into two crucial development steps: data curation and iteration, forming a closed-loop system that continuously improves model performance. We show a detailed codebook on how to process existing massive datasets and build user-specific data flywheel. As a demonstration, we release a VLM, named Capybara-VL, which excels in typical multimodal tasks (e.g. , visual question answering, scientific reasoning, and text-rich tasks). Despite its relatively compact size, Capybara-VL surpasses several open-source models that are up to 10 times larger in size. Moreover, it achieves results that are on par with those of several leading proprietary models, demonstrating its remarkable competitiveness. These results highlight the power of our data-centric framework and the potential of training smaller and more efficient VLMs.
Variational quantum and neural quantum states algorithms for the linear complementarity problem
De, Saibal, Knitter, Oliver, Kodati, Rohan, Jayakumar, Paramsothy, Stokes, James, Veerapaneni, Shravan
Variational quantum algorithms (VQAs) are promising hybrid quantum-classical methods designed to leverage the computational advantages of quantum computing while mitigating the limitations of current noisy intermediate-scale quantum (NISQ) hardware. Although VQAs have been demonstrated as proofs of concept, their practical utility in solving real-world problems -- and whether quantum-inspired classical algorithms can match their performance -- remains an open question. We present a novel application of the variational quantum linear solver (VQLS) and its classical neural quantum states-based counterpart, the variational neural linear solver (VNLS), as key components within a minimum map Newton solver for a complementarity-based rigid body contact model. We demonstrate using the VNLS that our solver accurately simulates the dynamics of rigid spherical bodies during collision events. These results suggest that quantum and quantum-inspired linear algebra algorithms can serve as viable alternatives to standard linear algebra solvers for modeling certain physical systems.
These four charts sum up the state of AI and energy
A new report from the International Energy Agency digs into the details of energy and AI, and I think it's worth looking at some of the data to help clear things up. Here are four charts from the report that sum up the crucial points about AI and energy demand. This point is the most obvious, but it bears repeating: AI is exploding, and it's going to lead to higher energy demand from data centers. "AI has gone from an academic pursuit to an industry with trillions of dollars at stake," as the IEA report's executive summary puts it. Data centers used less than 300 terawatt-hours of electricity in 2020.
U.K. raises alarm on Chinese drones used to survey sensitive sites
U.K. government officials have raised private concerns that Chinese-manufactured drones are being used to take high resolution images of critical national infrastructure sites in the U.K., going against guidance from the country's security services. National Grid PLC, which operates the nation's electricity and gas networks, uses drones made by Shenzhen-based SZ DJI Technology to take videos, photographs and thermal images of its electricity substations, according to information posted on its website as recently as September. DJI drones have also been used to survey the construction of Electricite de France SA's Hinkley Point C nuclear power plant, to inspect solar farms, and by Thames Water to monitor reservoirs and the water supply. Deployment of the drones comes despite a warning in 2023 by the U.K.'s National Protective Security Authority (NPSA), part of the domestic security service MI5, that British organizations managing sensitive sites should be wary of using drones "manufactured in countries with coercive data sharing practices," a reference to China. Moreover, in 2022, the U.S. Department of Defense included DJI on a blacklist of Chinese firms with military ties.
SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fields
Park, David Keetae, Luo, Xihaier, Zhao, Guang, Lee, Seungjun, Oprescu, Miruna, Yoo, Shinjae
Spatiotemporal learning is challenging due to the intricate interplay between spatial and temporal dependencies, the high dimensionality of the data, and scalability constraints. These challenges are further amplified in scientific domains, where data is often irregularly distributed (e.g., missing values from sensor failures) and high-volume (e.g., high-fidelity simulations), posing additional computational and modeling difficulties. In this paper, we present SCENT, a novel framework for scalable and continuity-informed spatiotemporal representation learning. SCENT unifies interpolation, reconstruction, and forecasting within a single architecture. Built on a transformer-based encoder-processor-decoder backbone, SCENT introduces learnable queries to enhance generalization and a query-wise cross-attention mechanism to effectively capture multi-scale dependencies. To ensure scalability in both data size and model complexity, we incorporate a sparse attention mechanism, enabling flexible output representations and efficient evaluation at arbitrary resolutions. We validate SCENT through extensive simulations and real-world experiments, demonstrating state-of-the-art performance across multiple challenging tasks while achieving superior scalability.
Battery-aware Cyclic Scheduling in Energy-harvesting Federated Learning
Jeong, Eunjeong, Pappas, Nikolaos
Federated Learning (FL) has emerged as a promising framework for distributed learning, but its growing complexity has led to significant energy consumption, particularly from computations on the client side. This challenge is especially critical in energy-harvesting FL (EHFL) systems, where device availability fluctuates due to limited and time-varying energy resources. We propose FedBacys, a battery-aware FL framework that introduces cyclic client participation based on users' battery levels to cope with these issues. FedBacys enables clients to save energy and strategically perform local training just before their designated transmission time by clustering clients and scheduling their involvement sequentially. This design minimizes redundant computation, reduces system-wide energy usage, and improves learning stability. Our experiments demonstrate that FedBacys outperforms existing approaches in terms of energy efficiency and performance consistency, exhibiting robustness even under non-i.i.d. training data distributions and with very infrequent battery charging. This work presents the first comprehensive evaluation of cyclic client participation in EHFL, incorporating both communication and computation costs into a unified, resource-aware scheduling strategy.