Energy
RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators
Fabiani, Gianluca, Kevrekidis, Ioannis G., Siettos, Constantinos, Yannacopoulos, Athanasios N.
Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space of parameters and hyperparameters. This fact, along with the requirement of substantial computational resources, poses a barrier to achieving high numerical accuracy. Here, inpsired by DeepONets and to address the above challenges, we present Random Projection-based Operator Networks (RandONets): shallow networks with random projections that learn linear and nonlinear operators. The implementation of RandONets involves: (a) incorporating random bases, thus enabling the use of shallow neural networks with a single hidden layer, where the only unknowns are the output weights of the network's weighted inner product; this reduces dramatically the dimensionality of the parameter space; and, based on this, (b) using established least-squares solvers (e.g., Tikhonov regularization and preconditioned QR decomposition) that offer superior numerical approximation properties compared to other optimization techniques used in deep-learning. In this work, we prove the universal approximation accuracy of RandONets for approximating nonlinear operators and demonstrate their efficiency in approximating linear nonlinear evolution operators (right-hand-sides (RHS)) with a focus on PDEs. We show, that for this particular task, RandONets outperform, both in terms of numerical approximation accuracy and computational cost, the ``vanilla" DeepOnets.
Adaptive Layer Splitting for Wireless LLM Inference in Edge Computing: A Model-Based Reinforcement Learning Approach
Chen, Yuxuan, Li, Rongpeng, Yu, Xiaoxue, Zhao, Zhifeng, Zhang, Honggang
Optimizing the deployment of large language models (LLMs) in edge computing environments is critical for enhancing privacy and computational efficiency. Toward efficient wireless LLM inference in edge computing, this study comprehensively analyzes the impact of different splitting points in mainstream open-source LLMs. On this basis, this study introduces a framework taking inspiration from model-based reinforcement learning (MBRL) to determine the optimal splitting point across the edge and user equipment (UE). By incorporating a reward surrogate model, our approach significantly reduces the computational cost of frequent performance evaluations. Extensive simulations demonstrate that this method effectively balances inference performance and computational load under varying network conditions, providing a robust solution for LLM deployment in decentralized settings.
Taking Second-life Batteries from Exhausted to Empowered using Experiments, Data Analysis, and Health Estimation
Cui, Xiaofan, Khan, Muhammad Aadil, Pozzato, Gabriele, Singh, Surinder, Sharma, Ratnesh, Onori, Simona
The reuse of retired electric vehicle batteries in grid energy storage offers environmental and economic benefits. This study concentrates on health monitoring algorithms for retired batteries deployed in grid storage. Over 15 months of testing, we collect, analyze, and publicize a dataset of second-life batteries, implementing a cycling protocol simulating grid energy storage load profiles within a 3-4 V voltage window. Four machine-learning-based health estimation models, relying on online-accessible features and initial capacity, are compared, with the selected model achieving a mean absolute percentage error below 2.3% on test data. Additionally, an adaptive online health estimation algorithm is proposed by integrating a clustering-based method, thus limiting estimation errors during online deployment. These results showcase the feasibility of repurposing retired batteries for second-life applications. Based on obtained data and power demand, these second-life batteries exhibit potential for over a decade of grid energy storage use.
Hinge-FM2I: An Approach using Image Inpainting for Interpolating Missing Data in Univariate Time Series
Saad, Noufel, Nadir, Maaroufi, Mehdi, Najib, Mohamed, Bakhouya
Accurate time series forecasts are crucial for various applications, such as traffic management, electricity consumption, and healthcare. However, limitations in models and data quality can significantly impact forecasts accuracy. One common issue with data quality is the absence of data points, referred to as missing data. It is often caused by sensor malfunctions, equipment failures, or human errors. This paper proposes Hinge-FM2I, a novel method for handling missing data values in univariate time series data. Hinge-FM2I builds upon the strengths of the Forecasting Method by Image Inpainting (FM2I). FM2I has proven effective, but selecting the most accurate forecasts remain a challenge. To overcome this issue, we proposed a selection algorithm. Inspired by door hinges, Hinge-FM2I drops a data point either before or after the gap (left/right-hinge), then use FM2I for imputation, and then select the imputed gap based on the lowest error of the dropped data point. Hinge-FM2I was evaluated on a comprehensive sample composed of 1356 time series, extracted from the M3 competition benchmark dataset, with missing value rates ranging from 3.57\% to 28.57\%. Experimental results demonstrate that Hinge-FM2I significantly outperforms established methods such as, linear/spline interpolation, K-Nearest Neighbors (K-NN), and ARIMA. Notably, Hinge-FM2I achieves an average Symmetric Mean Absolute Percentage Error (sMAPE) score of 5.6\% for small gaps, and up to 10\% for larger ones. These findings highlight the effectiveness of Hinge-FM2I as a promising new method for addressing missing values in univariate time series data.
Computer made out of human BRAINS could solve the world's energy crisis - here's the scientist making science fiction reality
There is a lot of fear about robots replacing human. But maybe it should be the machines worrying about us. Swedish scientists have created the world's first'living computer' that is made out of human brain tissue. It composes of 16 organoids, or clumps of brain cells that were grown in a lab, which send information between each other. They work much like a traditional computer chip - sending and receiving signals through their neurons that act like circuits.
Urgent fire safety warning issued over the bizarre AI gadget that projects a display onto your PALM - dubbed the 'worst produced ever reviewed'
Silicon Valley startup Humane has told users to stop using the charging case that came with its AI Pin, citing safety concerns. In an email, the firm asks users to'immediately stop using and charging your Charge Case' due to an issue with'certain battery cells'. Battery cells โ containers that chemically store energy in the charger โ are defective and'may pose a fire safety risk', it warns. AI Pin is the bizarre gadget that projects a display onto your palm, but it's been blasted for issues including overheating and AI that delivers'incorrect answers'. It comes as Humane reportedly attempts to sell itself to US tech giant HP for around 1 billion.
Scientists discover the 'Gateway to Hell' in Siberia is expanding rapidly - it can be seen from SPACE
A 200-acre wide, nearly 300-foot deep pit in the Yana highlands of Siberia, known as the'Batagaika Crater,' is expanding faster than expected due to climate change. Sometimes called the'Gateway to Hell,' the Batagaika Crater first formed when melting'permafrost' soil within the Siberian tundra began to release tons of previously frozen methane, a powerful greenhouse gas, into Earth's atmosphere. Now, new research has discovered that the rate of methane and other carbon gases released as the crater deepens has reached between 4000 and 5000 tons per year. The findings, according to the study's lead author, 'demonstrate how quickly permafrost degradation occurs.' He warns the crater is soon likely to leak all the remaining greenhouse gas it has left.
M2NO: Multiresolution Operator Learning with Multiwavelet-based Algebraic Multigrid Method
Li, Zhihao, Lai, Zhilu, Wang, Xiaobo, Wang, Wei
Solving partial differential equations (PDEs) effectively necessitates a multi-scale approach, particularly critical in high-dimensional scenarios characterized by increasing grid points or resolution. Traditional methods often fail to capture the detailed features necessary for accurate modeling, presenting a significant challenge in scientific computing. In response, we introduce the Multiwavelet-based Algebraic Multigrid Neural Operator (M2NO), a novel deep learning framework that synergistically combines multiwavelet transformations and algebraic multigrid (AMG) techniques. By exploiting the inherent similarities between these two approaches, M2NO overcomes their individual limitations and enhances precision and flexibility across various PDE benchmarks. Employing Multiresolution Analysis (MRA) with high-pass and low-pass filters, the model executes hierarchical decomposition to accurately delineate both global trends and localized details within PDE solutions, supporting adaptive data representation at multiple scales. M2NO also automates node selection and adeptly manages complex boundary conditions through its multiwavelet-based operators. Extensive evaluations on a diverse array of PDE datasets with different boundary conditions confirm M2NO's superior performance.
CarbonSense: A Multimodal Dataset and Baseline for Carbon Flux Modelling
Fortier, Matthew, Richter, Mats L., Sonnentag, Oliver, Pal, Chris
Terrestrial carbon fluxes provide vital information about our biosphere's health and its capacity to absorb anthropogenic CO$_2$ emissions. The importance of predicting carbon fluxes has led to the emerging field of data-driven carbon flux modelling (DDCFM), which uses statistical techniques to predict carbon fluxes from biophysical data. However, the field lacks a standardized dataset to promote comparisons between models. To address this gap, we present CarbonSense, the first machine learning-ready dataset for DDCFM. CarbonSense integrates measured carbon fluxes, meteorological predictors, and satellite imagery from 385 locations across the globe, offering comprehensive coverage and facilitating robust model training. Additionally, we provide a baseline model using a current state-of-the-art DDCFM approach and a novel transformer based model. Our experiments illustrate the potential gains that multimodal deep learning techniques can bring to this domain. By providing these resources, we aim to lower the barrier to entry for other deep learning researchers to develop new models and drive new advances in carbon flux modelling.
Time-Series JEPA for Predictive Remote Control under Capacity-Limited Networks
Girgis, Abanoub M., Valcarce, Alvaro, Bennis, Mehdi
In remote control systems, transmitting large data volumes (e.g. video feeds) from wireless sensors to faraway controllers is challenging when the uplink channel capacity is limited (e.g. RedCap devices or massive wireless sensor networks). Furthermore, the controllers often only need the information-rich components of the original data. To address this, we propose a Time-Series Joint Embedding Predictive Architecture (TS-JEPA) and a semantic actor trained through self-supervised learning. This approach harnesses TS-JEPA's semantic representation power and predictive capabilities by capturing spatio-temporal correlations in the source data. We leverage this to optimize uplink channel utilization, while the semantic actor calculates control commands directly from the encoded representations, rather than from the original data. We test our model through multiple parallel instances of the well-known inverted cart-pole scenario, where the approach is validated through the maximization of stability under constrained uplink channel capacity.