Energy
Improved Efficient Two-Stage Denoising Diffusion Power System Measurement Recovery Against False Data Injection Attacks and Data Losses
Pei, Jianhua, Wang, Jingyu, Shi, Dongyuan, Wang, Ping
Measurement uncertainties, represented by cyber-attacks and data losses, seriously degrade the quality of power system measurements. Fortunately, the powerful generation ability of the denoising diffusion models can enable more precise measurement generation for power system data recovery. However, the controllable data generation and efficient computing methods of denoising diffusion models for deterministic trajectory still need further investigation. To this end, this paper proposes an improved two-stage denoising diffusion model (TSDM) to identify and reconstruct the measurements with various measurement uncertainties. The first stage of the model comprises a classifier-guided conditional anomaly detection component, while the second stage involves diffusion-based measurement imputation component. Moreover, the proposed TSDM adopts precise means and optimal variances to accelerate the diffusion generation process with subsequence sampling. Extensive numerical case studies demonstrate that the proposed TSDM can accurately recover power system measurements despite strong randomness under renewable energy integration and highly nonlinear dynamics under complex cyber-physical contingencies. Additionally, the proposed TSDM has stronger robustness compared to existing reconstruction networks and exhibits lower computational complexity than general denoising diffusion models.
Dynamic Data-Driven Digital Twins for Blockchain Systems
Diamantopoulos, Georgios, Tziritas, Nikos, Bahsoon, Rami, Theodoropoulos, Georgios
In recent years, we have seen an increase in the adoption of blockchain-based systems in non-financial applications, looking to benefit from what the technology has to offer. Although many fields have managed to include blockchain in their core functionalities, the adoption of blockchain, in general, is constrained by the so-called trilemma trade-off between decentralization, scalability, and security. In our previous work, we have shown that using a digital twin for dynamically managing blockchain systems during runtime can be effective in managing the trilemma trade-off. Our Digital Twin leverages DDDAS feedback loop, which is responsible for getting the data from the system to the digital twin, conducting optimisation, and updating the physical system. This paper examines how leveraging DDDAS feedback loop can support the optimisation component of the trilemma benefiting from Reinforcement Learning agents and a simulation component to augment the quality of the learned model while reducing the computational overhead required for decision-making.
Constraint Model for the Satellite Image Mosaic Selection Problem
Simรณn, Manuel Combarro, Talbot, Pierre, Danoy, Grรฉgoire, Musial, Jedrzej, Alswaitti, Mohammed, Bouvry, Pascal
Satellite imagery solutions are widely used to study and monitor different regions of the Earth. However, a single satellite image can cover only a limited area. In cases where a larger area of interest is studied, several images must be stitched together to create a single larger image, called a mosaic, that can cover the area. Today, with the increasing number of satellite images available for commercial use, selecting the images to build the mosaic is challenging, especially when the user wants to optimize one or more parameters, such as the total cost and the cloud coverage percentage in the mosaic. More precisely, for this problem the input is an area of interest, several satellite images intersecting the area, a list of requirements relative to the image and the mosaic, such as cloud coverage percentage, image resolution, and a list of objectives to optimize. We contribute to the constraint and mixed integer lineal programming formulation of this new problem, which we call the \textit{satellite image mosaic selection problem}, which is a multi-objective extension of the polygon cover problem. We propose a dataset of realistic and challenging instances, where the images were captured by the satellite constellations SPOT, Pl\'eiades and Pl\'eiades Neo. We evaluate and compare the two proposed models and show their efficiency for large instances, up to 200 images.
TimeDRL: Disentangled Representation Learning for Multivariate Time-Series
Chang, Ching, Chan, Chiao-Tung, Wang, Wei-Yao, Peng, Wen-Chih, Chen, Tien-Fu
Abstract--Multivariate time-series data in numerous realworld applications (e.g., healthcare and industry) are informative but challenging due to the lack of labels and high dimensionality. Recent studies in self-supervised learning have shown their potential in learning rich representations without relying on labels, yet they fall short in learning disentangled embeddings and addressing issues of inductive bias (e.g., transformationinvariance). To tackle these challenges, we propose TimeDRL, a generic multivariate time-series representation learning framework with disentangled dual-level embeddings. The first challenge in SSL for time-series data is learning I. Existing approaches Multivariate time-series data are widely used in various focus on deriving either timestamp-level [12], [13] or instancelevel applications, such as forecasting for electric power [1], [2], embeddings [14]-[16], but not both at the same time. These time-series timestamp-level embeddings are effective for anomaly datasets are rich in information, but the patterns within and detection and forecasting, whereas instance-level embeddings across temporal dimensions are not discernible by humans, are suited for classification and clustering tasks [17]. Recently, we can theoretically avoid explicitly deriving instance-level there has been a growing trend among researchers to first learn embeddings by extracting them from timestamp-level embeddings representations/embeddings from a large amount of unlabeled using pooling methods (as illustrated in Figure 1(a)) [12], data using unsupervised representation learning and then to this approach often results in the anisotropy problem [18]- fine-tune these models with a limited amount of labeled data [20], where the embeddings are confined to a narrow cone for specific downstream tasks. Self-supervised learning (SSL) is a prominent method To the best of our knowledge, how to disentangle within unsupervised representation learning, which captures instance-level embeddings from timestamp-level embeddings generalizable representations from unlabeled data with pretext in the time-series domain remains an unexplored problem. The left sections (a) and (c) represent predictive learning, utilizing a single representation to predict inherent data characteristics.
A Machine Learning Approach to Two-Stage Adaptive Robust Optimization
Bertsimas, Dimitris, Kim, Cheol Woo
We propose an approach based on machine learning to solve two-stage linear adaptive robust optimization (ARO) problems with binary here-and-now variables and polyhedral uncertainty sets. We encode the optimal here-and-now decisions, the worst-case scenarios associated with the optimal here-and-now decisions, and the optimal wait-and-see decisions into what we denote as the strategy. We solve multiple similar ARO instances in advance using the column and constraint generation algorithm and extract the optimal strategies to generate a training set. We train a machine learning model that predicts high-quality strategies for the here-and-now decisions, the worst-case scenarios associated with the optimal here-and-now decisions, and the wait-and-see decisions. We also introduce an algorithm to reduce the number of different target classes the machine learning algorithm needs to be trained on. We apply the proposed approach to the facility location, the multi-item inventory control and the unit commitment problems. Our approach solves ARO problems drastically faster than the state-of-the-art algorithms with high accuracy.
PAPR: Proximity Attention Point Rendering
Zhang, Yanshu, Peng, Shichong, Moazeni, Alireza, Li, Ke
Learning accurate and parsimonious point cloud representations of scene surfaces from scratch remains a challenge in 3D representation learning. Existing point-based methods often suffer from the vanishing gradient problem or require a large number of points to accurately model scene geometry and texture. To address these limitations, we propose Proximity Attention Point Rendering (PAPR), a novel method that consists of a point-based scene representation and a differentiable renderer. Our scene representation uses a point cloud where each point is characterized by its spatial position, influence score, and view-independent feature vector. The renderer selects the relevant points for each ray and produces accurate colours using their associated features. PAPR effectively learns point cloud positions to represent the correct scene geometry, even when the initialization drastically differs from the target geometry. Notably, our method captures fine texture details while using only a parsimonious set of points. We also demonstrate four practical applications of our method: zero-shot geometry editing, object manipulation, texture transfer, and exposure control. More results and code are available on our project website at https://zvict.github.io/papr/.
Resource Allocation of Federated Learning for the Metaverse with Mobile Augmented Reality
Zhou, Xinyu, Liu, Chang, Zhao, Jun
The Metaverse has received much attention recently. Metaverse applications via mobile augmented reality (MAR) require rapid and accurate object detection to mix digital data with the real world. Federated learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics. Due to privacy concerns and the limited computation resources on mobile devices, we incorporate FL into MAR systems of the Metaverse to train a model cooperatively. Besides, to balance the trade-off between energy, execution latency and model accuracy, thereby accommodating different demands and application scenarios, we formulate an optimization problem to minimize a weighted combination of total energy consumption, completion time and model accuracy. Through decomposing the non-convex optimization problem into two subproblems, we devise a resource allocation algorithm to determine the bandwidth allocation, transmission power, CPU frequency and video frame resolution for each participating device. We further present the convergence analysis and computational complexity of the proposed algorithm. Numerical results show that our proposed algorithm has better performance (in terms of energy consumption, completion time and model accuracy) under different weight parameters compared to existing benchmarks.
Neural network based generation of a 1-dimensional stochastic field with turbulent velocity statistics
We define and study a fully-convolutional neural network stochastic model, NN-Turb, which generates a 1-dimensional field with some turbulent velocity statistics. In particular, the generated process satisfies the Kolmogorov 2/3 law for second order structure function. It also presents negative skewness across scales (i.e. Kolmogorov 4/5 law) and exhibits intermittency as characterized by skewness and flatness. Furthermore, our model is never in contact with turbulent data and only needs the desired statistical behavior of the structure functions across scales for training.
Robotic mouse with flexible spine moves with greater speed and agility
A mouse-like robot with an articulated spine is faster, more agile and defter at balancing than rigid competitors, but the added cost and complexity means such devices will only be suitable for some applications. Zhenshan Bing at the Technical University of Munich, Germany, and his colleagues created their robot using a 3D printer. Its flexible spine has eight joints controlled by servos, and the whole machine is about 40 centimetres long and weighs 225 grams. The team put the robot through a variety of tests with its spine rigidly locked, and then again while allowed to use its full range of movement. A balance test that involved lifting each leg in turn tipped the robot over with a rigid spine, but in the flexible test, it was able to change its centre of gravity by bowing its spine and remain upright.
Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs
Mishra, Siddhartha, Molinaro, Roberto
Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for PDEs. An abstract formalism is introduced and stability properties of the underlying PDE are leveraged to derive an estimate for the generalization error in terms of the training error and number of training samples. This abstract framework is illustrated with several examples of nonlinear PDEs. Numerical experiments, validating the proposed theory, are also presented.