Today, human operators primarily perform voltage control of the electric transmission system. As the complexity of the grid increases, so does its operation, suggesting additional automation could be beneficial. A subset of machine learning known as deep reinforcement learning (DRL) has recently shown promise in performing tasks typically performed by humans. This paper applies DRL to the transmission voltage control problem, presents open-source DRL environments for voltage control, proposes a novel modification to the "deep Q network" (DQN) algorithm, and performs experiments at scale with systems up to 500 buses. The promise of applying DRL to voltage control is demonstrated, though more research is needed to enable DRL-based techniques to consistently outperform conventional methods.

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial input uncertainty, but researchers have recently shown a need for methods that consider random uncertainty. In this paper, we propose a novel robustness certification method that upper bounds the probability of misclassification when the input noise follows an arbitrary probability distribution. This bound is cast as a chance-constrained optimization problem, which is then reformulated using input-output samples to replace the optimization constraints. The resulting optimization reduces to a linear program with an analytical solution. Furthermore, we develop a sufficient condition on the number of samples needed to make the misclassification bound hold with overwhelming probability. Our case studies on MNIST classifiers show that this method is able to certify a uniform infinity-norm uncertainty region with a radius of nearly 50 times larger than what the current state-of-the-art method can certify.

Non-intrusive reduced-order models (ROMs) have recently generated considerable interest for constructing computationally efficient counterparts of nonlinear dynamical systems emerging from various domain sciences. They provide a low-dimensional emulation framework for systems that may be intrinsically high-dimensional. This is accomplished by utilizing a construction algorithm that is purely data-driven. It is no surprise, therefore, that the algorithmic advances of machine learning have led to non-intrusive ROMs with greater accuracy and computational gains. However, in bypassing the utilization of an equation-based evolution, it is often seen that the interpretability of the ROM framework suffers. This becomes more problematic when black-box deep learning methods are used which are notorious for lacking robustness outside the physical regime of the observed data. In this article, we propose the use of a novel latent-space interpolation algorithm based on Gaussian process regression. Notably, this reduced-order evolution of the system is parameterized by control parameters to allow for interpolation in space. The use of this procedure also allows for a continuous interpretation of time which allows for temporal interpolation. The latter aspect provides information, with quantified uncertainty, about full-state evolution at a finer resolution than that utilized for training the ROMs. We assess the viability of this algorithm for an advection-dominated system given by the inviscid shallow water equations.

Effective detection of energy theft can prevent revenue losses of utility companies and is also important for smart grid security. In recent years, enabled by the massive fine-grained smart meter data, deep learning (DL) approaches are becoming popular in the literature to detect energy theft in the advanced metering infrastructure (AMI). However, as neural networks are shown to be vulnerable to adversarial examples, the security of the DL models is of concern. In this work, we study the vulnerabilities of DL-based energy theft detection through adversarial attacks, including single-step attacks and iterative attacks. From the attacker's point of view, we design the \textit{SearchFromFree} framework that consists of 1) a randomly adversarial measurement initialization approach to maximize the stolen profit and 2) a step-size searching scheme to increase the performance of black-box iterative attacks. The evaluation based on three types of neural networks shows that the adversarial attacker can report extremely low consumption measurements to the utility without being detected by the DL models. We finally discuss the potential defense mechanisms against adversarial attacks in energy theft detection.

The Smart grid (SG), generally known as the next-generation power grid emerged as a replacement for ill-suited power systems in the 21st century. It is in-tegrated with advanced communication and computing capabilities, thus it is ex-pected to enhance the reliability and the efficiency of energy distribution with minimum effects. With the massive infrastructure it holds and the underlying communication network in the system, it introduced a large volume of data that demands various techniques for proper analysis and decision making. Big data analytics, machine learning (ML), and deep learning (DL) plays a key role when it comes to the analysis of this massive amount of data and generation of valuable insights. This paper explores and surveys the Smart grid architectural elements, machine learning, and deep learning-based applications and approaches in the context of the Smart grid. In addition in terms of machine learning-based data an-alytics, this paper highlights the limitations of the current research and highlights future directions as well.

Recent wildfires in the United States have resulted in loss of life and billions of dollars, destroying countless structures and forests. Fighting wildfires is extremely complex. It is difficult to observe the true state of fires due to smoke and risk associated with ground surveillance. There are limited resources to be deployed over a massive area and the spread of the fire is challenging to predict. This paper proposes a decision-theoretic approach to combat wildfires. We model the resource allocation problem as a partially-observable Markov decision process. We also present a data-driven model that lets us simulate how fires spread as a function of relevant covariates. A major problem in using data-driven models to combat wildfires is the lack of comprehensive data sources that relate fires with relevant covariates. We present an algorithmic approach based on large-scale raster and vector analysis that can be used to create such a dataset. Our data with over 2 million data points is the first open-source dataset that combines existing fire databases with covariates extracted from satellite imagery. Through experiments using real-world wildfire data, we demonstrate that our forecasting model can accurately model the spread of wildfires. Finally, we use simulations to demonstrate that our response strategy can significantly reduce response times compared to baseline methods.

Do you ever just get really excited about an idea? Maybe you're crazy like me and want to hike the Pacific Crest Trail (as I'm moving to Seattle soon, so I can't help but get excited about the idea of flying down to San Diego and walking home). Well, this project is one of those types of ideas for me, and I hope you enjoy the ride! Before I get started, though, I want to warn you that this is quite an extensive project, and so I'm breaking it up into parts. While working on a project for work one day, I came across a paper that introduced a novel idea.

In Milan, Italy, STIIMA, the National Research Council's Institute for Smart Industrial Technology Systems for Advanced Manufacturing, and the Polytechnic University of Milan have set up a joint experimental "re-manufacturing" and "de-manufacturing" facility. While still at a pilot experimental level, this is an excellent example of the enormous potential of artificial intelligence in the circular economy. This is because there are no similar plants in the world capable of managing electronic waste, understanding what the items are, dismantling them and recovering their useful or valuable components. For this reason, millions of tonnes of old TVs, monitors, broken PCs, telephones, and electrical appliances of every type, are piling up at waste sites, from where they are often taken to fuel an illegal and extremely polluting market. Its real size is difficult to estimate, but according to UNEP, the United Nations Environmental Protection agency, the global market for electronic waste is worth more than 62 billion dollars and only 20% of it is officially recycled.

RADAR satellites can collect massive amounts of remote sensing data that can detect ground movements--surface defomations--at volcanoes in near real time. These ground movements could signal impending volcanic activity and unrest; however, clouds and other atmospheric and instrumental disturbances can introduce significant errors in those ground movement measurements. Now, Penn State researchers have used artificial intelligence (AI) to clear up that noise, drastically facilitating and improving near real-time observation of volcanic movements and the detection of volcanic activity and unrest. "The shape of volcanoes is constantly changing and much of that change is due to underground magma movements in the magma plumbing system made of magma reservoirs and conduits," said Christelle Wauthier, associate professor of geosciences and Institute for Data and Computational Sciences (ICDS) faculty fellow. "Much of this movement is subtle and cannot be picked up by the naked eye."

From the simplest unicellular organisms to complex animals, feedback control based on sensing and actuation is a staple of self‐regulation in biological processes and is a key to life itself. Malfunctioning of this control loop can often lead to disease or death. Bioelectronic devices that interface electronics with biological systems can be used for sensing and actuation of biological processes and have potential for novel therapeutic applications. Due to the complexity of biological systems and the challenge of affecting their innate self‐regulation, closing the loop between sensing and actuation with bioelectronics is difficult to achieve. Herein, bioelectronic proton‐conducting devices are integrated with fluorescence sensing using machine learning to provide closed‐loop control of bioelectronic actuation in living cells.