Energy
AI Weekly: AI researchers release toolkit to promote AI that helps to achieve sustainability goals
While discussions about AI often center around the technology's commercial potential, increasingly, researchers are investigating ways that AI can be harnessed to drive societal change. Among others, Facebook chief AI scientist Yann LeCun and Google Brain cofounder Andrew Ng have argued that mitigating climate change and promoting energy efficiency are preeminent challenges for AI researchers. Along this vein, researchers at the Montreal AI Ethics Institute have proposed a framework designed to quantify the social impact of AI through techniques like compute-efficient machine learning. An IBM project delivers farm cultivation recommendations from digital farm "twins" that simulate the future soil conditions of real-world crops. Other researchers are using AI-generated images to help visualize climate change, and nonprofits like WattTime are working to reduce households' carbon footprint by automating when electric vehicles, thermostats, and appliances are active based on where renewable energy is available.
Towards Autonomous Satellite Communications: An AI-based Framework to Address System-level Challenges
Garau-Luis, Juan Jose, Eiskowitz, Skylar, Pachler, Nils, Crawley, Edward, Cameron, Bruce
The next generation of satellite constellations is designed to better address the future needs of our connected society: highly-variable data demand, mobile connectivity, and reaching more under-served regions. Artificial Intelligence (AI) and learning-based methods are expected to become key players in the industry, given the poor scalability and slow reaction time of current resource allocation mechanisms. While AI frameworks have been validated for isolated communication tasks or subproblems, there is still not a clear path to achieve fully-autonomous satellite systems. Part of this issue results from the focus on subproblems when designing models, instead of the necessary system-level perspective. In this paper we try to bridge this gap by characterizing the system-level needs that must be met to increase satellite autonomy, and introduce three AI-based components (Demand Estimator, Offline Planner, and Real Time Engine) that jointly address them. We first do a broad literature review on the different subproblems and identify the missing links to the system-level goals. In response to these gaps, we outline the three necessary components and highlight their interactions. We also discuss how current models can be incorporated into the framework and possible directions of future work.
Technical Language Supervision for Intelligent Fault Diagnosis in Process Industry
Löwenmark, Karl, Taal, Cees, Schnabel, Stephan, Liwicki, Marcus, Sandin, Fredrik
In the process industry, condition monitoring systems with automated fault diagnosis methods assisthuman experts and thereby improve maintenance efficiency, process sustainability, and workplace safety.Improving the automated fault diagnosis methods using data and machine learning-based models is a centralaspect of intelligent fault diagnosis (IFD). A major challenge in IFD is to develop realistic datasets withaccurate labels needed to train and validate models, and to transfer models trained with labeled lab datato heterogeneous process industry environments. However, fault descriptions and work-orders written bydomain experts are increasingly digitized in modern condition monitoring systems, for example in the contextof rotating equipment monitoring. Thus, domain-specific knowledge about fault characteristics and severitiesexists as technical language annotations in industrial datasets. Furthermore, recent advances in naturallanguage processing enable weakly supervised model optimization using natural language annotations, mostnotably in the form ofnatural language supervision(NLS). This creates a timely opportunity to developtechnical language supervision(TLS) solutions for IFD systems grounded in industrial data, for exampleas a complement to pre-training with lab data to address problems like overfitting and inaccurate out-of-sample generalisation. We surveyed the literature and identify a considerable improvement in the maturityof NLS over the last two years, facilitating applications beyond natural language; a rapid development ofweak supervision methods; and transfer learning as a current trend in IFD which can benefit from thesedevelopments. Finally, we describe a framework for integration of TLS in IFD which is inspired by recentNLS innovations.
Remotely-Piloted Delivery Service Expands Its Capabilities
Coco, the robot based delivery service, announced the official launch of COCO 1, a larger, more advanced version of its signature pink bot. The COCO 1 is a first of its kind delivery robot designed and manufactured in partnership with the largest micro mobility hardware manufacturer, Segway. Coco is currently deploying 1,000s of COCO 1 robots to serve local merchants in multiple cities, over the next few months. With its increased carrying capacity, the COCO 1 will deliver larger orders for a wider range of merchants, further eliminating the need for car-based delivery. Compared to the current model, the COCO 1 offers a number of added features including a more efficient drivetrain and a larger battery capacity that allows for an increased delivery radius of up to three miles, nearly double the radius of the original model.
Google lends a hand in the search for new solar cell designs with open-source tool
The number of materials with the potential for use in each of the many layers in a solar cell is enormous. And even once they have chosen one to work with, scientists need to understand its interactions with the other materials present, and the effects of changing parameters such as layer thickness, dopant concentration and a wealth of others in order to get the best out of the cells they are working on. With so many possibilities, this can be a time-consuming process. And scientists today are increasingly able to turn to artificial intelligence to guide them in the next steps to take in practical lab work. And developing a system to do just that for solar cell design was the focus of a group of researchers at the Massachusetts Institute of Technology (MIT), who worked with experts at Google Brain to develop a system to evaluate the potential of different solar cell designs, and also predict which changes would provide improved performance characteristics.
Machine learning method could speed the search for new battery materials
To discover materials for better batteries, researchers must wade through a vast field of candidates. New research demonstrates a machine learning technique that could more quickly surface ones with the most desirable properties. The study could accelerate designs for solid-state batteries, a promising next-generation technology that has the potential to store more energy than lithium-ion batteries without the flammability concerns. However, solid-state batteries encounter problems when materials within the cell interact with each other in ways that degrade performance. Researchers from the National Renewable Energy Laboratory (NREL), the Colorado School of Mines, and the University of Illinois demonstrated a machine learning method that can accurately predict the properties of inorganic compounds.
Layer-Parallel Training of Residual Networks with Auxiliary-Variable Networks
Sun, Qi, Dong, Hexin, Chen, Zewei, Sun, Jiacheng, Li, Zhenguo, Dong, Bin
Gradient-based methods for the distributed training of residual networks (ResNets) typically require a forward pass of the input data, followed by back-propagating the error gradient to update model parameters, which becomes time-consuming as the network goes deeper. To break the algorithmic locking and exploit synchronous module parallelism in both the forward and backward modes, auxiliary-variable methods have attracted much interest lately but suffer from significant communication overhead and lack of data augmentation. In this work, a novel joint learning framework for training realistic ResNets across multiple compute devices is established by trading off the storage and recomputation of external auxiliary variables. More specifically, the input data of each independent processor is generated from its low-capacity auxiliary network (AuxNet), which permits the use of data augmentation and realizes forward unlocking. The backward passes are then executed in parallel, each with a local loss function that originates from the penalty or augmented Lagrangian (AL) methods. Finally, the proposed AuxNet is employed to reproduce the updated auxiliary variables through an end-to-end training process. We demonstrate the effectiveness of our methods on ResNets and WideResNets across CIFAR-10, CIFAR-100, and ImageNet datasets, achieving speedup over the traditional layer-serial training method while maintaining comparable testing accuracy.
Quantum Architecture Search via Continual Reinforcement Learning
Ye, Esther, Chen, Samuel Yen-Chi
Quantum computing has promised significant improvement in solving difficult computational tasks over classical computers. Designing quantum circuits for practical use, however, is not a trivial objective and requires expert-level knowledge. To aid this endeavor, this paper proposes a machine learning-based method to construct quantum circuit architectures. Previous works have demonstrated that classical deep reinforcement learning (DRL) algorithms can successfully construct quantum circuit architectures without encoded physics knowledge. However, these DRL-based works are not generalizable to settings with changing device noises, thus requiring considerable amounts of training resources to keep the RL models up-to-date. With this in mind, we incorporated continual learning to enhance the performance of our algorithm. In this paper, we present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL) framework to tackle this circuit design challenge. By conducting numerical simulations over various noise patterns, we demonstrate that the RL agent with PPR was able to find the quantum gate sequence to generate the two-qubit Bell state faster than the agent that was trained from scratch. The proposed framework is general and can be applied to other quantum gate synthesis or control problems -- including the automatic calibration of quantum devices.
A Simple and Efficient Sampling-based Algorithm for General Reachability Analysis
Lew, Thomas, Janson, Lucas, Bonalli, Riccardo, Pavone, Marco
In this work, we analyze an efficient sampling-based algorithm for general-purpose reachability analysis, which remains a notoriously challenging problem with applications ranging from neural network verification to safety analysis of dynamical systems. By sampling inputs, evaluating their images in the true reachable set, and taking their ɛ-padded convex hull as a set estimator, this algorithm applies to general problem settings and is simple to implement. Our main contribution is the derivation of asymptotic and finite-sample accuracy guarantees using random set theory. This analysis informs algorithmic design to obtain an ɛ-close reachable set approximation with high probability, provides insights into which reachability problems are most challenging, and motivates safety-critical applications of the technique. On a neural network verification task, we show that this approach is more accurate and significantly faster than prior work. Informed by our analysis, we also design a robust model predictive controller that we demonstrate in hardware experiments. Keywords: reachability analysis, random set theory, robust control, neural network verification.
Secure Federated Learning for Residential Short Term Load Forecasting
Fernandez, Joaquin Delgado, Menci, Sergio Potenciano, Lee, Charles, Fridgen, Gilbert
The inclusion of intermittent and renewable energy sources has increased the importance of demand forecasting in power systems. Smart meters can play a critical role in demand forecasting due to the measurement granularity they provide. Despite their virtue, smart meters used for forecasting face some constraints as consumers' privacy concerns, reluctance of utilities and vendors to share data with competitors or third parties, and regulatory constraints. This paper examines a collaborative machine learning method, federated learning extended with privacy preserving techniques for short-term demand forecasting using smart meter data as a solution to the previous constraints. The combination of privacy preserving techniques and federated learning enables to ensure consumers' confidentiality concerning both their data, the models generated using it (Differential Privacy), and the communication mean (Secure Aggregation). To evaluate this paper's collaborative secure federated learning setting, we explore current literature to select the baseline for our simulations and evaluation. We simulate and evaluate several scenarios that explore how traditional centralized approaches could be projected in the direction of a decentralized, collaborative and private system. The results obtained over the evaluations provided decent performance and in a privacy setting using differential privacy almost perfect privacy budgets (1.39,$10e^{-5}$) and (2.01,$10e^{-5}$) with a negligible performance compromise.