Materials
Deep Learning for Detecting Building Defects Using Convolutional Neural Networks
Perez, Husein, Tah, Joseph H. M., Mosavi, Amir
Clients are increasingly looking for fast and effective means to quickly and frequently survey and communicate the condition of their buildings so that essential repairs and maintenance work can be done in a proactive and timely manner before it becomes too dangerous and expensive. Traditional methods for this type of work commonly comprise of engaging building surveyors to undertake a condition assessment which involves a lengthy site inspection to produce a systematic recording of the physical condition of the building elements, including cost estimates of immediate and projected long-term costs of renewal, repair and maintenance of the building. Current asset condition assessment procedures are extensively time consuming, laborious, and expensive and pose health and safety threats to surveyors, particularly at height and roof levels which are difficult to access. This paper aims at evaluating the application of convolutional neural networks (CNN) towards an automated detection and localisation of key building defects, e.g., mould, deterioration, and stain, from images. The proposed model is based on pre-trained CNN classifier of VGG-16 (later compaired with ResNet-50, and Inception models), with class activation mapping (CAM) for object localisation. The challenges and limitations of the model in real-life applications have been identified. The proposed model has proven to be robust and able to accurately detect and localise building defects. The approach is being developed with the potential to scale-up and further advance to support automated detection of defects and deterioration of buildings in real-time using mobile devices and drones.
ASNets: Deep Learning for Generalised Planning
Toyer, Sam, Trevizan, Felipe, Thiébaux, Sylvie, Xie, Lexing
In this paper, we discuss the learning of generalised policies for probabilistic and classical planning problems using Action Schema Networks (ASNets). The ASNet is a neural network architecture that exploits the relational structure of (P)PDDL planning problems to learn a common set of weights that can be applied to any problem in a domain. By mimicking the actions chosen by a traditional, non-learning planner on a handful of small problems in a domain, ASNets are able to learn a generalised reactive policy that can quickly solve much larger instances from the domain. This work extends the ASNet architecture to make it more expressive, while still remaining invariant to a range of symmetries that exist in PPDDL problems. We also present a thorough experimental evaluation of ASNets, including a comparison with heuristic search planners on seven probabilistic and deterministic domains, an extended evaluation on over 18,000 Blocksworld instances, and an ablation study. Finally, we show that sparsity-inducing regularisation can produce ASNets that are compact enough for humans to understand, yielding insights into how the structure of ASNets allows them to generalise across a domain.
ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable Recommendations
Korovina, Ksenia, Xu, Sailun, Kandasamy, Kirthevasan, Neiswanger, Willie, Poczos, Barnabas, Schneider, Jeff, Xing, Eric P.
We describe ChemBO, a Bayesian Optimization framework for generating and optimizing organic molecules for desired molecular properties. This framework is useful in applications such as drug discovery, where an algorithm recommends new candidate molecules; these molecules first need to be synthesized and then tested for drug-like properties. The algorithm uses the results of past tests to recommend new ones so as to find good molecules efficiently. Most existing data-driven methods for this problem do not account for sample efficiency and/or fail to enforce realistic constraints on synthesizability. In this work, we explore existing kernels for molecules in the literature as well as propose a novel kernel which views a molecule as a graph. In ChemBO, we implement these kernels in a Gaussian process model. Then we explore the chemical space by traversing possible paths of molecular synthesis. Consequently, our approach provides a proposal synthesis path every time it recommends a new molecule to test, a crucial advantage when compared to existing methods. In our experiments, we demonstrate the efficacy of the proposed approach on several molecular optimization problems.
Researchers use machine learning technique to rapidly evaluate new transition metal compounds
In recent years, machine learning has been proving a valuable tool for identifying new materials with properties optimized for specific applications. Working with large, well-defined data sets, computers learn to perform an analytical task to generate a correct answer and then use the same technique on an unknown data set. While that approach has guided the development of valuable new materials, they've primarily been organic compounds, notes Heather Kulik Ph.D. '09, an assistant professor of chemical engineering. Kulik focuses instead on inorganic compounds--in particular, those based on transition metals, a family of elements (including iron and copper) that have unique and useful properties. In those compounds--known as transition metal complexes--the metal atom occurs at the center with chemically bound arms, or ligands, made of carbon, hydrogen, nitrogen, or oxygen atoms radiating outward. Transition metal complexes already play important roles in areas ranging from energy storage to catalysis for manufacturing fine chemicals--for example, for pharmaceuticals.
Innovation rush aims to help farmers, rich and poor, beat climate change
LONDON - In decades to come, African farmers may pool their money to buy small robot vehicles to weed their fields or drones that can hover to squirt a few drops of pesticide only where needed. Smartphones already allow farmers in remote areas to snap photos of sick plants, upload them and get a quick diagnosis, plus advice on treatment. Researchers also are trying to train crops like maize and wheat to produce their own nitrogen fertilizer from the air -- a trick soybeans and other legumes use -- and exploring how to make wheat and rice better at photosynthesis in very hot conditions. As warmer, wilder weather linked to climate change brings growing challenges for farmers across the globe -- and as they try to curb their own heat-trapping emissions -- a rush of innovation aimed at helping both rich and poor farmers is now converging in ways that could benefit them all, scientists say. In a hotter world, farmers share "the same problems, the same issues," said Svend Christensen, head of plant and environmental sciences at the University of Copenhagen.
Automatic crack detection and classification by exploiting statistical event descriptors for Deep Learning
Siracusano, Giulio, La Corte, Aurelio, Tomasello, Riccardo, Lamonaca, Francesco, Scuro, Carmelo, Garescì, Francesca, Carpentieri, Mario, Finocchio, Giovanni
In modern building infrastructures, the chance to devise adaptive and unsupervised data-driven health monitoring systems is gaining in popularity due to the large availability of data from low-cost sensors with internetworking capabilities. In particular, deep learning provides the tools for processing and analyzing this unprecedented amount of data efficiently. The main purpose of this paper is to combine the recent advances of Deep Learning (DL) and statistical analysis on structural health monitoring (SHM) to develop an accurate classification tool able to discriminate among different acoustic emission events (cracks) by means of the identification of tensile, shear and mixed modes. The applications of DL in SHM systems is described by using the concept of Bidirectional Long Short Term Memory. We investigated on effective event descriptors to capture the unique characteristics from the different types of modes. Among them, Spectral Kurtosis and Spectral L2/L1 Norm exhibit distinctive behavior and effectively contributed to the learning process. This classification will contribute to unambiguously detect incipient damages, which is advantageous to realize predictive maintenance. Tests on experimental results confirm that this method achieves accurate classification (92%) capabilities of crack events and can impact on the design of future SHM technologies.
IoT's Role in Revolutionizing Agriculture
It's rare to see tech headlines about agriculture, but the field (pardon the pun) is often at the forefront of implementing new technology Perhaps no recent tech development has had a greater impact on the industry than smart technology, and this IoT data is being used to improve operations across nearly all modern farming operations around the globe. Here are a few examples. Farmers were among the first to adopt GPS technology; John Deere was the first tractor manufacturer to implement GPS technologies in the early 1990s, and farmers quickly began using GPS assistance and even automated steering to reduce user errors. GPS technology can be combined with sensor data to create ultra-precise maps of varying factors. Knowing how soil quality varies across large plots of land, for example, can help farmers know which areas need which type of fertilizers.
Can Machine Learning Identify Governing Laws For Dynamics in Complex Engineered Systems ? : A Study in Chemical Engineering
Subramanian, Renganathan, Singh, Shweta
Machine learning recently has been used to identify the governing equations for dynamics in physical systems. The promising results from applications on systems such as fluid dynamics and chemical kinetics inspire further investigation of these methods on complex engineered systems. Dynamics of these systems play a crucial role in design and operations. Hence, it would be advantageous to learn about the mechanisms that may be driving the complex dynamics of systems. In this work, our research question was aimed at addressing this open question about applicability and usefulness of novel machine learning approach in identifying the governing dynamical equations for engineered systems. We focused on distillation column which is an ubiquitous unit operation in chemical engineering and demonstrates complex dynamics i.e. it's dynamics is a combination of heuristics and fundamental physical laws. We tested the method of Sparse Identification of Non-Linear Dynamics (SINDy) because of it's ability to produce white-box models with terms that can be used for physical interpretation of dynamics. Time series data for dynamics was generated from simulation of distillation column using ASPEN Dynamics. One promising result was reduction of number of equations for dynamic simulation from 1000s in ASPEN to only 13 - one for each state variable. Prediction accuracy was high on the test data from system within the perturbation range, however outside perturbation range equations did not perform well. In terms of physical law extraction, some terms were interpretable as related to Fick's law of diffusion (with concentration terms) and Henry's law (with ratio of concentration and pressure terms). While some terms were interpretable, we conclude that more research is needed on combining engineering systems with machine learning approach to improve understanding of governing laws for unknown dynamics.
Toxicity Prediction by Multimodal Deep Learning
Karim, Abdul, Singh, Jaspreet, Mishra, Avinash, Dehzangi, Abdollah, Newton, M. A. Hakim, Sattar, Abdul
Prediction of toxicity levels of chemical compounds is an important issue in Quantitative Structure-Activity Relationship (QSAR) modeling. Although toxicity prediction has achieved significant progress in recent times through deep learning, prediction accuracy levels obtained by even very recent methods are not yet very high. We propose a multimodal deep learning method using multiple heterogeneous neural network types and data representations. We represent chemical compounds by strings, images, and numerical features. We train fully connected, convolutional, and recurrent neural networks and their ensembles. Each data representation or neural network type has its own strengths and weaknesses. Our motivation is to obtain a collective performance that could go beyond individual performance of each data representation or each neural network type. On a standard toxicity benchmark, our proposed method obtains significantly better accuracy levels than that by the state-of-the-art toxicity prediction methods.