Goto

Collaborating Authors

 Materials


Dorabot's first robot for recycling

#artificialintelligence

Sign in to report inappropriate content. Dorabot's Robot for recycling, can identify, pick, and sort recyclable items such as plastic bottles, glass bottles, paper, cartons, and aluminum cans. The robot has deep learning-based computer vision and dynamic planning to select items in a moving conveyor belt. It also includes customized and erosion resistant grippers to pick irregularly shaped items, which results in a cost-effective integrated solution. Follow us on Twitter: https://twitter.com/dorabot_inc


Disentangling trainability and generalization in deep learning

arXiv.org Machine Learning

A BSTRACT A fundamental goal in deep learning is the characterization of trainability and generalization of neural networks as a function of their architecture and hyper-parameters. In this paper, we discuss these challenging issues in the context of wide neural networks at large depths where we will see that the situation simplifies considerably. To do this, we leverage recent advances that have separately shown: (1) that in the wide network limit, random networks before training are Gaussian Processes governed by a kernel known as the Neural Network Gaussian Process (NNGP) kernel, (2) that at large depths the spectrum of the NNGP kernel simplifies considerably and becomes "weakly data-dependent", and (3) that gradient descent training of wide neural networks is described by a kernel called the Neural Tangent Kernel (NTK) that is related to the NNGP . Here we show that in the large depth limit the spectrum of the NTK simplifies in much the same way as that of the NNGP kernel. By analyzing this spectrum, we arrive at a precise characterization of trainability and a necessary condition for generalization across a range of architectures including Fully Connected Networks (FCNs) and Con-volutional Neural Networks (CNNs). In particular, we find that there are large regions of hyperparameter space where networks can only memorize the training set in the sense they reach perfect training accuracy but completely fail to generalize outside the training set, in contrast with several recent results. By comparing CNNs with-and without-global average pooling, we show that CNNs without average pooling have very nearly identical learning dynamics to FCNs while CNNs with pooling contain a correction that alters its generalization performance. We perform a thorough empirical investigation of these theoretical results and finding excellent agreement on real datasets. Historically, the rampant success of deep learning models has lacked a sturdy theoretical foundation; architectures, hyperparameters, and learning algorithms are often selected by brute force search (Bergstra & Bengio, 2012) and heuristics (Glorot & Bengio, 2010). Recently, significant theoretical progress has been made on several fronts that have shown promise in making neural network design more systematic. In particular, in the infinite width (or channel) limit, the distribution of functions induced by neural networks with random weights and biases has been precisely characterized before, during, and after training. The study of infinite networks dates back to seminal work by Neal (1994) who showed that the distribution of functions given by single hidden-layer networks with random weights and biases in the infinite-width limit are Gaussian Processes (GPs). Recently, there has been renewed interest in studying random, infinite, networks starting with concurrent work on "conjugate kernels" (Daniely et al., 2016; Daniely, 2017) and "mean-field theory" (Poole et al., 2016; Schoenholz et al., 2017).


Value of structural health monitoring quantification in partially observable stochastic environments

arXiv.org Artificial Intelligence

Sequential decision-making under uncertainty for optimal life-cycle control of deteriorating engineering systems and infrastructure entails two fundamental classes of decisions. The first class pertains to the various structural interventions, which can directly modify the existing properties of the system, while the second class refers to prescribing appropriate inspection and monitoring schemes, which are essential for updating our existing knowledge about the system states. The latter have to rely on quantifiable measures of efficiency, determined on the basis of objective criteria that, among others, consider the Value of Information (VoI) of different observational strategies, and the Value of Structural Health Monitoring (VoSHM) over the entire system life-cycle. In this work, we present general solutions for quantifying the VoI and VoSHM in partially observable stochastic domains, and although our definitions and methodology are general, we are particularly emphasizing and describing the role of Partially Observable Markov Decision Processes (POMDPs) in solving this problem, due to their advantageous theoretical and practical attributes in estimating arbitrarily well globally optimal policies. POMDP formulations are articulated for different structural environments having shared intervention actions but diversified inspection and monitoring options, thus enabling VoI and VoSHM estimation through their differentiated stochastic optimal control policies. POMDP solutions are derived using point-based solvers, which can efficiently approximate the POMDP value functions through Bellman backups at selected reachable points of the belief space. The suggested methodology is applied on stationary and non-stationary deteriorating environments, with both infinite and finite planning horizons, featuring single- or multi-component engineering systems.


Business Problems and Data Science Solutions Part 1

#artificialintelligence

An important principle of data science is that data mining is a process. It includes the application of information technology, such as the automated discovery and evaluation of patterns from data. It also includes an analyst's creativity, business knowledge, and common sense. Understanding the whole process helps to structure data mining projects. Since the data mining process breaks up the overall task of finding patterns from data into a set of well-defined subtasks, it is also useful for structuring discussions about data science.


Universal Hysteresis Identification Using Extended Preisach Neural Network

arXiv.org Machine Learning

Hysteresis phenomena have been observed in different branches of physics and engineering sciences. Therefore, several models have been proposed for hysteresis simulation in different fields; however, almost neither of them can be utilized universally. In this paper by inspiring of Preisach Neural Network which was inspired by the Preisach model that basically stemmed from Madelungs rules and using the learning capability of the neural networks, an adaptive universal model for hysteresis is introduced and called Extended Preisach Neural Network Model. It is comprised of input, output and, two hidden layers. The input and output layers contain linear neurons while the first hidden layer incorporates neurons called Deteriorating Stop neurons, which their activation function follows Deteriorating Stop operator. Deteriorating Stop operators can generate non-congruent hysteresis loops. The second hidden layer includes Sigmoidal neurons. Adding the second hidden layer, helps the neural network learn non-Masing and asymmetric hysteresis loops very smoothly. At the input layer, besides input data the rate at which input data changes, is included as well in order to give the model the capability of learning rate-dependent hysteresis loops. Hence, the proposed approach has the capability of the simulation of both rate-independent and rate-dependent hysteresis with either congruent or non-congruent loops as well as symmetric and asymmetric loops. A new hybridized algorithm has been adopted for training the model which is based on a combination of the Genetic Algorithm and the optimization method of sub-gradient with space dilatation. The generality of the proposed model has been evaluated by applying it to various hysteresis from different areas of engineering with different characteristics. The results show that the model is successful in the identification of the considered hystereses.


SCR-Apriori for Mining `Sets of Contrasting Rules'

arXiv.org Machine Learning

--In this paper, we propose an efficient algorithm for mining novel'Set of Contrasting Rules'-pattern (SCR-pattern), which consists of several association rules. This pattern is of high interest due to the guaranteed quality of the rules forming it and its ability to discover useful knowledge. However, SCR-pattern has no efficient mining algorithm. We propose SCR-Apriori algorithm, which results in the same set of SCR-patterns as the state-of-the-art approache, but is less computationally expensive. We also show experimentally that by incorporating the knowledge about the pattern structure into Apriori algorithm, SCR-Apriori can significantly prune the search space of frequent itemsets to be analysed. I NTRODUCTION Association rules learning is a popular technique in data mining [1]. However, it is known that finding rules of high quality is not always an easy task [2]. This issue is even more significant in domains where the reliability of the obtained knowledge is required to be high (for example, in medicine). Also, association rules mining techniques usually generate a huge number of rules that have to be analysed by a human in order to choose meaningful and useful ones [3].


New Research Indicates AI May Be Catalyst to Making Healthcare More Human

#artificialintelligence

CHICAGO & LONDON--(BUSINESS WIRE)--Artificial Intelligence (AI) is widely expected to drive important benefits across the health system, from increasing efficiency to improving patient outcomes, but it also may be key to making healthcare more human. Benefits range from increasing the amount of time clinicians can spend with patients and on cross-care team collaboration to enhancing the ability to deliver preventative care. According to a new study of more than 900 healthcare professionals in the U.S. and U.K. conducted by MIT Technology Review Insights with GE Healthcare, nearly half of medical professionals surveyed said AI is already increasing their ability to spend time with and provide care to patients. Additionally, more than 78 percent of healthcare business leaders who reported they have deployed AI in their operations also reported that AI has helped drive workflow improvements, streamlining operational and administrative activities and delivering significant efficiencies toward transforming the future of healthcare. "Of any industry, AI could have the most profound benefits on human lives if we can effectively harness it across the healthcare system," said Kieran Murphy, President and CEO, GE Healthcare.


Spectroscopy and Chemometrics News Weekly #50, 2019

#artificialintelligence

Check out their product page โ€ฆ link Get the Chemometrics and Spectroscopy News in real time on Twitter @ CalibModel and follow us. Near Infrared " Raman Spectroscopy and NIR Spectroscopy as Possible AID in Localisation of Solitary Pulmonary Nodules" LINK NIR spectroscopy has potential for rapid on farm analysis of slurry nutrient content. Wouter Saeys, IFSConf LINK "Modeling for SSC and Firmness Detection of Persimmon Based on NIR Hyperspectral Imaging by Sample Partitioning and Variables Selection" LINK " Application of the NIR Spectroscopy in the Researches of Orthopedics Diseases" LINK "FT-NIR ใซใ‚ˆใ‚‹ๆฒน่„‚ใฎ่ฟ…้€Ÿใชๅ“่ณช็ฎก็†" LINK "Accuracy improvement of quantitative analysis in VIS-NIR spectroscopy using the GKF-WTEF algorithm." LINK "Rapid determination of the content of digestible energy and metabolizable energy in sorghum fed to growing pigs by near-infrared reflectance spectroscopy." LINK "Characterization of the Processing Conditions upon Textural Profile Analysis (TPA) Parameters of Processed Cheese Using Near-Infrared Hyperspectral Imaging" LINK "Total aromatics of diesel fuels analysis by deep learning and near-infrared spectroscopy" LINK "Rapid Assessment of Soil Quality Indices Using Infrared Reflectance Spectroscopy" LINK "Quantitative Determination of the Fiber Components in Textiles by Near-Infrared Spectroscopy and Extreme Learning Machine" LINK "Non-Destructive Method for Predicting Sapodilla Fruit Quality Using Near Infrared Spectroscopy" LINK "Qualitative analysis for sweetness classification of longan by near infrared hyperspectral imaging" LINK " MENGUKUR BERAT VOLUME TANAH DI LAPANGAN MENGGUNAKAN NEAR INFRARED SPECTROSCOPY MEASUREMENT OF SOIL BULK DENSITY IN โ€ฆ" LINK "Hyperspectral Characteristics of Coastal Saline Soil with Visible/near Infrared Spectroscopy" LINK "Monitoring Soil Surface Mineralogy at Different Moisture Conditions Using Visible Near-Infrared Spectroscopy Data" LINK "Near infrared spectroscopy for assessing mechanical properties of Castanea sativa wood samples" Modulus of elasticity LINK " Development of near-infrared spectroscopic sensing system for online real-time monitoring of milk quality during milking" LINK " Advances in Near-Infrared Spectroscopy and Related Computational Methods" LINK "Morphological, Physicochemical and FTIR Spectroscopic Properties of Bee Pollen Loads from Different Botanical Origin" LINK "Fourier transform infrared imaging and quantitative analysis of pre-treated wood fibers: A comparison between partial least squares and multivariate curve resolution with alternating least squares methods in a case study" LINK "Antioxidant Activity of Blueberry (Vaccinium spp.)


Deep learning surrogate interacting Markov chain Monte Carlo based full wave inversion scheme for properties of materials quantification

arXiv.org Machine Learning

Full Wave Inversion (FWI) imaging scheme has many applications in engineering, geoscience and medical sciences. In this paper, a surrogate deep learning FWI approach is presented to quantify properties of materials using stress waves. Such inverse problems, in general, are ill-posed and nonconvex, especially in cases where the solutions exhibit shocks, heterogeneity, discontinuities, or large gradients. The proposed approach is proven efficient to obtain global minima responses in these cases. This approach is trained based on random sampled set of material properties and sampled trials around local minima, therefore, it requires a forward simulation can handle high heterogeneity, discontinuities and large gradients. High resolution Kurganov-Tadmor (KT) central finite volume method is used as forward wave propagation operator. Using the proposed framework, material properties of 2D media are quantified for several different situations. The results demonstrate the feasibility of the proposed method for estimating mechanical properties of materials with high accuracy using deep learning approaches.


Mastering the 3 Ms

#artificialintelligence

Marketing today is on the threshold of change. In the past, marketing as we knew it was largely dominated by 30-second TV spots and other mass media such as print, outdoor, radio and so on. The number-crunching only came into play while deciding which medium to back in the advertising campaign and for what price to buy the media. But, look around today and there are the likes of Google, Facebook, Twitter and others who apply complex algorithms such as Page Rank, Adsense, marketing mix modelling, content marketing and so on along with technology (analytics, digital marketing, search engine optimisation (SEO) and search engine marketing (SEM) to make marketing a lot more data-driven. Similarly, in music the magic of maths plays a huge role.