Deep Learning
Artificial Intelligence
Artificial Intelligence (AI) has a long history, starting in the 1950s with the theoretical concept of the Turing test and gaining considerable momentum since the early 2000s. This development has been driven by the significant increase in computing power which makes computation-intensive Deep Learning algorithms easy and effortless to handle. The intelligent processing of images (computer vision) and speech (natural language processing) is becoming a routine part of our customers' daily lives as found in mass market applications such as Apple's Siri or Amazon's Alexa. Artificial Intelligence is defined as the imitation of human intelligence or intellectual processes by machines, especially computer systems. These processes include learning, reasoning, and automatic correction.
DIGITAL HEALTH BRIEFING: Google, researchers use AI to predict patient mortality -- Mental health chatbot launches on iOS -- Israel PM reveals national digital health project
Welcome to Digital Health Briefing, a new email providing the latest news, data, and insight on how digital technology is disrupting the healthcare ecosystem, produced by BI Intelligence. Sign up and receive Digital Health Briefing free to your inbox. We'd like to hear from you. RESEARCHERS TAP DEEP LEARNING TO PREDICT IN-HOSPITAL PATIENT MORTALITY AND READMISSION RATES: Newly published collaborative research from Google, Stanford, the University of Chicago, and the University of California, suggests that artificial intelligence (AI) can be used in combination with electronic health record data to predict mortality, readmission, and other events that have an adverse impact on healthcare in the US. The study adds considerable weight to the growing body of research in the field of big data and health analytics.
Abductive reasoning as the basis to reproduce expert criteria in ECG Atrial Fibrillation identification
Teijeiro, Tomรกs, Garcรญa, Constantino A., Castro, Daniel, Fรฉlix, Paulo
Objective: This work aims at providing a new method for the automatic detection of atrial fibrillation, other arrhythmia and noise on short single lead ECG signals, emphasizing the importance of the interpretability of the classification results. Approach: A morphological and rhythm description of the cardiac behavior is obtained by a knowledge-based interpretation of the signal using the \textit{Construe} abductive framework. Then, a set of meaningful features are extracted for each individual heartbeat and as a summary of the full record. The feature distributions were used to elucidate the expert criteria underlying the labeling of the 2017 Physionet/CinC Challenge dataset, enabling a manual partial relabeling to improve the consistency of the classification rules. Finally, state-of-the-art machine learning methods are combined to provide an answer on the basis of the feature values. Main results: The proposal tied for the first place in the official stage of the Challenge, with a combined $F_1$ score of 0.83, and was even improved in the follow-up stage to 0.85 with a significant simplification of the model. Significance: This approach demonstrates the potential of \textit{Construe} to provide robust and valuable descriptions of temporal data even with significant amounts of noise and artifacts. Also, we discuss the importance of a consistent classification criteria in manually labeled training datasets, and the fundamental advantages of knowledge-based approaches to formalize and validate that criteria.
Interpretable VAEs for nonlinear group factor analysis
Ainsworth, Samuel, Foti, Nicholas, Lee, Adrian KC, Fox, Emily
Deep generative models have recently yielded encouraging results in producing subjectively realistic samples of complex data. Far less attention has been paid to making these generative models interpretable. In many scenarios, ranging from scientific applications to finance, the observed variables have a natural grouping. It is often of interest to understand systems of interaction amongst these groups, and latent factor models (LFMs) are an attractive approach. However, traditional LFMs are limited by assuming a linear correlation structure. We present an output interpretable VAE (oi-VAE) for grouped data that models complex, nonlinear latent-to-observed relationships. We combine a structured VAE comprised of group-specific generators with a sparsity-inducing prior. We demonstrate that oi-VAE yields meaningful notions of interpretability in the analysis of motion capture and MEG data. We further show that in these situations, the regularization inherent to oi-VAE can actually lead to improved generalization and learned generative processes.
CREPE: A Convolutional Representation for Pitch Estimation
Kim, Jong Wook, Salamon, Justin, Li, Peter, Bello, Juan Pablo
The task of estimating the fundamental frequency of a monophonic sound recording, also known as pitch tracking, is fundamental to audio processing with multiple applications in speech processing and music information retrieval. To date, the best performing techniques, such as the pYIN algorithm, are based on a combination of DSP pipelines and heuristics. While such techniques perform very well on average, there remain many cases in which they fail to correctly estimate the pitch. In this paper, we propose a data-driven pitch tracking algorithm, CREPE, which is based on a deep convolutional neural network that operates directly on the time-domain waveform. We show that the proposed model produces state-of-the-art results, performing equally or better than pYIN. Furthermore, we evaluate the model's generalizability in terms of noise robustness. A pre-trained version of CREPE is made freely available as an open-source Python module for easy application.
A Likelihood-Free Inference Framework for Population Genetic Data using Exchangeable Neural Networks
Chan, Jeffrey, Perrone, Valerio, Spence, Jeffrey P., Jenkins, Paul A., Mathieson, Sara, Song, Yun S.
Inference for population genetics models is hindered by computationally intractable likelihoods. While this issue is tackled by likelihood-free methods, these approaches typically rely on hand-crafted summary statistics of the data. In complex settings, designing and selecting suitable summary statistics is problematic and results are very sensitive to such choices. In this paper, we learn the first exchangeable feature representation for population genetic data to work directly with genotype data. This is achieved by means of a novel Bayesian likelihood-free inference framework, where a permutation-invariant convolutional neural network learns the inverse functional relationship from the data to the posterior. We leverage access to scientific simulators to learn such likelihood-free function mappings, and establish a general framework for inference in a variety of simulation-based tasks. We demonstrate the power of our method on the recombination hotspot testing problem, outperforming the state-of-the-art.
Improved GQ-CNN: Deep Learning Model for Planning Robust Grasps
Jaลkowski, Maciej, ลwiฤ tkowski, Jakub, Zajฤ c, Michaล, Klimek, Maciej, Potiuk, Jarek, Rybicki, Piotr, Polatowski, Piotr, Walczyk, Przemysลaw, Nowicki, Kacper, Cygan, Marek
Recent developments in the field of robot grasping have shown great improvements in the grasp success rates when dealing with unknown objects. In this work we improve on one of the most promising approaches, the Grasp Quality Convolutional Neural Network (GQ-CNN) trained on the DexNet 2.0 dataset [15].We propose a new architecture for the GQ-CNN and describe practical improvements that increase the model validation accuracy from 92.2% to 95.8% and from 85.9% to 88.0% on respectively image-wise and object-wise training and validation splits.
Disentangling by Factorising
We define and address the problem of unsupervised learning of disentangled representations on data generated from independent factors of variation. We propose FactorVAE, a method that disentangles by encouraging the distribution of representations to be factorial and hence independent across the dimensions. We show that it improves upon $\beta$-VAE by providing a better trade-off between disentanglement and reconstruction quality. Moreover, we highlight the problems of a commonly used disentanglement metric and introduce a new metric that does not suffer from them.
Spectral Normalization for Generative Adversarial Networks
Miyato, Takeru, Kataoka, Toshiki, Koyama, Masanori, Yoshida, Yuichi
One of the challenges in the study of generative adversarial networks is the instability of its training. In this paper, we propose a novel weight normalization technique called spectral normalization to stabilize the training of the discriminator. Our new normalization technique is computationally light and easy to incorporate into existing implementations. We tested the efficacy of spectral normalization on CIFAR10, STL-10, and ILSVRC2012 dataset, and we experimentally confirmed that spectrally normalized GANs (SN-GANs) is capable of generating images of better or equal quality relative to the previous training stabilization techniques.
Neural Granger Causality for Nonlinear Time Series
Tank, Alex, Covert, Ian, Foti, Nicholas, Shojaie, Ali, Fox, Emily
While most classical approaches to Granger causality detection assume linear dynamics, many interactions in applied domains, like neuroscience and genomics, are inherently nonlinear. In these cases, using linear models may lead to inconsistent estimation of Granger causal interactions. We propose a class of nonlinear methods by applying structured multilayer perceptrons (MLPs) or recurrent neural networks (RNNs) combined with sparsity-inducing penalties on the weights. By encouraging specific sets of weights to be zero---in particular through the use of convex group-lasso penalties---we can extract the Granger causal structure. To further contrast with traditional approaches, our framework naturally enables us to efficiently capture long-range dependencies between series either via our RNNs or through an automatic lag selection in the MLP. We show that our neural Granger causality methods outperform state-of-the-art nonlinear Granger causality methods on the DREAM3 challenge data. This data consists of nonlinear gene expression and regulation time courses with only a limited number of time points. The successes we show in this challenging dataset provide a powerful example of how deep learning can be useful in cases that go beyond prediction on large datasets. We likewise demonstrate our methods in detecting nonlinear interactions in a human motion capture dataset.