Exploiting the deep generative model's remarkable ability of learning the data-manifold structure, some recent researches proposed a geometric data interpolation method based on the geodesic curves on the learned data-manifold. However, this interpolation method often gives poor results due to a topological difference between the model and the dataset. The model defines a family of simply-connected manifolds, whereas the dataset generally contains disconnected regions or holes that make them non-simply-connected. To compensate this difference, we propose a novel density regularizer that make the interpolation path circumvent the holes denoted by low probability density. We confirm that our method gives consistently better interpolation results from the experiments with real-world image datasets.

Transfer learning which aims at utilizing knowledge learned from one problem (source domain) to solve another different but related problem (target domain) has attracted wide research attentions. However, the current transfer learning methods are mostly uninterpretable, especially to people without ML expertise. In this extended abstract, we brief introduce two knowledge graph (KG) based frameworks towards human understandable transfer learning explanation. The first one explains the transferability of features learned by Convolutional Neural Network (CNN) from one domain to another through pre-training and fine-tuning, while the second justifies the model of a target domain predicted by models from multiple source domains in zero-shot learning (ZSL). Both methods utilize KG and its reasoning capability to provide rich and human understandable explanations to the transfer procedure.

Electroencephalography (EEG) is a complex signal and can require several years of training to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn good feature representations from raw data. Whether DL truly presents advantages as compared to more traditional EEG processing approaches, however, remains an open question. In this work, we review 156 papers that apply DL to EEG, published between January 2010 and July 2018, and spanning different application domains such as epilepsy, sleep, brain-computer interfacing, and cognitive and affective monitoring. We extract trends and highlight interesting approaches in order to inform future research and formulate recommendations. Various data items were extracted for each study pertaining to 1) the data, 2) the preprocessing methodology, 3) the DL design choices, 4) the results, and 5) the reproducibility of the experiments. Our analysis reveals that the amount of EEG data used across studies varies from less than ten minutes to thousands of hours. As for the model, 40% of the studies used convolutional neural networks (CNNs), while 14% used recurrent neural networks (RNNs), most often with a total of 3 to 10 layers. Moreover, almost one-half of the studies trained their models on raw or preprocessed EEG time series. Finally, the median gain in accuracy of DL approaches over traditional baselines was 5.4% across all relevant studies. More importantly, however, we noticed studies often suffer from poor reproducibility: a majority of papers would be hard or impossible to reproduce given the unavailability of their data and code. To help the field progress, we provide a list of recommendations for future studies and we make our summary table of DL and EEG papers available and invite the community to contribute.

Quantum computing is a relatively modern technology that pioneering scientists, researchers, and entrepreneurs worldwide are currently actively pursuing to commercialize. For example, recently at CES (Consumer Electronics Show) in January 2019, IBM debuted its "Q System One" as the first standalone quantum computer geared for scientific and commercial use. Making quantum computing accessible will help accelerate progress in artificial intelligence (AI). Speed up computing, and you enhance the performance of deep learning. For example, the parallel processing capabilities of GPUs (graphics processing unit) helped accelerate AI deep learning by providing greater computational power than serial processing CPUs (central processing unit) to process large amounts of big data used for machine learning.

We present graph wavelet neural network (GWNN), a novel graph convolutional neural network (CNN), leveraging graph wavelet transform to address the shortcomings of previous spectral graph CNN methods that depend on graph Fourier transform. Different from graph Fourier transform, graph wavelet transform can be obtained via a fast algorithm without requiring matrix eigendecomposition with high computational cost. Moreover, graph wavelets are sparse and localized in vertex domain, offering high efficiency and good interpretability for graph convolution. The proposed GWNN significantly outperforms previous spectral graph CNNs in the task of graph-based semi-supervised classification on three benchmark datasets: Cora, Citeseer and Pubmed.

Abstract: Neural Processes (NPs) (Garnelo et al 2018a;b) approach regression by learning to map a context set of observed input-output pairs to a distribution over regression functions. Each function models the distribution of the output given an input, conditioned on the context. NPs have the benefit of fitting observed data efficiently with linear complexity in the number of context input-output pairs, and can learn a wide family of conditional distributions; they learn predictive distributions conditioned on context sets of arbitrary size. Nonetheless, we show that NPs suffer a fundamental drawback of underfitting, giving inaccurate predictions at the inputs of the observed data they condition on. We address this issue by incorporating attention into NPs, allowing each input location to attend to the relevant context points for the prediction.

The new research comes from Institute of Evolutionary Biology (IBE), the Centro Nacional de Análisis Genómico (CNAG-CRG) of the Centre for Genomic Regulation (CRG) and the Institute of Genomics at the University of Tartu. In studies researchers have applied deep learning algorithms and statistical methods to establish the footprint of a new hominid. The application of human DNA computational analysis indicates that the extinct species was a hybrid of Neanderthals and Denisovans. At some stage this hominid cross bred with'Out of Africa' modern humans within the region of the world that is now Asia. The scientific theory of recent African origin of modern humans is the most widely accepted model of the geographic origin and early migration of anatomically modern humans (Homo sapiens).

Getting past the buzzwords to the meat of what is on offer in the machine learning services landscape isn't easy. That's why we've put together a little guide to help you understand how you can start utilizing real and true machine learning to accelerate your business. Lots of buzzwords these days actually reference open-source machine learning platforms and libraries, which often require knowledge of computer science, statistics, linear algebra, calculus and sometimes even more arcane math to fully utilize. These are separate from the technologies built on top of them, but can get conflated in the media landscape. Tensorflow is the (mostly) open-source library that Google maintains and presumably builds their internal and external machine learning services with.

In the present era, machines have successfully achieved 99% accuracy in understanding, identifying the features and objects in the images. We see them daily, to quote a few, smartphones recognizing faces in the camera, ability to search particular photos in google photos, scanning text from the barcode or books at a good pace etc. This state of the art performance of the machine was possible because of a specific type of neural network called Convolutional Neural Network, also known as convnet. If you are a deep learning enthusiast, you would have probably heard about these and you might have developed a few image classifiers. Modern deep-learning frameworks like Tensorflow and PyTorch make it easy to teach machines about images.

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph structure so that it can be easily exploited by machine learning models. However, traditionally machine learning approaches relied on user-defined heuristics to extract features encoding structural information about a graph. In this talk I will discuss methods that automatically learn to encode graph structure into low-dimensional embeddings, using techniques based on deep learning and nonlinear dimensionality reduction. I will provide a conceptual review of key advancements in this area of representation learning on graphs, including random-walk based algorithms, and graph convolutional networks.