Genre
Uber launches artificial intelligence lab - BBC News
Ride-sharing service Uber has acquired a New York-based artificial intelligence start-up which it hopes can speed up its progress in creating self-driving cars. The deal, for an undisclosed sum, will see Uber gain 15 specialist researchers who will form a new division at the company known as Uber AI Labs. Geometric Intelligence's co-founder Gary Marcus told the BBC the team would have a wide brief - ranging from improving traffic predictions to working towards a future of flying cars. Recent reports have suggested Uber's aggressive growth, which has required heavily subsidising fares, meant the firm lost more than $2bn (ยฃ1.6bn) last year. That figure is likely to go up in 2016.
Deep Learning: Recurrent Neural Networks in Python
Like the course I just released on Hidden Markov Models, Recurrent Neural Networks are all about learning sequences - but whereas Markov Models are limited by the Markov assumption, Recurrent Neural Networks are not - and as a result, they are more expressive, and more powerful than anything we've seen on tasks that we haven't made progress on in decades. So what's going to be in this course and how will it build on the previous neural network courses and Hidden Markov Models? In the first section of the course we are going to add the concept of time to our neural networks. I'll introduce you to the Simple Recurrent Unit, also known as the Elman unit. We are going to revisit the XOR problem, but we're going to extend it so that it becomes the parity problem - you'll see that regular feedforward neural networks will have trouble solving this problem but recurrent networks will work because the key is to treat the input as a sequence.
The Brain Tech to Merge Humans and AI Is Already Being Developed
Do you believe the warnings from folks like Prof. Stephen Hawking, Elon Musk and others? Is AI the greatest tool humanity will ever create, or are we "summoning the demon"? To quote the head of AI at Singularity University, Neil Jacobstein, "It's not artificial intelligence I'm worried about, it's human stupidity." In a recent Abundance 360 webinar, I interviewed Bryan Johnson, the founder of a new company called Kernel which he seeded with $100 million. To quote Bryan, "It's not about AI vs. humans. In 2007, he founded Braintree, an online and mobile payments provider. In 2013, PayPal acquired Braintree for $800 million. In 2014, Bryan launched the OS Fund with $100 million of his personal capital to support inventors and scientists who aim to benefit humanity by rewriting the operating systems of life. His investments include endeavors to cure age-related diseases and radically extend healthy human life to 100 (Human Longevity Inc.), replicate the human visual cortex using ...
Artificial Intelligence Will Find The Solution To Aging by 2033 - Longevity LIVE
Researchers say that they are on the verge of cracking the aging code. They also say that death caused by aging may become obsolete by 2033 if artificial intelligence gets involved. Scientists from the Maximum Life Foundation believe that the combination of two fields of science will cure aging. They also believe that this combination will keep us healthy and young. These fields are artificial intelligence and gene therapy. Researchers at Scicog Systems are creating an'Artificial Scientist'.
Statistical and Computational Guarantees of Lloyd's Algorithm and its Variants
Clustering is a fundamental problem in statistics and machine learning. Lloyd's algorithm, proposed in 1957, is still possibly the most widely used clustering algorithm in practice due to its simplicity and empirical performance. However, there has been little theoretical investigation on the statistical and computational guarantees of Lloyd's algorithm. This paper is an attempt to bridge this gap between practice and theory. We investigate the performance of Lloyd's algorithm on clustering sub-Gaussian mixtures. Under an appropriate initialization for labels or centers, we show that Lloyd's algorithm converges to an exponentially small clustering error after an order of $\log n$ iterations, where $n$ is the sample size. The error rate is shown to be minimax optimal. For the two-mixture case, we only require the initializer to be slightly better than random guess. In addition, we extend the Lloyd's algorithm and its analysis to community detection and crowdsourcing, two problems that have received a lot of attention recently in statistics and machine learning. Two variants of Lloyd's algorithm are proposed respectively for community detection and crowdsourcing. On the theoretical side, we provide statistical and computational guarantees of the two algorithms, and the results improve upon some previous signal-to-noise ratio conditions in literature for both problems. Experimental results on simulated and real data sets demonstrate competitive performance of our algorithms to the state-of-the-art methods.
Segmental Convolutional Neural Networks for Detection of Cardiac Abnormality With Noisy Heart Sound Recordings
Zhang, Yuhao, Ayyar, Sandeep, Chen, Long-Huei, Li, Ethan J.
Heart diseases constitute a global health burden, and the problem is exacerbated by the error-prone nature of listening to and interpreting heart sounds. This motivates the development of automated classification to screen for abnormal heart sounds. Existing machine learning-based systems achieve accurate classification of heart sound recordings but rely on expert features that have not been thoroughly evaluated on noisy recordings. Here we propose a segmental convolutional neural network architecture that achieves automatic feature learning from noisy heart sound recordings. Our experiments show that our best model, trained on noisy recording segments acquired with an existing hidden semi-markov model-based approach, attains a classification accuracy of 87.5% on the 2016 PhysioNet/CinC Challenge dataset, compared to the 84.6% accuracy of the state-of-the-art statistical classifier trained and evaluated on the same dataset. Our results indicate the potential of using neural network-based methods to increase the accuracy of automated classification of heart sound recordings for improved screening of heart diseases.
Semi-Supervised Learning with the Deep Rendering Mixture Model
Nguyen, Tan, Liu, Wanjia, Perez, Ethan, Baraniuk, Richard G., Patel, Ankit B.
Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as such have been widely employed in the semi-supervised learning. In this paper we leverage the recently developed Deep Rendering Mixture Model (DRMM), a probabilistic generative model that models latent nuisance variation, and whose inference algorithm yields DCNs. We develop an EM algorithm for the DRMM to learn from both labeled and unlabeled data. Guided by the theory of the DRMM, we introduce a novel non-negativity constraint and a variational inference term. We report state-of-the-art performance on MNIST and SVHN and competitive results on CIFAR10. We also probe deeper into how a DRMM trained in a semi-supervised setting represents latent nuisance variation using synthetically rendered images. Taken together, our work provides a unified framework for supervised, unsupervised, and semi-supervised learning.
A Probabilistic Framework for Deep Learning
Patel, Ankit B., Nguyen, Tan, Baraniuk, Richard G.
We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate that max-sum inference in the DRMM yields an algorithm that exactly reproduces the operations in deep convolutional neural networks (DCNs), providing a first principles derivation. Our framework provides new insights into the successes and shortcomings of DCNs as well as a principled route to their improvement. DRMM training via the Expectation-Maximization (EM) algorithm is a powerful alternative to DCN back-propagation, and initial training results are promising. Classification based on the DRMM and other variants outperforms DCNs in supervised digit classification, training 2-3x faster while achieving similar accuracy. Moreover, the DRMM is applicable to semi-supervised and unsupervised learning tasks, achieving results that are state-of-the-art in several categories on the MNIST benchmark and comparable to state of the art on the CIFAR10 benchmark.
Factored Contextual Policy Search with Bayesian Optimization
Karkus, Peter, Kupcsik, Andras, Hsu, David, Lee, Wee Sun
Scarce data is a major challenge to scaling robot learning to truly complex tasks, as we need to generalize locally learned policies over different "contexts". Bayesian optimization approaches to contextual policy search (CPS) offer data-efficient policy learning that generalize over a context space. We propose to improve data- efficiency by factoring typically considered contexts into two components: target- type contexts that correspond to a desired outcome of the learned behavior, e.g. target position for throwing a ball; and environment type contexts that correspond to some state of the environment, e.g. initial ball position or wind speed. Our key observation is that experience can be directly generalized over target-type contexts. Based on that we introduce Factored Contextual Policy Search with Bayesian Optimization for both passive and active learning settings. Preliminary results show faster policy generalization on a simulated toy problem.
Supervised topic models for clinical interpretability
Hughes, Michael C., Elibol, Huseyin Melih, McCoy, Thomas, Perlis, Roy, Doshi-Velez, Finale
Supervised topic models can help clinical researchers find interpretable cooccurence patterns in count data that are relevant for diagnostics. However, standard formulations of supervised Latent Dirichlet Allocation have two problems. First, when documents have many more words than labels, the influence of the labels will be negligible. Second, due to conditional independence assumptions in the graphical model the impact of supervised labels on the learned topic-word probabilities is often minimal, leading to poor predictions on heldout data. We investigate penalized optimization methods for training sLDA that produce interpretable topic-word parameters and useful heldout predictions, using recognition networks to speed-up inference. We report preliminary results on synthetic data and on predicting successful anti-depressant medication given a patient's diagnostic history.