Goto

Collaborating Authors

 Deep Learning


Strengthening our commitment to Canadian research DeepMind

#artificialintelligence

Here's what others have to say about DeepMind Montreal: "DeepMind's exceptional research accomplishments have helped focus the world's attention on AI and to propel new scientific discoveries. The mission of DeepMind, solving intelligence, is perfectly aligned with my own research work and goals. I am really excited to join forces with DeepMind and to help build the new Montreal team. At the same time, I look forward to continue training the next generations of machine learning researchers at MILA and McGill, fostering diversity and inclusion in the research community, through AI projects for social good, and building further the Montreal AI ecosystem." "I am very excited to be working with Doina, Rich Sutton, Mike Bowling, Patrick Pilarski and the rest of our incredible research team to grow DeepMind's research labs in Edmonton and Montreal - two cities with a vibrant AI ecosystem. Key to the health of this ecosystem is the collaboration between academic institutions and industry and I look forward to building strong and enduring ties between the two right here in Canada. I am a big admirer of Doina's work and her focus on AI for social good, which clearly aligns with DeepMind's mission, and I am looking forward to supporting her in her future efforts."


Reconstruction of Hidden Representation for Robust Feature Extraction

arXiv.org Machine Learning

L(x, g(f(x))), where f(.) is the encoder function, g(.) is the decoder function and L(.) is the reconstruction error. Recently, they have become one of the most promising approaches to representation learning for estimating the data-generating distribution. Since the appearance of Auto-Encoders, many variants of representation learning algorithms based on Auto-Encoders have been proposed, e.g., Sparse Auto-Encoders [9], [10], Denoising Auto-Encoders (DAEs) [11], Higher Order Contractive Auto-Encoders [12], Variational Auto-Encoders [13], Marginalized Denoising Auto-Encoders [14], Generalized Denoising Auto-Encoders [15], Generative Stochastic Networks [16], MADE [17], Laplacian Auto-Encoders [18], Adversarial Auto-Encoders [19], Ladder Variational Auto-Encoders [20] and so on. In an Auto-Encoder-based algorithm, minimizing the reconstruction error of the input with the encoder and decoder function is a common practice for feature learning. The learned features are usually applied in subsequent tasks such as supervised classification [21]. In the past few years, many research works have shown that the reconstruction of the input with the encoder and decoder function is not only an efficient way for learning feature representation, but its resulting representations also substantially help the performance of the subsequent tasks. In general, a lower value of the reconstruction error of the input has a better feature representation of the input. In an ideal situation, the value of this reconstruction error is equal to 0, i.e., the 2


Machine learning to transform medicine Technology

#artificialintelligence

While robots and computers will probably never completely replace doctors and nurses, machine learning, deep learning and AI are transforming the healthcare industry, improving outcomes, and changing the way doctors think about providing care. In the past decade, the medical community has taken a major step in adopting electronic health systems to make information more accessible to clinicians and patients. Now, to make sense of all that information, healthcare providers are starting to turn to machine learning. "On top of that data you have applications or machine learning algorithms, things that you're doing against the data to allow you to gain insight, to make decisions and to optimise the outcomes," said Eric Schnatterly, Vice President IBM Systems for Cloud Platforms. When it comes to the effectiveness of machine learning, more data almost always yields better results โ€“ and the healthcare sector is sitting on a data goldmine.


Where is Deep Learning Heading?

#artificialintelligence

Deep learning is the fastest growing field in machine learning and is used to solve many big data problems such as computer vision, speech recognition, and natural language processing. It's used across multiple industries and as a method of overcoming real world problems like preventing disease, building smart cities, revolutionising analytics and so much more. Whilst deep learning is being adopted by businesses of all shapes and sizes, it can be overwhelming. Until very recently, its implementation has only been realistic for large companies with access to huge amounts of data such as images, signals and text to provide to the machine in order for it to learn. Smaller businesses or researchers who have limited historical data have previously been missing out; however there are ways of overcoming this barrier to implement deep learning methods.


Deep Learning Summit Montreal

#artificialintelligence

Computer scientists from the University of Toronto have created a software program that helps users avoid fashion faux pas. Raquel Urtasun and Sanja Fidler, along with colleagues in Spain, designed an algorithm that analyzes a person's photograph to determine whether the wearer's outfit is stylish. It also suggests ways to improve the ensemble and the subject's overall appeal.


Data Science, AI & Deep Learning Conference โ€“ 16 November 2017, London

@machinelearnbot

Click here to see the full programme. This conference brings together a range of expert practitioners to explore and discuss the new era of AI, Machine Learning and Deep Learning. Participants gain real insights on how to exploit these technological advances for themselves and their organisations in an increasingly'data-driven world'. Associated Workshops For a deeper understanding of the topics covered in the conference, sign up to our workshops. Attendees can expect: more coding, more examples and more interaction!


"PyTorch: Fast Differentiable Dynamic Graphs in Python" by Soumith Chintala

@machinelearnbot

In this talk, we will be discussing PyTorch: a deep learning framework that has fast neural networks that are dynamic in nature. PyTorch is written in a mix of Python and C/C and is targeted for very high performance using GPUs and CPUs. We'll be discussing the design and challenges of PyTorch, as well as the need for the dynamic nature because of new-age AI research. We will also be talking about a Tensor compiler that powers PyTorch, which fuses operations on the fly to make them faster. Soumith Chintala FACEBOOK Soumith is a Research Engineer at Facebook AI Research.


xbresson/graph_convnets_pytorch

@machinelearnbot

The code provides a simple example of graph ConvNets for the MNIST classification task. The graph is a 8-nearest neighbor graph of a 2D grid. The signals on graph are the MNIST images vectorized as $28 2 \times 1$ vectors. PyTorch has not yet implemented function torch.mm(sparse, It will be certainly implemented but in the meantime, I defined a new autograd function for sparse variables, called "my_sparse_mm", by subclassing torch.autograd.function


Deep learning for speech processing

#artificialintelligence

Net D-AE DBN DBM AEPerceptron RBM?GMM BayesNP SVM Supervised Supervised Unsupervised Sparse Coding SP Boosting DecisionTree Deep Neural Net RNN?Bayes Nets Modified from 16. 16 Signal Processing Information Processing Signals Processing Audio/Music Speech Image/ Animation/ Graphics Video Text/ Language Coding/ Compression Audio Coding Speech Coding Image Coding Video Coding Document Compression/ Summary Communication Voice over IP, DAB,etc 4G/5G Networks, DVB, Home Networking, etc Security Multimedia watermarking, encryption, etc. Enhancement/ Analysis De-noising/ Source separation Speech Enhancement/ Feature extraction Image/video enhancement (Clear Type), Segmentation, feature extraction Grammar checking, Text Parsing Synthesis/ Rendering Computer Music Speech Synthesis (text-to-speech) Computer Graphics/ Video Synthesis Natural Language Generation User-Interface Multi-Modal Human Computer Interaction (HCI --- Input Methods) Recognition Auditory Scene Analysis (Computer audition; e.g.


Deep Learning for Mortgage Risk by Justin Sirignano, Apaar Sadhwani, Kay Giesecke :: SSRN

#artificialintelligence

We develop a deep learning model of multi-period mortgage risk and use it to analyze an unprecedented dataset of origination and monthly performance records for over 120 million mortgages originated across the US between 1995 and 2014. Our nonparametric estimators of term structures of conditional probabilities of prepayment, foreclosure and various states of delinquency incorporate the dynamics of a large number of loan-specific as well as economic and demographic variables at national, state, county and zip-code levels. The behavior of mortgage risk can vary strongly depending upon the geographic region. Moreover, the relationship between factors and mortgage risk is often highly nonlinear. Higher-order interactions between multiple factors are prevalent.