Goto

Collaborating Authors

 Deep Learning


AI Helps Warehouse Robots Pick Up New Tricks

#artificialintelligence

Some of the biggest names in artificial intelligence, including two godfathers of the machine learning boom, are betting that clever algorithms are about to transform the abilities of industrial robots. Geoffrey Hinton and Yann LeCun, who shared this year's Turing Prize with Yoshua Bengio for their work on deep learning, are among the AI luminaries who have invested in Covariant.ai, The company, emerging from stealth Wednesday, announced the first commercial installations of its AI-equipped robots: picking boxes and bags of products for a German electronics retailer called Obeta. Picking up everyday boxes and plastic packages might sound trivial, and it is for most humans. Workers in factories and warehouses are frequently given new objects to handle, or a batch of different items mixed together, but it's deceptively difficult for a machine to quickly work out how to grab the next doodad.


AI Helps Warehouse Robots Pick Up New Tricks

#artificialintelligence

Some of the biggest names in artificial intelligence, including two godfathers of the machine learning boom, are betting that clever algorithms are about to transform the abilities of industrial robots. Geoffrey Hinton and Yann LeCun, who shared this year's Turing Prize with Yoshua Bengio for their work on deep learning, are among the AI luminaries who have invested in Covariant.ai, The company, emerging from stealth Wednesday, announced the first commercial installations of its AI-equipped robots: picking boxes and bags of products for a German electronics retailer called Obeta. Picking up everyday boxes and plastic packages might sound trivial, and it is for most humans. Workers in factories and warehouses are frequently given new objects to handle, or a batch of different items mixed together, but it's deceptively difficult for a machine to quickly work out how to grab the next doodad.


Automating Receipt Digitization with OCR and Deep Learning

#artificialintelligence

Receipt digitization addresses the challenge of automatically extracting information from a receipt. In this article, I cover the theory behind receipt digitization and implement an end-to-end pipeline using OpenCV and Tesseract. I also review a few important papers that do Receipt Digitization using Deep Learning. Receipts carry the information needed for trade to occur between companies and much of it is on paper or in semi-structured formats such as PDFs and images of paper/hard copies. In order to manage this information effectively, companies extract and store the relevant information contained in these documents. Traditionally this has been achieved by manually extracting the relevant information and inputting it into a database which is a labor-intensive and expensive process. Receipt digitization addresses the challenge of automatically extracting information from a receipt. Extracting key information from receipts and converting them to structured documents can serve many applications and services, such as efficient archiving, fast indexing and document analytics.


7 Observations About AI In 2019

#artificialintelligence

After years in the (mostly Canadian) wilderness followed by seven years of plenty, Deep Learning was officially recognized as the "dominant" AI paradigm and "a critical component of computing," with its three key proponents, Geoffrey Hinton, Yann LeCun, and Yoshua Bengio, receiving the Turing Award in March 2019. Turing Award winners (from left to right) Yoshua Bengio, Yann LeCun, and Geoffrey Hinton at the ... [ ] ReWork Deep Learning Summit, Montreal, October 2017. In October 2012, a deep neural network achieved an error rate of only 16% in the ImageNet Large Scale Visual Recognition Challenge, a significant improvement over the 25% error rate achieved by the best entry the year before. Yann LeCun: "The difference there was so great that a lot of people, you could see a big switch in their head going'clunk.' Now they were convinced;" Geoffrey Hinton: "Until we could produce results that were clearly better than the current state of the art, people were very skeptical;" Yoshua Bengio: "[Anyone hoping to make the next Turing-winning breakthrough in AI] should not follow the trend--which right now is deep learning." Deep Learning is a "critical component of computing"โ€ฆ or biology? As customary for Turing Awards laureates, Hinton, LeCun and Bengio delivered the A. M. Turing Lecture.


Data Science Trends for 2020 - Insights from 50 Leading AI Experts

#artificialintelligence

ODSC speakers are all subject-matter experts in their respective fields. From machine and deep learning to NLP and neural networks, all of our past and current event speakers truly are thought leaders in their specialties. On top of their day-to-day work, they're all proactive in staying up-to-date with the latest advances in the fields of data science and AI, whether that be from reading recent research papers or trying out the latest tools themselves. Because of their demonstrated expertise, we reached out to them to get their thoughts on the biggest updates from 2019, and what they're most excited for in 2020. Take your time reviewing their answers, learn about new frameworks, libraries, and languages, read some of their favorite research papers, and get a jump on what they're excited about in 2020.


Deep combinatorial optimisation for optimal stopping time problems and stochastic impulse control. Application to swing options pricing and fixed transaction costs options hedging

arXiv.org Machine Learning

American-style options are used not only by traditional asset managers but also by energy companies to hedge "optimised assets" by finding optimal decisions to optimise their P&L and find their value. A common modelling of a power plant unit P&L is done using swing options which are American options allowing to exercise at most l times the option with possibly a constraint on the delay between two exercise dates (see Carmona and Touzi (2008) or Warin (2012) for gas storage modelling). Formally, for T 0, we are given a stochastic processes ( X t) t 0 defined on a probability space (โ„ฆ, F, F ( F t) t 0, P) and one wants to find an increasing sequence of F stopping times ฯ„ ( ฯ„ 1,ฯ„ 2,...,ฯ„ l) that maximises the expectation of some objective function f E Pnull l null i 1f ( ฯ„ i,X ฯ„ i) 1 ฯ„ i Tnull . Numerical methods to solve the optimal stopping problem when l 1,f ( x,t) e rt g (x) and X is Markovian include: - Dynamic programming equation: the option price P 0 is computed using the following backward discrete scheme over a grid t 0 0 t 1 ... t N T: P t N g ( X T), P t i max( g ( X t i),e r (t i 1 t i) E P( P t i 1 F t i)), i 0,...,N 1 . One then needs to perform regression to compute the conditional expectations, see Longstaff and Schwartz (2001) or Bouchard and Warin (2012).


Full error analysis for the training of deep neural networks

arXiv.org Artificial Intelligence

Deep learning algorithms have been applied very successfully in recent years to a range of problems out of reach for classical solution paradigms. Nevertheless, there is no completely rigorous mathematical error and convergence analysis which explains the success of deep learning algorithms. The error of a deep learning algorithm can in many situations be decomposed into three parts, the approximation error, the generalization error, and the optimization error. In this work we estimate for a certain deep learning algorithm each of these three errors and combine these three error estimates to obtain an overall error analysis for the deep learning algorithm under consideration. In particular, we thereby establish convergence with a suitable convergence speed for the overall error of the deep learning algorithm under consideration. Our convergence speed analysis is far from optimal and the convergence speed that we establish is rather slow, increases exponentially in the dimensions, and, in particular, suffers from the curse of dimensionality. The main contribution of this work is, instead, to provide a full error analysis (i) which covers each of the three different sources of errors usually emerging in deep learning algorithms and (ii) which merges these three sources of errors into one overall error estimate for the considered deep learning algorithm.


Transport Gaussian Processes for Regression

arXiv.org Machine Learning

Gaussian process (GP) priors are non-parametric generative models with appealing modelling properties for Bayesian inference: they can model non-linear relationships through noisy observations, have closed-form expressions for training and inference, and are governed by interpretable hyperparameters. However, GP models rely on Gaussianity, an assumption that does not hold in several real-world scenarios, e.g., when observations are bounded or have extreme-value dependencies, a natural phenomenon in physics, finance and social sciences. Although beyond-Gaussian stochastic processes have caught the attention of the GP community, a principled definition and rigorous treatment is still lacking. In this regard, we propose a methodology to construct stochastic processes, which include GPs, warped GPs, Student-t processes and several others under a single unified approach. We also provide formulas and algorithms for training and inference of the proposed models in the regression problem. Our approach is inspired by layers-based models, where each proposed layer changes a specific property over the generated stochastic process. That, in turn, allows us to push-forward a standard Gaussian white noise prior towards other more expressive stochastic processes, for which marginals and copulas need not be Gaussian, while retaining the appealing properties of GPs. We validate the proposed model through experiments with real-world data.


Deep Learning Based Unsupervised and Semi-supervised Classification for Keratoconus

arXiv.org Machine Learning

The transparent cornea is the window of the eye, facilitating the entry of light rays and controlling focusing the movement of the light within the eye. The cornea is critical, contributing to 75% of the refractive power of the eye. Keratoconus is a progressive and multifactorial corneal degenerative disease affecting 1 in 2000 individuals worldwide. Currently, there is no cure for keratoconus other than corneal transplantation for advanced stage keratoconus or corneal cross-linking, which can only halt KC progression. The ability to accurately identify subtle KC or KC progression is of vital clinical significance. To date, there has been little consensus on a useful model to classify KC patients, which therefore inhibits the ability to predict disease progression accurately. In this paper, we utilised machine learning to analyse data from 124 KC patients, including topographical and clinical variables. Both supervised multilayer perceptron and unsupervised variational autoencoder models were used to classify KC patients with reference to the existing Amsler-Krumeich (A-K) classification system. Both methods result in high accuracy, with the unsupervised method showing better performance. The result showed that the unsupervised method with a selection of 29 variables could be a powerful tool to provide an automatic classification tool for clinicians. These outcomes provide a platform for additional analysis for the progression and treatment of keratoconus.


Channel-Attention Dense U-Net for Multichannel Speech Enhancement

arXiv.org Machine Learning

Supervised deep learning has gained significant attention for speech enhancement recently. The state-of-the-art deep learning methods perform the task by learning a ratio/binary mask that is applied to the mixture in the time-frequency domain to produce the clean speech. Despite the great performance in the single-channel setting, these frameworks lag in performance in the multichannel setting as the majority of these methods a) fail to exploit the available spatial information fully, and b) still treat the deep architecture as a black box which may not be well-suited for multichannel audio processing. This paper addresses these drawbacks, a) by utilizing complex ratio masking instead of masking on the magnitude of the spectrogram, and more importantly, b) by introducing a channel-attention mechanism inside the deep architecture to mimic beamforming. We propose Channel-Attention Dense U-Net, in which we apply the channel-attention unit recursively on feature maps at every layer of the network, enabling the network to perform non-linear beamforming. We demonstrate the superior performance of the network against the state-of-the-art approaches on the CHiME-3 dataset.