New types of machine learning hardware in development and entering the market hold the promise of revolutionizing deep learning in a manner as profound as GPUs. However, existing software frameworks and training algorithms for deep learning have yet to evolve to fully leverage the capability of the new wave of silicon. We already see the limitations of existing algorithms for models that exploit structured input via complex and instance-dependent control flow, which prohibits minibatching. We present an asynchronous model-parallel (AMP) training algorithm that is specifically motivated by training on networks of interconnected devices. Through an implementation on multi-core CPUs, we show that AMP training converges to the same accuracy as conventional synchronous training algorithms in a similar number of epochs, but utilizes the available hardware more efficiently even for small minibatch sizes, resulting in significantly shorter overall training times. Our framework opens the door for scaling up a new class of deep learning models that cannot be efficiently trained today.

Probability distributions produced by the cross-entropy loss for ordinal classification problems can possess undesired properties. We propose a straightforward technique to constrain discrete ordinal probability distributions to be unimodal via the use of the Poisson and binomial probability distributions. We evaluate this approach in the context of deep learning on two large ordinal image datasets, obtaining promising results.

Tesla Inc. has hired a Stanford University computer scientist specializing in artificial intelligence and deep learning to lead its efforts around driverless cars. Andrej Karpathy, previously a research scientist at OpenAI, was named director of AI and Autopilot Vision, reporting directly to Chief Executive Elon Musk, a Tesla spokesperson said. Karpathy is "one of the world's leading experts in computer vision and deep learning," the spokesperson said. He will work closely with Jim Keller, who is responsible for Autopilot hardware and software. Autopilot is Tesla's suite of advanced driver assistance systems, which relies on an onboard Nvidia Corp NVDA, 1.52% "supercomputer" to make sense of data from numerous sensors in and around Tesla vehicles and the company's software.

The vast majority of us are living in an artificial intelligence (AI) bubble. Indeed, it seems like the very notion of AI has recently undergone something of a makeover. It wasn't too long ago that AI belonged to the realm of science fiction, whereas many have come to view it as a business imperative today. Now, consumer applications like Alexa and Siri hog the headlines, and people are falling over themselves to tell you how AI will forever change the way we work. The truth, though, is that most of this AI bubble is overhyped.

The new approach for deep learning stems from the Massachusetts Institute of Technology (MIT). Deep learning refers to the use of artificial neural networks which contain more than one hidden layer. Deep learning is part of a broader family of machine learning methods based on learning data representations. As an example, most image recognition machines are "trained" via deep learning. In many cases such machines can complete task like looking for cancer in blood better than people.

How Quantum can be used to dramatically enhance and speed up not just Convolutional Neural Nets for image processing and Recurrent Neural Nets for language and speech recognition, but also the frontier applications of Generative Adversarial Neural Nets and Reinforcement Learning. While supply chain, cybersecurity, risk modeling, and complex system analysis are all important segments of data science, they don't hold nearly the promise of what a massive improvement in Deep Learning would mean commercially. Optimization problems extend beyond the realm of traditional data science to include incredibly complex problems like protein folding or test flying space craft based on mathematical models. Can We Make Quantum Computers Work Like Deep Neural Nets?

Add to that the new IBM Q program offering commercial quantum compute time via API where IBM says "To date users have run more than 300,000 quantum experiments on the IBM Cloud". In 2010 Lockheed became D-Wave's first commercial customer after testing whether (now 7 year old) Quantum computers could spot errors in complex code. Temporal Defense Systems (TDS): TDS is using the latest D-Wave 2000Q to build its advanced cyber security system, the Quantum Security Model. Commonwealth recently announced a large investment in a Quantum simulator, while Westpac and Telstra have made sizable ownership investments in Quantum computing companies focused on cyber security.

During the past few years, deep learning has revolutionized nearly every field it has been applied to, resulting in the greatest leap in performance in the history of computer science. With many problems, for which we were used to seeing small, gradual improvements every year, we are now witnessing 20% – 30% improvements within months, due to the application of deep learning. This success has also stirred lots of media and PR buzz, as a result of which, nowadays the terms "artificial intelligence", "machine learning", and "deep learning" are used very widely, and most often inaccurately and confusingly. Artificial Intelligence (AI), a phrase coined by the pioneering computer scientist John McCarthy in the 1950s, is an umbrella term for all the methods and disciplines that result in any form of intelligence exhibited by machines. This includes anything from the 1980s expert systems (basically datasets of hard-coded knowledge), up to most advanced forms of AI in the 2010s.

Think machines can't be creative? This awesome use of artificial intelligence to make epic dinosaur art will make you question that assumption. Neural networks can do some awesome things, from allowing cars to drive on their own to instantly translating dozens of languages. But when it comes to our personal favorite use cases, we're going with one recently engineered by Australian artist Chris Rodley. By combining a deep-learning algorithm, a book of dinosaur pictures, and a book of flower paintings, he's created some of the trippiest images this side of an M.C. "The tech that makes this work isn't mine, but was created by a team of researchers from Germany who published a paper on it two years ago," Rodley told Digital Trends. "The idea of the group, led by Leon Gatys, was to transfer an art style as represented in a sample print to a target photograph.

This resource is part of a series on specific topics related to data science: regression, clustering, neural networks, deep learning, Hadoop, decision trees, ensembles, correlation, outliers, regression, Python, R, Tensorflow, SVM, data reduction, feature selection, experimental design, time series, cross-validation, model fitting, dataviz, AI and many more. To keep receiving these articles, sign up on DSC.