Goto

Collaborating Authors

 Deep Learning


Neural Belief Tracker: Data-Driven Dialogue State Tracking

arXiv.org Artificial Intelligence

One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue. However, most current approaches have difficulty scaling to larger, more complex dialogue domains. This is due to their dependency on either: a) Spoken Language Understanding models that require large amounts of annotated training data; or b) hand-crafted lexicons for capturing some of the linguistic variation in users' language. We propose a novel Neural Belief Tracking (NBT) framework which overcomes these problems by building on recent advances in representation learning. NBT models reason over pre-trained word vectors, learning to compose them into distributed representations of user utterances and dialogue context. Our evaluation on two datasets shows that this approach surpasses past limitations, matching the performance of state-of-the-art models which rely on hand-crafted semantic lexicons and outperforming them when such lexicons are not provided.


ml4seti SETI Institute

#artificialintelligence

The SETI Institute of Mountain View is inviting all citizen data scientists and technologists to join us as collaborators in our mission to find intelligent radio signals from beyond our solar system. We are issuing a worldwide, public code challenge and accompanying hackathon for the purpose of expanding our radio-telescope signal classification tools using the latest developments available in machine- and deep-learning. We are looking for signal classification algorithms and models that can accurately identify the various types of radio signals we observe each night. We have constructed a set of simulated signals (thus, they are a labeled training data set) that mimic our observations. A typical analysis approach begins with transforming these simulated data into two-dimensional images.


Neural Networks Tutorial - A Pathway to Deep Learning - Adventures in Machine Learning

#artificialintelligence

Chances are, if you are searching for a tutorial on artificial neural networks (ANN) you already have some idea of what they are, and what they are capable of doing. But did you know that neural networks are the foundation of the new and exciting field of deep learning? Deep learning is the field of machine learning that is making many state-of-the-art advancements, from beating players at Go and Poker, to speeding up drug discovery and assisting self-driving cars. If these types of cutting edge applications excite you like they excite me, then you will be interesting in learning as much as you can about deep learning. However, that requires you to know quite a bit about how neural networks work. This tutorial article is designed to help you get up to speed in neural networks as quickly as possible. In this tutorial I'll be presenting some concepts, code and maths that will enable you to build and understand a simple neural network. Some tutorials focus only on the code and skip the maths – but this impedes understanding. I'll take things as slowly as possible, but it might help to brush up on your matrices and differentiation if you need to. The code will be in Python, so it will be beneficial if you have a basic understanding of how Python works. You'll pretty much get away with knowing about Python functions, loops and the basics of the numpy library. By the end of this neural networks tutorial you'll be able to build an ANN in Python that will correctly classify handwritten digits in images with a fair degree of accuracy. Once you're done with this tutorial, you can dive a little deeper with the following posts: All of the relevant code in this tutorial can be found here. Here's an outline of the tutorial, with links, so you can easily navigate to the parts you want: Artificial neural networks (ANNs) are software implementations of the neuronal structure of our brains. We don't need to talk about the complex biology of our brain structures, but suffice to say, the brain contains neurons which are kind of like organic switches. These can change their output state depending on the strength of their electrical or chemical input. The neural network in a person's brain is a hugely interconnected network of neurons, where the output of any given neuron may be the input to thousands of other neurons.


Artificial Intelligence Is Changing the Cloud Business

#artificialintelligence

"Data is key to both machine and deep learning," explains McDonough, "data in conjunction with a strong algorithm are the keys to success. Mega clouds have been attractive to customers because they make it easier to setup, operationalize and expand. They additionally offer ancillary services to be leveraged. Today most consider Amazon Web Services, Microsoft Azure, and Google Cloud Platform as the industry's biggest public cloud vendors. These three'mega clouds' are the market leaders, but McDonough speculated that this may not always be the case for AI.


AI turns children’s books illustrations into nightmares

Daily Mail - Science & tech

Researchers have seen hundreds of children's books through the eyes of an AI – and it was a nightmare. The team trained a deep learning algorithm to recognize illustrations by feeding it a data set of 6,468 pages from 223 books, by 24 artist. Once the AI had learned the characteristics of a specific artist, it transferred them to a new image that is sure to give children night terrors – it lit a smiling turtle on fire, engulfed a girl in flames and turned a snow covered scene bottom into an image of the apocalypse. Researchers aimed to teach a deep deep learning algorithm to recognize patterns and used children's books illustrations. The team fed the AI a data set of 6,468 pages from 223 books, by 24 artist.


Practicalities of employing deep learning at scale

#artificialintelligence

This is an excerpt from a talk by Kenny Daniel, "Lessons learned from deploying the top deep learning frameworks in production." Visit Safari to view the full session from the 2016 Artificial Intelligence Conference in New York. Algorithmia is a leading online marketplace for developers to share, sell, and use machine learning APIs. The company gives co-founder Kenny Daniel a bird's-eye view of the machine learning landscape, including the latest developments in artificial intelligence and deep learning. In this excerpt from his talk, Daniel recounts lessons learned when trying to implement deep neural networks not only for oneself, but also for others in a production-worthy environment.


Why Deep Learning Will Revolutionize The Tech Industry Articles Big Data

#artificialintelligence

Data analysis tools like deep learning, top-down reporting and stream processing which may be used to produce detailed reports in real time are all responsible for numerous changes in the way that businesses conduct their everyday operations. Big data techniques and analytics may be used to generate valuable insight regarding the effectiveness of policy changes and quality improvement efforts, customer profiling, and even marketing and promotional opportunities. Resources that make it much easier to generate a comprehensive and detailed data analysis covering many different aspects of the operation or various workflow processes are an asset that more and more businesses have begun to rely upon.


Microsoft's SQL Server is getting an artificial intelligence mind-meld

#artificialintelligence

Microsoft says it's building artificial intelligence capabilities directly into SQL Server 2017, aiming to simplify and speed up machine-learning processes that would normally take place outside the database. The company says the integration will create new deep-learning capabilities inside databases, such as image recognition, text analysis and other AI tasks involving unstructured data. Microsoft describes the integration as a first for relational database management systems. The company is also adding support for the Python programming language into SQL Server, supplementing its existing support for the R programming language that's popular for data science. "SQL Server now is not just a database management system -- I think of it as an intelligence base," said Joseph Sirosh, corporate vice president for Microsoft's Data Group, in a briefing with reporters and analysts.


The InfoQ eMag: Introduction to Machine Learning

#artificialintelligence

Machine learning has long powered many products we interact with daily--from "intelligent" assistants like Apple's Siri and Google Now, to recommendation engines like Amazon's that suggest new products to buy, to the ad ranking systems used by Google and Facebook. More recently, machine learning has entered the public consciousness because of advances in "deep learning"--these include AlphaGo's defeat of Go grandmaster Lee Sedol and impressive new products around image recognition and machine translation. While much of the press around machine learning has focused on achievements that were not previously possible, the full range of machine learning methods--from traditional techniques that have been around for decades to more recent approaches with neural networks--can be deployed to solve many important (but perhaps more prosaic) problems that businesses face. Examples of these applications include, but are by no means limited to, fraud prevention, time-series forecasting, and spam detection. InfoQ has curated a series of articles for this introduction to machine learning eMagazine covering everything from the very basics of machine learning (what are typical classifiers and how do you measure their performance?), to production considerations (how do you deal with changing patterns in data after you've deployed your model?), to newer techniques in deep learning.


Launch Your Deep Learning Moonshot at GTC NVIDIA Blog

#artificialintelligence

A credit card that stops fraudsters in their tracks. A car that can drive itself down San Francisco's Lombard Street, the famed "crookedest" street in the world. Deep learning and AI will be front and center at our eighth annual GPU Technology Conference, May 8-11 at the San Jose Convention Center. Pioneers and rising stars in the field will share what they've learned, help demystify deep learning and teach you what you need to know to get started, or hone your skills with the latest advances. AI researchers and developers around the world use NVIDIA's GPU computing and deep learning platform to train and deploy machines to classify images, analyze videos, recognize speech, process natural language and more -- and upend how business gets done.