Goto

Collaborating Authors

 Deep Learning


Deep Learning of Robotic Tasks without a Simulator using Strong and Weak Human Supervision

arXiv.org Artificial Intelligence

We propose a scheme for training a computerized agent to perform complex human tasks such as highway steering. The scheme is designed to follow a natural learning process whereby a human instructor teaches a computerized trainee. The learning process consists of five elements: (i) unsupervised feature learning; (ii) supervised imitation learning; (iii) supervised reward induction; (iv) supervised safety module construction; and (v) reinforcement learning. We implemented the last four elements of the scheme using deep convolutional networks and applied it to successfully create a computerized agent capable of autonomous highway steering over the well-known racing game Assetto Corsa. We demonstrate that the use of the last four elements is essential to effectively carry out the steering task using vision alone, without access to a driving simulator internals, and operating in wall-clock time. This is made possible also through the introduction of a safety network, a novel way for preventing the agent from performing catastrophic mistakes during the reinforcement learning stage.


Hadamard Product for Low-rank Bilinear Pooling

arXiv.org Artificial Intelligence

Bilinear models provide rich representations compared with linear models. They have been applied in various visual tasks, such as object recognition, segmentation, and visual question-answering, to get state-of-the-art performances taking advantage of the expanded representations. However, bilinear representations tend to be high-dimensional, limiting the applicability to computationally complex tasks. We propose low-rank bilinear pooling using Hadamard product for an efficient attention mechanism of multimodal learning. We show that our model outperforms compact bilinear pooling in visual question-answering tasks with the state-of-the-art results on the VQA dataset, having a better parsimonious property. Bilinear models (Tenenbaum & Freeman, 2000) provide richer representations than linear models. To exploit this advantage, fully-connected layers in neural networks can be replaced with bilinear pooling. The outer product of two vectors (or Kroneker product for matrices) is involved in bilinear pooling, as a result of this, all pairwise interactions among given features are considered. Recently, a successful application of this technique is used for fine-grained visual recognition (Lin et al., 2015).


Deep Learning for Data Engineers: Part I - DZone Big Data

#artificialintelligence

Deep Learning is not just for super genius Data Science PhDs. Someone needs to get this code running, scale it, distribute it, install it, integrate it, and have it executed. Here is the place where the Big Data engineers and data DevOps teams come into play. I have been integrating some of these frameworks, libraries, models and tools into existing Hadoop, Big Data, Spark, and Machine Learning pipelines. Follow the instructions for PyTorch, TensorFlow, and MXNet.


This chart illustrates how AI is exploding at Google

#artificialintelligence

These are some the most elite academic journals in the world. And last year, one tech company, Alphabet's Google, published papers in all of them. The unprecedented run of scientific results by the Mountain View search giant touched on everything from ophthalmology to computer games to neuroscience and climate models. For Google, 2016 was an annus mirabilis during which its researchers cracked the top journals and set records for sheer volume. Behind the surge is Google's growing investment in artificial intelligence, particularly "deep learning," a technique whose ability to make sense of images and other data is enhancing services like search and translation (see "10 Breakthrough Technologies 2013: Deep Learning").


Deep learning is about more than AI – it has unified research

#artificialintelligence

Over the course of March of the Machines, there has been a lot of talk about machine learning and deep learning, and the jobs arising from them, but what is it like to work in that field? When we talk about emerging technologies and the future of tech, deep learning is an area that crops up again and again. It will be the driving force behind the development of AI and robotics, and already plays an essential part in the creation of tech we use on a daily basis. But what is it like to work in this evolving sector? We asked Kevin McGuinness, research fellow at the Insight Centre for Data Analytics, Dublin City University (DCU), about what he's doing with deep learning and how the area is changing.


Getting Started with Deep Learning

@machinelearnbot

This article was written by Matthew Rubashkin. With a background in optical physics and biomedical research, Matthew has a broad range of experiences in software development, database engineering, and data analytics. At SVDS, our R&D team has been investigating different deep learning technologies, from recognizing images of trains to speech recognition. We needed to build a pipeline for ingesting data, creating a model, and evaluating the model performance. However, when we researched what technologies were available, we could not find a concise summary document to reference for starting a new deep learning project.


SureID - Vice President of Data Science/Machine Learning (Portland Metro Area)

#artificialintelligence

Job Requirements • Master's degree or equivalent work experience in machine learning • Strong hands on experience solving complex problems using unsupervised and supervised machine learning algorithms • Proficiency in feature selection and feature engineering • Strong experience with big data tools and techniques, like Hadoop and Spark • Broad knowledge of machine learning algorithms, with ability to select and apply appropriate algorithms to specific problem domains • Ability to collaborate with domain experts to efficiently and effectively identify and extract previously unfamiliar domain knowledge Preferred • Knowledge in Natural Language Processing, especially named entity recognition • Experience in problems associated with people-centric data, like name parsing, name comparison, address parsing etc. • Experience with frameworks and techniques in deep learning and deep neural networks • Experience with computer vision, particularly facial recognition and comparison About SureID SureID, Inc. integrates leading edge products and services into solutions that combine identity enrollment, authentication, background screening, and access management to make facilities, assets, and people safer and more secure. Using SureID's patented programs, highly secure facilities – such as military installations, government buildings, manufacturing and distribution sites, ports, and commercial builds – can increase security and streamline access for authorized personnel. SureID has a proven track record for successfully servicing government, military and commercial clients. The RAPIDGate Program already serves thousands of companies and hundreds of thousands of RAPIDGate badge-holders who enjoy streamlined access into Department of Defense and Homeland Security facilities. SureID is a privately-held company founded in November 2001 and headquartered in Hillsboro, OR.


Udacity Self-Driving Car Nanodegree Project 5 -- Vehicle Detection – Becoming Human

#artificialintelligence

Welcome to the "mom report" (Hi mom!); if jargon and mumbo jumbo are more your style then maybe this is what you're after, otherwise enjoy! I'm already counting the days (four, at the moment) until Term 2 begins and trying to decide the best way to sustain my momentum, starting with this here recap of Project 5 -- Vehicle Detection. The interesting thing to me about this project, in particular, was that it sort of occupied the middle ground between the first and fourth projects and the second and third projects. The first and fourth projects used old-school computer vision techniques and explicitly defined steps to produce an output (highlighting the location of lane lines), whereas the second and third projects employed deep learning's hot-ass newness (I might have to trademark that) to sort of let the program figure out the rules on its own based on a ton of examples. The goal of the Vehicle Detection project was to identify vehicles in dashcam video. While there are already deep learning implementations (e.g.


Addressing the Critical Issues of Deep Learning in Medical Imaging

@machinelearnbot

Since being named as one of the top 10 breakthrough technologies of 2013, deep learning has hit the headlines repeatedly, with new applications emerging rapidly. In particular, deep learning techniques have proven to be powerful tools for a range of computer vision tasks, including medical imaging. Accurate diagnosis of disease depends on the acquisition and interpretation of medical images, which is still usually undertaken by humans. Using machines instead is expected to leave less room for human error that is usually due to subjectivity, variations in expertise and opinion of interpreters, and fatigue in physicians. View a selection of presentations from the 2017 Deep Learning in Healthcare Summit in London here, or contact Chloe cpang@re-work.co to sign up for a video membership.


The Mathematics of Machine Learning – Towards Data Science

#artificialintelligence

In the last few months, I have had several people contact me about their enthusiasm for venturing into the world of data science and using Machine Learning (ML) techniques to probe statistical regularities and build impeccable data-driven products. However, I have observed that some actually lack the necessary mathematical intuition and framework to get useful results. This is the main reason I decided to write this blog post. Recently, there has been an upsurge in the availability of many easy-to-use machine and deep learning packages such as scikit-learn, Weka, Tensorflow, R-caret etc. Machine Learning theory is a field that intersects statistical, probabilistic, computer science and algorithmic aspects arising from learning iteratively from data and finding hidden insights which can be used to build intelligent applications. Despite the immense possibilities of Machine and Deep Learning, a thorough mathematical understanding of many of these techniques is necessary for a good grasp of the inner workings of the algorithms and getting good results. The main question when trying to understand an interdisciplinary field such as Machine Learning is the amount of maths necessary and the level of maths needed to understand these techniques.