Goto

Collaborating Authors

 Deep Learning


3 Ways Baidu Is Harnessing AI to Power Its Business -- The Motley Fool

#artificialintelligence

How important is artificial intelligence (AI) to Baidu (NASDAQ:BIDU)? Gone is the era of PC, and soon will we say goodbye to the era of mobile internet ... We believe that coming is the era of artificial intelligence. Andrew Ng, Baidu's chief scientist, has some experience in this area. During his previous tenure at Google parent Alphabet, he led the Google Brain AI project. He is also an adjunct professor at Stanford University, where he taught AI.


Notes for deep learning on NLP

#artificialintelligence

Deep learning gradually plays a major role on NLP (Natural Language Processing). Here I note some technical evolution for the NLP problems. A continuous text sequence "to be or not to be" can be modelled by: N-gram model can solve the problem of next word prediction, e.g., the occurrence of 6-gram model can predict the probability of next word is "be" if the previous words are "to be or not to": With neural network, the idea is proposed to train a shared matrix C which can project each word into a feature vector, and put the vector as the input of a neural network to train the main task. Suppose the dimension of feature space is M, and vocabluary is V, the projection C is a V *M matrix. The input layer contains N-1 previous words in a N-gram model, which is encoded by 1-to- V representation.


15 Disruptive Technology Trends to watch in 2017 - Disruption

#artificialintelligence

That company, the'secretive' Magic Leap has yet to showcase any of the Mixed Reality platform it is working on, but in the meantime Microsoft has opened up it's MR platform for developers and we expect to see some fruit in 2017. Self teaching Robots have been one of the breakthroughs of 2016 as we have seen more examples of bot to bot communication in which one machine shares its learning with another, and deep learning based networks which robots can tap into and teach themselves.


Machine Learning & Artificial Intelligence: Main Developments in 2016 and Key Trends in 2017

#artificialintelligence

At KDnuggets, we try to keep our finger on the pulse of main events and developments in industry, academia, and technology. We also do our best to look forward to key trends on the horizon. We recently asked some of the leading experts in Big Data, Data Science, Artificial Intelligence, and Machine Learning for their opinion on the most important developments of 2016 and key trends they 2017. "What were the main Artificial Intelligence/Machine Learning related events in 2016 and what key trends do you see in 2017?" Common themes include the triumphs of deep neural networks, reinforcement learning's successes, AlphaGo as exemplar of the power of both of these phenomena in unison, the application of machine learning to the Internet of Things, self-driving vehicles, and automation, among others. We generally asked participants to keep their responses to within 100 words or so, but were amenable to longer answers if the situation warranted.


The Machines are Coming: China's role in the future of artificial intelligence

#artificialintelligence

Try typing "the machines" into Google and chances are that one of the top results the artificial intelligence-powered search engine will return is the phrase: "The Machines are Coming". After a 2016 filled with high-profile advances in artificial intelligence (AI), leading technologists say this could be a breakout year in the development of intelligent machines that emulate humans. Asia, until now lagging Silicon Valley in AI, will play a bigger role as the field cements itself at the pinnacle of the technology world in 2017, the experts say. AI – technically, a computing field that involves the analysis of large troves of data to predict outcomes and patterns – is as old as modern computers but its esoteric nature means it has long endured caricatures of its actual potential – think for example, the 1960s space age cartoon The Jetsons, which featured a sentient robot maid and automated flying cars (both of which we are still waiting for, even 50 years on). Now, a confluence of factors has given rise to hopes that computers with human-like cognitive ability may soon be a reality.


Deep Learning in a Nutshell: Core Concepts

#artificialintelligence

This post is the first in a series I'll be writing for Parallel Forall that aims to provide an intuitive and gentle introduction to deep learning. It covers the most important deep learning concepts and aims to provide an understanding of each concept rather than its mathematical and theoretical details. While the mathematical terminology is sometimes necessary and can further understanding, these posts use analogies and images whenever possible to provide easily digestible bits comprising an intuitive overview of the field of deep learning. I wrote this series in a glossary style so it can also be used as a reference for deep learning concepts. Part 1 focuses on introducing the main concepts of deep learning. Part 2 provides historical background and delves into the training procedures, algorithms and practical tricks that are used in training for deep learning. Part 3 covers sequence learning, including recurrent neural networks, LSTMs, and encoder-decoder systems for neural machine translation.


7 Steps to Understanding Computer Vision

#artificialintelligence

If We Want Machines to Think, We Need to Teach Them to See. Learning and computation provides machine the ability to better understand the context of images and build visual systems which truly understand intelligence. The huge amount of image and video content urges the scientific community to make sense and identify patterns amongst it to reveal details which we aren't aware of. Computer Vision generates mathematical models from images; Computer Graphics draws in images from models and lastly image processing takes image as an input and gives an image at the output. Computer Vision is an overlapping field drawing on concepts from areas such as artificial intelligence, digital image processing, machine learning, deep learning, pattern recognition, probabilistic graphical models, scientific computing and a lot of mathematics.


FinTech @CloudExpo #AI #ML #DL #FinTech #Blockchain #MachineLearning

#artificialintelligence

Financial Technology - or FinTech - Is Now Part of the @CloudExpo Program! Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech, which will incorporate machine learning, artificial intelligence, deep learning, and blockchain into one track. Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expensive intermediate processes from their businesses. FinTech brings efficiency as well as the ability to deliver new services and a much improved customer experience throughout the global financial services industry. FinTech is a natural fit with cloud computing, as new services are quickly developed, deployed, and scaled on public, private, and hybrid clouds.


Direct Feedback Alignment Provides Learning in Deep Neural Networks

Neural Information Processing Systems

Artificial neural networks are most commonly trained with the back-propagation algorithm, where the gradient for learning is provided by back-propagating the error, layer by layer, from the output layer to the hidden layers. A recently discovered method called feedback-alignment shows that the weights used for propagating the error backward don't have to be symmetric with the weights used for propagation the activation forward. In fact, random feedback weights work evenly well, because the network learns how to make the feedback useful. In this work, the feedback alignment principle is used for training hidden layers more independently from the rest of the network, and from a zero initial condition. The error is propagated through fixed random feedback connections directly from the output layer to each hidden layer. This simple method is able to achieve zero training error even in convolutional networks and very deep networks, completely without error back-propagation. The method is a step towards biologically plausible machine learning because the error signal is almost local, and no symmetric or reciprocal weights are required. Experiments show that the test performance on MNIST and CIFAR is almost as good as those obtained with back-propagation for fully connected networks. If combined with dropout, the method achieves 1.45% error on the permutation invariant MNIST task.


Deep Neural Networks with Inexact Matching for Person Re-Identification

Neural Information Processing Systems

Person Re-Identification is the task of matching images of a person across multiple camera views. Almost all prior approaches address this challenge by attempting to learn the possible transformations that relate the different views of a person from a training corpora. Then, they utilize these transformation patterns for matching a query image to those in a gallery image bank at test time. This necessitates learning good feature representations of the images and having a robust feature matching technique. Deep learning approaches, such as Convolutional Neural Networks (CNN), simultaneously do both and have shown great promise recently. In this work, we propose two CNN-based architectures for Person Re-Identification. In the first, given a pair of images, we extract feature maps from these images via multiple stages of convolution and pooling. A novel inexact matching technique then matches pixels in the first representation with those of the second. Furthermore, we search across a wider region in the second representation for matching. Our novel matching technique allows us to tackle the challenges posed by large viewpoint variations, illumination changes or partial occlusions. Our approach shows a promising performance and requires only about half the parameters as a current state-of-the-art technique. Nonetheless, it also suffers from false matches at times. In order to mitigate this issue, we propose a fused architecture that combines our inexact matching pipeline with a state-of-the-art exact matching technique. We observe substantial gains with the fused model over the current state-of-the-art on multiple challenging datasets of varying sizes, with gains of up to about 21%.