Genre
Geometric Enclosing Networks
Le, Trung, Vu, Hung, Nguyen, Tu Dinh, Phung, Dinh
Training model to generate data has increasingly attracted research attention and become important in modern world applications. We propose in this paper a new geometry-based optimization approach to address this problem. Orthogonal to current state-of-the-art density-based approaches, most notably VAE and GAN, we present a fresh new idea that borrows the principle of minimal enclosing ball to train a generator G\left(\bz\right) in such a way that both training and generated data, after being mapped to the feature space, are enclosed in the same sphere. We develop theory to guarantee that the mapping is bijective so that its inverse from feature space to data space results in expressive nonlinear contours to describe the data manifold, hence ensuring data generated are also lying on the data manifold learned from training data. Our model enjoys a nice geometric interpretation, hence termed Geometric Enclosing Networks (GEN), and possesses some key advantages over its rivals, namely simple and easy-to-control optimization formulation, avoidance of mode collapsing and efficiently learn data manifold representation in a completely unsupervised manner. We conducted extensive experiments on synthesis and real-world datasets to illustrate the behaviors, strength and weakness of our proposed GEN, in particular its ability to handle multi-modal data and quality of generated data.
Deep Transfer Learning with Joint Adaptation Networks
Long, Mingsheng, Zhu, Han, Wang, Jianmin, Jordan, Michael I.
Deep networks have been successfully applied to learn transferable features for adapting models from a source domain to a different target domain. In this paper, we present joint adaptation networks (JAN), which learn a transfer network by aligning the joint distributions of multiple domain-specific layers across domains based on a joint maximum mean discrepancy (JMMD) criterion. Adversarial training strategy is adopted to maximize JMMD such that the distributions of the source and target domains are made more distinguishable. Learning can be performed by stochastic gradient descent with the gradients computed by back-propagation in linear-time. Experiments testify that our model yields state of the art results on standard datasets.
A Review of Methodologies for Natural-Language-Facilitated Human-Robot Cooperation
Natural-language-facilitated human-robot cooperation (NLC) refers to using natural language (NL) to facilitate interactive information sharing and task executions with a common goal constraint between robots and humans. Recently, NLC research has received increasing attention. Typical NLC scenarios include robotic daily assistance, robotic health caregiving, intelligent manufacturing, autonomous navigation, and robot social accompany. However, a thorough review, that can reveal latest methodologies to use NL to facilitate human-robot cooperation, is missing. In this review, a comprehensive summary about methodologies for NLC is presented. NLC research includes three main research focuses: NL instruction understanding, NL-based execution plan generation, and knowledge-world mapping. In-depth analyses on theoretical methods, applications, and model advantages and disadvantages are made. Based on our paper review and perspective, potential research directions of NLC are summarized.
Imposing higher-level Structure in Polyphonic Music Generation using Convolutional Restricted Boltzmann Machines and Constraints
Lattner, Stefan, Grachten, Maarten, Widmer, Gerhard
Since computers can automate such processes, automatic music generation has become a small, but steadily emerging field in Artificial Intelligence and Machine Learning. Nevertheless, automatic music generation as a problem is far from solved: musical outputs created by artificial systems are regarded as a curiosity by human listeners at best, but all too often they are taken as a direct offense to our sense of musical aesthetics. This sensitivity to violations of even the most subtle musical norms illustrates how complex the problem of (especially polyphonic) music generation is. In addition, there are hardly any objective evaluation criteria to rigorously test and compare music generation systems. This is lamentable, not least since successful methods for automatic music generation would be of considerable commercial interest to the music, gaming, and film industries.
A Deep Learning Approach for Joint Video Frame and Reward Prediction in Atari Games
Leibfried, Felix, Kushman, Nate, Hofmann, Katja
Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model-free and learn to act effectively across a wide range of environments such as Atari games, but require huge amounts of data. Model-based techniques are more data-efficient, but need to acquire explicit knowledge about the environment. In this paper, we take a step towards using model-based techniques in environments with a high-dimensional visual state space by demonstrating that it is possible to learn system dynamics and the reward structure jointly. Our contribution is to extend a recently developed deep neural network for video frame prediction in Atari games to enable reward prediction as well. To this end, we phrase a joint optimization problem for minimizing both video frame and reward reconstruction loss, and adapt network parameters accordingly. Empirical evaluations on five Atari games demonstrate accurate cumulative reward prediction of up to 200 frames. We consider these results as opening up important directions for model-based reinforcement learning in complex, initially unknown environments.
Learning to Perform Physics Experiments via Deep Reinforcement Learning
Denil, Misha, Agrawal, Pulkit, Kulkarni, Tejas D, Erez, Tom, Battaglia, Peter, de Freitas, Nando
When encountering novel objects, humans are able to infer a wide range of physical properties such as mass, friction and deformability by interacting with them in a goal driven way. This process of active interaction is in the same spirit as a scientist performing experiments to discover hidden facts. Recent advances in artificial intelligence have yielded machines that can achieve superhuman performance in Go, Atari, natural language processing, and complex control problems; however, it is not clear that these systems can rival the scientific intuition of even a young child. In this work we introduce a basic set of tasks that require agents to estimate properties such as mass and cohesion of objects in an interactive simulated environment where they can manipulate the objects and observe the consequences. We found that deep reinforcement learning methods can learn to perform the experiments necessary to discover such hidden properties. By systematically manipulating the problem difficulty and the cost incurred by the agent for performing experiments, we found that agents learn different strategies that balance the cost of gathering information against the cost of making mistakes in different situations. We also compare our learned experimentation policies to randomized baselines and show that the learned policies lead to better predictions.
Machine Learning: Classification Coursera
About this course: Case Studies: Analyzing Sentiment & Loan Default Prediction In our case study on analyzing sentiment, you will create models that predict a class (positive/negative sentiment) from input features (text of the reviews, user profile information,...). In our second case study for this course, loan default prediction, you will tackle financial data, and predict when a loan is likely to be risky or safe for the bank. These tasks are an examples of classification, one of the most widely used areas of machine learning, with a broad array of applications, including ad targeting, spam detection, medical diagnosis and image classification. In this course, you will create classifiers that provide state-of-the-art performance on a variety of tasks. You will become familiar with the most successful techniques, which are most widely used in practice, including logistic regression, decision trees and boosting.
Teens engage in risky behavior to learn about the world
A new study suggests that the risk-taking behavior common among teenagers is often guided by the desire to learn about the world. This is contrary to a previous theory that argued that teenage risk-taking behavior is due to a brain deficit resulting in impulsive behavior. Teenagers have a heightened attraction to new and exciting experiences, and researchers argue that teens who show this tendency alone aren't necessarily more likely to suffer from health issues like substance abuse. A new study suggests that the risk-taking behavior that teenagers engage in is often guided by the desire to learn about the world. A new study suggests that the risk-taking behavior that teenagers engage in is often guided by the desire to learn about the world.
Mastercard Enhances Artificial Intelligence Capability with the Acquisition of Brighterion, Inc.
This acquisition will further expand its suite of capabilities that deliver an enhanced customer experience and security. Artificial intelligence plays a critical role in enabling consumer convenience, while delivering enhanced security. This advanced technology delivers greater insights from every transaction to assist in making even more accurate fraud decisions. "To fully realize the promise of our increasingly digital lives, we need to design our payment systems with the future in mind and that's what we're doing," said Ajay Bhalla, president of enterprise risk and security for Mastercard. "Our unprecedented use of artificial intelligence on our network is already proving successful. With the acquisition of Brighterion, we will further extend our capabilities to support the consumer experience."
โFrankensteinโ dino discovery
The legendary Bigfoot is often described as the "missing link" between apes and man, but the Chilesaurus has an edge on Bigfoot: it is the missing link between herbivore dinosaurs and their carnivorous brethren. In a new study done by the University of Cambridge, Chilesaurus, which lived 150 million years ago, scientists now believe the dinosaur is an early member of the "Ornithischia," a "bird-hipped" group that includes dinosaurs such as the Stegosaurus and Iguanadon. Researchers found that the Chilesaurus has the same inverted hip structure of the Ornithischia group, which aids in complex digestive systems. But it also lacks the beak Ornithischia dinosaurs used for eating. "Chilesaurus almost looks like it was stitched together from different animals, which is why it baffled everybody," said Matthew Baron, a doctoral student in Cambridge University's Department of Earth Sciences and the paper's joint first author, in a statement.