Goto

Collaborating Authors

 Education


Semi-Unsupervised Lifelong Learning for Sentiment Classification: Less Manual Data Annotation and More Self-Studying

arXiv.org Artificial Intelligence

Lifelong machine learning is a novel machine learning paradigm which can continually accumulate knowledge during learning. The knowledge extracting and reusing abilities enable the lifelong machine learning to solve the related problems. The traditional approaches like Na\"ive Bayes and some neural network based approaches only aim to achieve the best performance upon a single task. Unlike them, the lifelong machine learning in this paper focuses on how to accumulate knowledge during learning and leverage them for further tasks. Meanwhile, the demand for labelled data for training also is significantly decreased with the knowledge reusing. This paper suggests that the aim of the lifelong learning is to use less labelled data and computational cost to achieve the performance as well as or even better than the supervised learning.


Learning by Active Nonlinear Diffusion

arXiv.org Machine Learning

This article proposes an active learning method for high dimensional data, based on intrinsic data geometries learned through diffusion processes on graphs. Diffusion distances are used to parametrize low-dimensional structures on the dataset, which allow for high-accuracy labelings of the dataset with only a small number of carefully chosen labels. The geometric structure of the data suggests regions that have homogeneous labels, as well as regions with high label complexity that should be queried for labels. The proposed method enjoys theoretical performance guarantees on a general geometric data model, in which clusters corresponding to semantically meaningful classes are permitted to have nonlinear geometries, high ambient dimensionality, and suffer from significant noise and outlier corruption. The proposed algorithm is implemented in a manner that is quasilinear in the number of unlabeled data points, and exhibits competitive empirical performance on synthetic datasets and real hyperspectral remote sensing images.


Towards Finding Longer Proofs

arXiv.org Artificial Intelligence

We present a reinforcement learning (RL) based guidance system for automated theorem proving geared towards Finding Longer Proofs (FLoP). FLoP focuses on generalizing from short proofs to longer ones of similar structure. To achieve that, FLoP uses state-of-the-art RL approaches that were previously not applied in theorem proving. In particular, we show that curriculum learning significantly outperforms previous learning-based proof guidance on a synthetic dataset of increasingly difficult arithmetic problems.


Natural language processing explained

#artificialintelligence

Me: Alexa please remind me my morning yoga sculpt class is at 5:30am. Alexa: I have added Tequila to your shopping list. We talk to our devices, and sometimes they recognize what we are saying correctly. We use free services to translate foreign language phrases encountered online into English, and sometimes they give us an accurate translation. Although natural language processing has been improving by leaps and bounds, it still has considerable room for improvement.


Reinvention in the age of AI - IoT Agenda

#artificialintelligence

In the economic game of survival of the fittest, reinvention is a constant theme. Where would Samsung be today if it still sold dried fish? For example, Uber is often mentioned as an example of an industry disruptor that displaced jobs for incumbent taxi drivers. However, a recent analysis of Uber's impact on U.S. cities showed that Uber not only increased the number of jobs for drivers by 50% on average, but the wages for Uber drivers were about 10% higher. The same is true for technological progress -- while it does disrupt the way things were done in the past, it also opens the door for new opportunities and skills.


No time like the present: how AI is transforming HR today - IBM UK

#artificialintelligence

Welcome to our HR Modernization Playbook: Tomorrow's people โ€“ Why HR matters more than ever in the age of artificial intelligence. Digital transformation is happening faster than ever. The adoption of artificial intelligence (AI) and automation will redefine jobs, enhance employee productivity and accelerate workforce development. In fact, skills and culture โ€“ not technology โ€“ are the biggest barriers to business growth in the AI era. This means CEOs are looking to their CHRO to lead culture change, manage talent and drive down costs.


This AI Uses Echolocation to Identify What You're Doing

#artificialintelligence

He and his colleagues have built a device, about the size of a thin laptop, that emits sound at frequencies 10 times higher than the shrillest note a piccolo can sustain. The pitches it produces are inaudible to the human ear. When Guo's team aims the device at a person and fires an ultrasonic pitch, the gadget listens for the echo using its hundreds of embedded microphones. Then, employing artificial intelligence techniques, his team tries to decipher what the person is doing from the reflected sound alone. The technology is still in its infancy, but they've achieved some promising initial results.


Microsoft's new language learning app uses your phone's camera and computer vision to teach vocabulary โ€“ TechCrunch

#artificialintelligence

Eight Microsoft interns have developed a new language learning tool that uses the smartphone camera to help adults improve their English literacy by learning the words for the things around them. The app, Read My World, lets you take a picture with your phone to learn from a library of more than 1,500 words. The photo can be of a real-world object or text found in a document, Microsoft says. The app is meant to either supplement formal classroom training or offer a way to learn some words for those who didn't have the time or funds to participate in a language learning class. Instead of lessons, users are encouraged to snap photos of the things they encounter in their everyday lives.


Don't Forget Your Teacher: A Corrective Reinforcement Learning Framework

arXiv.org Artificial Intelligence

Although reinforcement learning (RL) can provide reliable solutions in many settings, practitioners are often wary of the discrepancies between the RL solution and their status quo procedures. Therefore, they may be reluctant to adapt to the novel way of executing tasks proposed by RL. On the other hand, many real-world problems require relatively small adjustments from the status quo policies to achieve improved performance. Therefore, we propose a student-teacher RL mechanism in which the RL (the "student") learns to maximize its reward, subject to a constraint that bounds the difference between the RL policy and the "teacher" policy. The teacher can be another RL policy (e.g., trained under a slightly different setting), the status quo policy, or any other exogenous policy. We formulate this problem using a stochastic optimization model and solve it using a primal-dual policy gradient algorithm. We prove that the policy is asymptotically optimal. However, a naive implementation suffers from high variance and convergence to a stochastic optimal policy. With a few practical adjustments to address these issues, our numerical experiments confirm the effectiveness of our proposed method in multiple GridWorld scenarios.


Matrix-Free Preconditioning in Online Learning

arXiv.org Machine Learning

We provide an online convex optimization algorithm with regret that interpolates between the regret of an algorithm using an optimal preconditioning matrix and one using a diagonal preconditioning matrix. Our regret bound is never worse than that obtained by diagonal preconditioning, and in certain setting even surpasses that of algorithms with full-matrix preconditioning. Importantly, our algorithm runs in the same time and space complexity as online gradient descent. Along the way we incorporate new techniques that mildly streamline and improve logarithmic factors in prior regret analyses. We conclude by benchmarking our algorithm on synthetic data and deep learning tasks.