Goto

Collaborating Authors

 Inductive Learning


Equalizing Financial Impact in Supervised Learning

arXiv.org Machine Learning

Machine learning is revolutionizing the way we interact with the world. Popular websites use algorithms to analyze user data and recommend videos, customize social media feeds, and optimize advertisements. Unsurprisingly, machine learning is taking a large role in making decisions about human beings, ranging from credit to parole decisions, and is likely to be more and more widely used in the future. It is not hard to imagine that, even in cases where the final decisions are made by people, they will be doing so with advice from algorithms that make inferences from patterns in petabytes of data. Some proponents of machine learning have suggested that not only are these algorithms able to leverage the increasing amount of data we have access to, but also that they might be able to make these decisions more fairly, as they seem to not be subject to human biases. There is some truth to these claims.


Learning Instance Segmentation by Interaction

arXiv.org Artificial Intelligence

We present an approach for building an active agent that learns to segment its visual observations into individual objects by interacting with its environment in a completely self-supervised manner. The agent uses its current segmentation model to infer pixels that constitute objects and refines the segmentation model by interacting with these pixels. The model learned from over 50K interactions generalizes to novel objects and backgrounds. To deal with noisy training signal for segmenting objects obtained by self-supervised interactions, we propose robust set loss. A dataset of robot's interactions along-with a few human labeled examples is provided as a benchmark for future research. We test the utility of the learned segmentation model by providing results on a downstream vision-based control task of rearranging multiple objects into target configurations from visual inputs alone. Videos, code, and robotic interaction dataset are available at https://pathak22.


Unsupervised Imitation Learning

arXiv.org Machine Learning

We introduce a novel method to learn a policy from unsupervised demonstrations of a process. Given a model of the system and a set of sequences of outputs, we find a policy that has a comparable performance to the original policy, without requiring access to the inputs of these demonstrations. We do so by first estimating the inputs of the system from observed unsupervised demonstrations. Then, we learn a policy by applying vanilla supervised learning algorithms to the (estimated)input-output pairs. For the input estimation, we present a new adaptive linear estimator (AdaL-IE) that explicitly trades-off variance and bias in the estimation. As we show empirically, AdaL-IE produces estimates with lower error compared to the state-of-the-art input estimation method, (UMV-IE) [Gillijns and De Moor, 2007]. Using AdaL-IE in conjunction with imitation learning enables us to successfully learn control policies that consistently outperform those using UMV-IE.


Report on FBI Actions in Clinton Email Case Set for Release

U.S. News

FILE - In this April 6, 2017, file photo, former Secretary of State Hillary Clinton speaks in New York. The Justice Department's internal watchdog is expected to criticize the FBI's handling of the Clinton email investigation, stepping into a political minefield as it details how a determinedly non-partisan law enforcement agency came to be entangled in the 2016 presidential race. President Donald Trump will look to the inspector general report to provide a fresh line of attack against the FBI's two former top officials, Director James Comey and his deputy, Andrew McCabe, as he claims that a politically tainted bureau tried to undermine his campaign and, through the Russia investigation, his presidency.


Sparse Stochastic Zeroth-Order Optimization with an Application to Bandit Structured Prediction

arXiv.org Machine Learning

Stochastic zeroth-order (SZO), or gradient-free, optimization allows to optimize arbitrary functions by relying only on function evaluations under parameter perturbations, however, the iteration complexity of SZO methods suffers a factor proportional to the dimensionality of the perturbed function. We show that in scenarios with natural sparsity patterns as in structured prediction applications, this factor can be reduced to the expected number of active features over input-output pairs. We give a general proof that applies sparse SZO optimization to Lipschitz-continuous, nonconvex, stochastic objectives, and present an experimental evaluation on linear bandit structured prediction tasks with sparse word-based feature representations that confirm our theoretical results.


A One-Sided Classification Toolkit with Applications in the Analysis of Spectroscopy Data

arXiv.org Machine Learning

This dissertation investigates the use of one-sided classification algorithms in the application of separating hazardous chlorinated solvents from other materials, based on their Raman spectra. The experimentation is carried out using a new one-sided classification toolkit that was designed and developed from the ground up. In the one-sided classification paradigm, the objective is to separate elements of the target class from all outliers. These one-sided classifiers are generally chosen, in practice, when there is a deficiency of some sort in the training examples. Sometimes outlier examples can be rare, expensive to label, or even entirely absent. However, this author would like to note that they can be equally applicable when outlier examples are plentiful but nonetheless not statistically representative of the complete outlier concept. It is this scenario that is explicitly dealt with in this research work. In these circumstances, one-sided classifiers have been found to be more robust that conventional multi-class classifiers. The term "unexpected" outliers is introduced to represent outlier examples, encountered in the test set, that have been taken from a different distribution to the training set examples. These are examples that are a result of an inadequate representation of all possible outliers in the training set. It can often be impossible to fully characterise outlier examples given the fact that they can represent the immeasurable quantity of "everything else" that is not a target. The findings from this research have shown the potential drawbacks of using conventional multi-class classification algorithms when the test data come from a completely different distribution to that of the training samples.


World record set for largest skinny dip on Co Wicklow beach

BBC News

More than 2,500 women have stripped naked on a beach in the Republic of Ireland to break the world record for the largest skinny dip.


Localized Structured Prediction

arXiv.org Machine Learning

Key to structured prediction is exploiting the problem structure to simplify the learning process. A major challenge arises when data exhibit a local structure (e.g., are made by "parts") that can be leveraged to better approximate the relation between (parts of) the input and (parts of) the output. Recent literature on signal processing, and in particular computer vision, has shown that capturing these aspects is indeed essential to achieve state-of-the-art performance. While such algorithms are typically derived on a case-by-case basis, in this work we propose the first theoretical framework to deal with part-based data from a general perspective. We derive a novel approach to deal with these problems and study its generalization properties within the setting of statistical learning theory. Our analysis is novel in that it explicitly quantifies the benefits of leveraging the part-based structure of the problem with respect to the learning rates of the proposed estimator.


AI (I): Machine learning

#artificialintelligence

Machine learning provides de foundation for artificial intelligence. Machine learning is a technique in which we train a software model using data. The model learns from the training cases and then, we can use the trained model to make predictions for new data cases. To have a computer make intelligent predictions from the data, we just need a way to train it to perform the correct calculations. We usually start with a data set that contains historical records, often called cases or observations.


Explaining supervised learning to a kid (or your boss)

#artificialintelligence

Now that you know what machine learning is, let's meet the easiest kind. My goal here is to get humans of all stripes and (almost) all ages comfy with its basic jargon: instance, label, feature, model, algorithm, and supervised learning. Instances are also called'examples' or'observations.' What do these examples look like when we put them in a table? Sticking with convention (because good manners are good), each row is an instance.