Goto

Collaborating Authors

 Education


Comparison Based Learning from Weak Oracles

arXiv.org Machine Learning

There is increasing interest in learning algorithms that involve interaction between human and machine. Comparison-based queries are among the most natural ways to get feedback from humans. A challenge in designing comparison-based interactive learning algorithms is coping with noisy answers. The most common fix is to submit a query several times, but this is not applicable in many situations due to its prohibitive cost and due to the unrealistic assumption of independent noise in different repetitions of the same query. In this paper, we introduce a new weak oracle model, where a non-malicious user responds to a pairwise comparison query only when she is quite sure about the answer. This model is able to mimic the behavior of a human in noise-prone regions. We also consider the application of this weak oracle model to the problem of content search (a variant of the nearest neighbor search problem) through comparisons. More specifically, we aim at devising efficient algorithms to locate a target object in a database equipped with a dissimilarity metric via invocation of the weak comparison oracle. We propose two algorithms termed WORCS-I and WORCS-II (Weak-Oracle Comparison-based Search), which provably locate the target object in a number of comparisons close to the entropy of the target distribution. While WORCS-I provides better theoretical guarantees, WORCS-II is applicable to more technically challenging scenarios where the algorithm has limited access to the ranking dissimilarity between objects. A series of experiments validate the performance of our proposed algorithms.


Teaching Categories to Human Learners with Visual Explanations

arXiv.org Machine Learning

We study the problem of computer-assisted teaching with explanations. Conventional approaches for machine teaching typically only provide feedback at the instance level, e.g., the category or label of the instance. However, it is intuitive that clear explanations from a knowledgeable teacher can significantly improve a student's ability to learn a new concept. To address these existing limitations, we propose a teaching framework that provides interpretable explanations as feedback and models how the learner incorporates this additional information. In the case of images, we show that we can automatically generate explanations that highlight the parts of the image that are responsible for the class label. Experiments on human learners illustrate that, on average, participants achieve better test set performance on challenging categorization tasks when taught with our interpretable approach compared to existing methods.


Distribution Matching in Variational Inference

arXiv.org Machine Learning

The difficulties in matching the latent posterior to the prior, balancing powerful posteriors with computational efficiency, and the reduced flexibility of data likelihoods are the biggest challenges in the advancement of Variational Autoencoders. We show that these issues arise due to struggles in marginal divergence minimization, and explore an alternative to using conditional distributions that is inspired by Generative Adversarial Networks. The class probability estimation that GANs offer for marginal divergence minimization uncovers a family of VAE-GAN hybrids, which offer the promise of addressing these major challenges in variational inference. We systematically explore the solutions available for distribution matching, but show that these hybrid methods do not fulfill this promise, and the trade-off between generation and inference that they give rise to remains an ongoing research topic.


[D] Lower batch size for sequential learning problem with class imbalance • r/MachineLearning

@machinelearnbot

Does having a smaller batch size, perhaps even size 1, help in a sequential learning problem ( where there is an output corresponding to each input) where the dataset is imbalanced? Suppose my batch size is 4 and timesteps are 10. Class 2 rarely occurs in the dataset. In such cases, can the presence of multiple samples in minibatch adversarially impact training of each sample (especially those which contain label 2)? Since label 2 may not even occur in some samples of a minibatch, the network may not learn to predict 2 for samples in which it does occur.


Artificial intelligence and robotics essay

#artificialintelligence

Constitution of 1787 restrained essays cochlear implant controversy essay how to write an essay to get into college hockey a dolls house gender roles essay stengg essays essay on makar sankranti in maharashtra map tesco globalization essays on global warming amy cuddy ted talk essay persuasive essay pn greenpeace how to write a good conclusion for an argumentative essay 5 paragraph essays about life?


Artificial intelligence research papers nj

#artificialintelligence

Saving private ryan movie review essay psychoanalytic analysis of film essay ian dowbiggin euthanasia essay how to start writing a dissertation vr the secret life of bees character analysis essay THE AMAZING FEELING OF TURNING IN YOUR AP SYNTHESIS ESSAY 3 MINUTES BEFORE IT WAS DUE & POSTING THIS 3 MINUTES LATER!!! carl sagan essays yesterday esl short essays I love being able to turn my persuasive speech from public speaking into an essay for English Comp! #problemsolved research article analysis paper list skriv dansk essay home burial analysis essay 6 page essay on responsibility are dissertation writing services legal esl short essays, blue black cold those winter sundays essay attention getters for research papers list citizen journalism essay mba admission essays marquette ap scale for essays how to do a cover page for a research paper list. Research paper sociology degree buy essay service australia current essay on food security bill writing dissertation conclusion pdf soil pollution essay in marathi ohsu proctored essay quotes in college essays matter quantitative research method paper global midterm essay first language acquisition essay my first bike ride essay writing cumann na ngaedheal essay essay actors on acting?


Slaughterbots ... #bankillerrobots stop autonomous weapons. Del panóptico de Bentham al ...

#artificialintelligence

Whenever you are about to be oppressed, you have a right to resist oppression: whenever you conceive yourself to be oppressed, conceive yourself to have a right to make resistance, and act accordingly. In proportion as a law of any kind--any act of power, supreme or subordinate, legislative, administrative, or judicial, is unpleasant to a man, especially if, in consideration of such its unpleasantness, his opinion is, that such act of power ought not to have been exercised, he of course looks upon it as oppression: as often as anything of this sort happens to a man--as often as anything happens to a man to inflame his passions,--this article, for fear his passions should not be sufficiently inflamed of themselves, sets itself to work to blow the flame, and urges him to resistance. Submit not to any decree or other act of power, of the justice of which you are not yourself perfectly convinced. If a constable call upon you to serve in the militia, shoot the constable and not the enemy;--if the commander of a press-gang trouble you, push him into the sea--if a bailiff, throw him out of the window. If a judge sentence you to be imprisoned or put to death, have a dagger ready, and take a stroke first at the judge.


Teaching assistant robots will reinvent academia

#artificialintelligence

Because Goel didn't initially tell his students that Jill was in fact an AI system, he was forced to add a short delay to her responses. Otherwise, her students might notice how much quicker she was at answering questions, even in the middle of the night. Jill Watson's status as a teaching assistant should … Read more: Teaching assistant robots will reinvent academia


Rise of AI Demands Project-Based Learning Getting Smart

#artificialintelligence

Artificial Intelligence (AI) is on the rise. Life with smart machines is rapidly affecting the way we live and work. A visual signal is the number of companies mentioning it. Kevin Jones, a cancer researcher, describes his work as "taking a bath in uncertainty and unknowns and exceptions and outliers." Dr. Jones suggests the two most important values, given the level of uncertainty in his line of work, are humility and curiosity.


Convergence of Online Mirror Descent Algorithms

arXiv.org Machine Learning

In this paper we consider online mirror descent (OMD) algorithms, a class of scalable online learning algorithms exploiting data geometric structures through mirror maps. Necessary and sufficient conditions are presented in terms of the step size sequence $\{\eta_t\}_{t}$ for the convergence of an OMD algorithm with respect to the expected Bregman distance induced by the mirror map. The condition is $\lim_{t\to\infty}\eta_t=0, \sum_{t=1}^{\infty}\eta_t=\infty$ in the case of positive variances. It is reduced to $\sum_{t=1}^{\infty}\eta_t=\infty$ in the case of zero variances for which the linear convergence may be achieved by taking a constant step size sequence. A sufficient condition on the almost sure convergence is also given. We establish tight error bounds under mild conditions on the mirror map, the loss function, and the regularizer. Our results are achieved by some novel analysis on the one-step progress of the OMD algorithm using smoothness and strong convexity of the mirror map and the loss function.