Genre
Becoming More Robust to Label Noise with Classifier Diversity
Smith, Michael R., Martinez, Tony
It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A biased measure may work well on certain data sets, but it can also be less effective on a broader set of data sets. In this paper, we present noise identification using classifier diversity (NICD) -- a method for deriving a less biased noise measurement and integrating it into the learning process. To lessen the bias of the noise measure, NICD selects a diverse set of classifiers (based on their predictions of novel instances) to determine which instances are noisy. We examine NICD as a technique for filtering, instance weighting, and selecting the base classifiers of a voting ensemble. We compare NICD with several other noise handling techniques that do not consider classifier diversity on a set of 54 data sets and 5 learning algorithms. NICD significantly increases the classification accuracy over the other considered approaches and is effective across a broad set of data sets and learning algorithms.
The SAT-UNSAT transition in the adversarial SAT problem
Bardoscia, Marco, Nagaj, Daniel, Scardicchio, Antonello
The study of random ensembles of decision problems has grown into a fertile field of investigation where the methods of statistical Physics have found applications to the theory (and practice) of hard combinatorial problems. This resulted in a wealth of intuition on the nature of the typical complexity of hard decision problems and in a new, efficient family of algorithms [1, 2]. One such problem is a random ensemble of satisfiability (in short SAT), where boolean formulas are generated in a random way and tested for a solution. If the formula is restricted to be of the form of a conjunction of an arbitrary number of clauses, and each clause is the logical disjunction of K variables, the problem is denoted by K-SAT. The ensemble is determined once the number of clauses per variable is fixed. As this ratio is increased the formulas go from being typically satisfiable to being typically unsatisfiable [2-4]. This is the SAT-UNSAT phase transition. Recent progress in the study of quantum decision problems [5] lead to the definition of the quantum generalisation of K-SAT (we call it K-QSAT) [6].
Active Learning for Autonomous Intelligent Agents: Exploration, Curiosity, and Interaction
Lopes, Manuel, Montesano, Luis
In this survey we present different approaches that allow an intelligent agent to explore autonomous its environment to gather information and learn multiple tasks. Different communities proposed different solutions, that are in many cases, similar and/or complementary. These solutions include active learning, exploration/exploitation, online-learning and social learning. The common aspect of all these approaches is that it is the agent to selects and decides what information to gather next. Applications for these approaches already include tutoring systems, autonomous grasping learning, navigation and mapping and human-robot interaction. We discuss how these approaches are related, explaining their similarities and their differences in terms of problem assumptions and metrics of success. We consider that such an integrated discussion will improve inter-disciplinary research and applications.
An Introduction to Constraint-Based Temporal Reasoning
Bartk, Roman, Morris, Robert A., Venable, K. Brent
Solving challenging computational problems involving time has been a critical component in the development of artificial intelligence systems almost since the inception of the field. This book provides a concise introduction to the core computational elements of temporal reasoning for use in AI systems for planning and scheduling, as well as systems that extract temporal information from data. It presents a survey of temporal frameworks based on constraints, both qualitative and quantitative, as well as of major temporal consistency techniques. The book also introduces the reader to more recent extensions to the core model that allow AI systems to explicitly represent temporal preferences and temporal uncertainty. This book is intended for students and researchers interested in constraint-based temporal reasoning.
Collaborative Filtering with Information-Rich and Information-Sparse Entities
Zhu, Kai, Wu, Rui, Ying, Lei, Srikant, R.
In this paper, we consider a popular model for collaborative filtering in recommender systems where some users of a website rate some items, such as movies, and the goal is to recover the ratings of some or all of the unrated items of each user. In particular, we consider both the clustering model, where only users (or items) are clustered, and the co-clustering model, where both users and items are clustered, and further, we assume that some users rate many items (information-rich users) and some users rate only a few items (information-sparse users). When users (or items) are clustered, our algorithm can recover the rating matrix with $\omega(MK \log M)$ noisy entries while $MK$ entries are necessary, where $K$ is the number of clusters and $M$ is the number of items. In the case of co-clustering, we prove that $K^2$ entries are necessary for recovering the rating matrix, and our algorithm achieves this lower bound within a logarithmic factor when $K$ is sufficiently large. We compare our algorithms with a well-known algorithms called alternating minimization (AM), and a similarity score-based algorithm known as the popularity-among-friends (PAF) algorithm by applying all three to the MovieLens and Netflix data sets. Our co-clustering algorithm and AM have similar overall error rates when recovering the rating matrix, both of which are lower than the error rate under PAF. But more importantly, the error rate of our co-clustering algorithm is significantly lower than AM and PAF in the scenarios of interest in recommender systems: when recommending a few items to each user or when recommending items to users who only rated a few items (these users are the majority of the total user population). The performance difference increases even more when noise is added to the datasets.
New Perspectives on k-Support and Cluster Norms
McDonald, Andrew M., Pontil, Massimiliano, Stamos, Dimitris
The norm is obtained by taking an infimum of certain quadratic functions, which are parameterized by a set ฮ . By varying the set, the regularizer can be tailored to assumptions on the underlying model, which should lead to more accurate learning. The norm is defined for w R d, as โ w โ ฮ inf ฮธ ฮ d i 1 w 2 i ฮธ i (1) where ฮ is a convex bounded subset of the positive orthant. This family is sufficiently rich to encompasses standard regularizers such as the p norms [Micchelli and Pontil, 2005] for p [1, 2], the group Lasso Y uan and Lin [2006], Group Lasso with Overlap [Jacob et al., 2009b], the norm in [Jacob et al., 2009a], and the structured sparsity norms of [Micchelli et al., 2013]. Our work builds upon a recent line of papers which considered convex regularizers defined as an infimum problem over a parametric family of quadratics, as well as related infimal convolution problems [see Jacob et al., 2009b, Maurer and Pontil, 2012, Obozinski and Bach, 2012, and references therein].
Retrieval of Experiments with Sequential Dirichlet Process Mixtures in Model Space
Dutta, Ritabrata, Seth, Sohan, Kaski, Samuel
We address the problem of retrieving relevant experiments given a query experiment, motivated by the public databases of datasets in molecular biology and other experimental sciences, and the need of scientists to relate to earlier work on the level of actual measurement data. Since experiments are inherently noisy and databases ever accumulating, we argue that a retrieval engine should possess two particular characteristics. First, it should compare models learnt from the experiments rather than the raw measurements themselves: this allows incorporating experiment-specific prior knowledge to suppress noise effects and focus on what is important. Second, it should be updated sequentially from newly published experiments, without explicitly storing either the measurements or the models, which is critical for saving storage space and protecting data privacy: this promotes life long learning. We formulate the retrieval as a ``supermodelling'' problem, of sequentially learning a model of the set of posterior distributions, represented as sets of MCMC samples, and suggest the use of Particle-Learning-based sequential Dirichlet process mixture (DPM) for this purpose. The relevance measure for retrieval is derived from the supermodel through the mixture representation. We demonstrate the performance of the proposed retrieval method on simulated data and molecular biological experiments.
Nonlinear hyperspectral unmixing with robust nonnegative matrix factorization
Fรฉvotte, Cรฉdric, Dobigeon, Nicolas
Abstract--This paper introduces a robust mixing model to describe hyperspectral data resulting from the mixture of several pure spectral signatures. This new model not only generalizes the commonly used linear mixing model, but also allows for possible nonlinear effects to be easily handled, relying on mild assumptions regarding these nonlinearities. The standard nonnegativity and sum-to-one constraints inherent to spectral unmixing are coupled with a group-sparse constraint imposed on the nonlinearity component. The data fidelity term is expressed as a ฮฒ -divergence, a continuous family of dissimilarity measures that takes the squared Euclidean distance and the generalized Kullback-Leibler divergence as special cases. The penalized objective is minimized with a block-coordinate descent that involves majorization-minimization updates. Simulation results obtained on synthetic and real data show that the proposed strategy competes with state-of-the-art linear and nonlinear unmixing methods. Spectral unmixing (SU) is an issue of prime interest when analyzing hyperspectral data since it provides a comprehensive and meaningful description of the collected measurements in various application fields including remote sensing [1], planetology [2], food monitoring [3] or spectro-microscopy [4]. Most of the hyperspectral unmixing algorithms proposed in the signal & image processing and geoscience literatures rely on the commonly admitted linear mixing model (LMM),Y MA . Indeed, LMM provides a good approximation of the physical process underlying the observations and has resulted in interesting results for most applications. However, for several specific applications, LMM may be inaccurate and other nonlinear models need to be advocated [7]. For instance, in remotely sensed images composed of vegetation (e.g., trees), interactions of photons with multiple components of the scene lead to nonlinear effects that can be taken into account N. Dobigeon is with University of Toulouse, IRIT/INP-ENSEEIHT, 2 rue Camichel, BP 7122, 31071 Toulouse cedex 7, France.
Design a Persian Automated Plagiarism Detector (AMZPPD)
Mahmoodi, Maryam, Varnamkhasti, Mohammad Mahmoodi
Currently there are lots of plagiarism detection approaches. But few of them implemented and adapted for Persian languages. In this paper, our work on designing and implementation of a plagiarism detection system based on pre-processing and NLP technics will be described. And the results of testing on a corpus will be presented.
Approximation Models of Combat in StarCraft 2
Helmke, Ian, Kreymer, Daniel, Wiegand, Karl
Real-time strategy (RTS) games make heavy use of artificial intelligence (AI), especially in the design of computerized opponents. Because of the computational complexity involved in managing all aspects of these games, many AI opponents are designed to optimize only a few areas of playing style. In games like StarCraft 2, a very popular and recently released RTS, most AI strategies revolve around economic and building efficiency: AI opponents try to gather and spend all resources as quickly and effectively as possible while ensuring that no units are idle. The aim of this work was to help address the need for AI combat strategies that are not computationally intensive. Our goal was to produce a computationally efficient model that is accurate at predicting the results of complex battles between diverse armies, including which army will win and how many units will remain. Our results suggest it may be possible to develop a relatively simple approximation model of combat that can accurately predict many battles that do not involve micromanagement. Future designs of AI opponents may be able to incorporate such an approximation model into their decision and planning systems to provide a challenge that is strategically balanced across all aspects of play.