Goto

Collaborating Authors

 Uncertainty


Pattern Recognition from One Example by Chopping

Neural Information Processing Systems

We investigate the learning of the appearance of an object from a single image of it. Instead of using a large number of pictures of the object to recognize, we use a labeled reference database of pictures of other objects tolearn invariance to noise and variations in pose and illumination. This acquired knowledge is then used to predict if two pictures of new objects, which do not appear on the training pictures, actually display the same object. We propose a generic scheme called chopping to address this task. It relies on hundreds of random binary splits of the training set chosen to keep together the images of any given object. Those splits are extended to the complete image space with a simple learning algorithm. Given two images, the responses of the split predictors are combined with a Bayesian rule into a posterior probability of similarity.


Bayesian models of human action understanding

Neural Information Processing Systems

We present a Bayesian framework for explaining how people reason about and predict the actions of an intentional agent, based on observing itsbehavior. Action-understanding is cast as a problem of inverting a probabilistic generative model, which assumes that agents tend to act rationally in order to achieve their goals given the constraints of their environment. Workingin a simple sprite-world domain, we show how this model can be used to infer the goal of an agent and predict how the agent will act in novel situations or when environmental constraints change. The model provides a qualitative account of several kinds of inferences that preverbal infants have been shown to perform, and also fits quantitative predictionsthat adult observers make in a new experiment.


What Do We Know about Knowledge?

AI Magazine

What Do We Know about Knowledge? In this article, I will examine the first of these questions. AI has been slow to embrace this principle. Programs demonstrating research ideas in AI are often too large and not well enough documented to allow replication or sharing. What I would like to in diverse conditions. I wish to clarify the knowledge example, it was pretty clearly articulated in Biblical principle and try to increase our understanding times: "A man of knowledge increaseth of what programmers and program strength" (Proverbs 24: 5). Greek philosophers based their lives on acquiring The "knowledge is power" principle is most and transferring knowledge. In the course closely associated with Francis Bacon, from his of teaching, they sought to understand the 1597 tract on heresies: "Nam et ipsa scientia nature of knowledge and how we can establish potestas est." ("In and of itself, knowledge is knowledge of the natural world. B," along with quantification, "All A's are B's," Euclid's geometry firmly established the concept In the intervening several centuries before Plato, Socrates's pupil and Aristotle's mentor, was the first to pose the question in writing of the Middle Ages and the rise of modern science what we mean when we say that a person in the West, He was distinguishing empirical knowledge, church to make new knowledge fit with established lacking complete certainty, from the certain dogma.


Active Learning with Multiple Views

Journal of Artificial Intelligence Research

Active learners alleviate the burden of labeling large amounts of data by detecting and asking the user to label only the most informative examples in the domain. We focus here on active learning for multi-view domains, in which there are several disjoint subsets of features (views), each of which is sufficient to learn the target concept. In this paper we make several contributions. First, we introduce Co-Testing, which is the first approach to multi-view active learning. Second, we extend the multi-view learning framework by also exploiting weak views, which are adequate only for learning a concept that is more general/specific than the target concept. Finally, we empirically show that Co-Testing outperforms existing active learners on a variety of real world domains such as wrapper induction, Web page classification, advertisement removal, and discourse tree parsing.


Solving Factored MDPs with Hybrid State and Action Variables

Journal of Artificial Intelligence Research

Efficient representations and solutions for large decision problems with continuous and discrete variables are among the most important challenges faced by the designers of automated decision support systems. In this paper, we describe a novel hybrid factored Markov decision process (MDP) model that allows for a compact representation of these problems, and a new hybrid approximate linear programming (HALP) framework that permits their efficient solutions. The central idea of HALP is to approximate the optimal value function by a linear combination of basis functions and optimize its weights by linear programming. We analyze both theoretical and computational aspects of this approach, and demonstrate its scale-up potential on several hybrid optimization problems.


Learning Sentence-internal Temporal Relations

Journal of Artificial Intelligence Research

In this paper we propose a data intensive approach for inferring sentence-internal temporal relations. Temporal inference is relevant for practical NLP applications which either extract or synthesize temporal information (e.g., summarisation, question answering). Our method bypasses the need for manual coding by exploiting the presence of markers like ``after", which overtly signal a temporal relation. We first show that models trained on main and subordinate clauses connected with a temporal marker achieve good performance on a pseudo-disambiguation task simulating temporal inference (during testing the temporal marker is treated as unseen and the models must select the right marker from a set of possible candidates). Secondly, we assess whether the proposed approach holds promise for the semi-automatic creation of temporal annotations. Specifically, we use a model trained on noisy and approximate data (i.e., main and subordinate clauses) to predict intra-sentential relations present in TimeBank, a corpus annotated rich temporal information. Our experiments compare and contrast several probabilistic models differing in their feature space, linguistic assumptions and data requirements. We evaluate performance against gold standard corpora and also against human subjects.


Generative Prior Knowledge for Discriminative Classification

Journal of Artificial Intelligence Research

We present a novel framework for integrating prior knowledge into discriminative classifiers. Our framework allows discriminative classifiers such as Support Vector Machines (SVMs) to utilize prior knowledge specified in the generative setting. The dual objective of fitting the data and respecting prior knowledge is formulated as a bilevel program, which is solved (approximately) via iterative application of second-order cone programming. To test our approach, we consider the problem of using WordNet (a semantic database of English language) to improve low-sample classification accuracy of newsgroup categorization. WordNet is viewed as an approximate, but readily available source of background knowledge, and our framework is capable of utilizing it in a flexible way.


A Variational Inference Procedure Allowing Internal Structure for Overlapping Clusters and Deterministic Constraints

Journal of Artificial Intelligence Research

We develop a novel algorithm, called VIP*, for structured variational approximate inference. This algorithm extends known algorithms to allow efficient multiple potential updates for overlapping clusters, and overcomes the difficulties imposed by deterministic constraints. The algorithm's convergence is proven and its applicability demonstrated for genetic linkage analysis.


Intelligent Multiobjective Optimization of Distribution System Operations

AI Magazine

A hybrid fuzzy knowledge-based system with crisp and fuzzy rules as well as numerical methods was developed for multiobjective optimization of power distribution system operation. The development process and knowledge-acquisition process for the fuzzy knowledge-based system are described in detail. After a heuristic preprocessor proposes a list of switch openings that would seem to reduce system losses, network radiality rules consider whether to open a particular switch and find a corresponding switch that can be closed to maintain radiality. Network performance rules find the degree of desirability of proposed switching combinations for enhancing multiple objectives.


Intelligent Multiobjective Optimization of Distribution System Operations

AI Magazine

Also, it provides a means for conflict resolution of multiple criteria and better assessment of options. This system provides identification, recognition, optimization, a very powerful solution methodology by permitting and control. The algorithmic methods optimization of power distribution system provide updates to the system status operation (Sarfi and Solo 2005a). Sarfi, Salama, and Chikhani (1994a) as well as system with a coupling between knowledgebased Sarfi and Solo (2002c) demonstrate that fuzzy and numerical methods combines the logic is not an asset in all power systems planning advantages of both methods for multiobjective and operation scenarios. Some rules do optimization of power distribution system not involve any uncertainty or can be represented operation. One must to ensure that the best methods are employed. An extensive study of software effectively optimizes a power distribution network tools used in real-time power system for multiple system-performance objectives, applications concluded that electric utility including system loss reduction, transformer companies were not satisfied with conventional load balancing, reduction of transformer approaches based on numerical methods in aging to decrease the failure rate and 50 percent of the cases examined (Sarfi, Salama, increase continuity of service, maintenance of and Chikhani 1994a). Dissatisfied parties a satisfactory voltage profile throughout the cited two major shortcomings in techniques network, reactive power compensation, and based on numerical methods: (1) lack of flexibility conservative voltage reduction (CVR) practice in system modeling, and (2) exclusion of to achieve peak shaving.