Many successful applications of computer vision to image or video manipulation are interactive by nature. However, parameters of such systems are often trained neglecting the user. Traditionally, interactive systems have been treated in the same manner as their fully automatic counterparts. Their performance is evaluated by computing the accuracy of their solutions under some fixed set of user interactions. This paper proposes a new evaluation and learning method which brings the user in the loop. It is based on the use of an active robot user - a simulated model of a human user. We show how this approach can be used to evaluate and learn parameters of state-of-the-art interactive segmentation systems. We also show how simulated user models can be integrated into the popular max-margin method for parameter learning and propose an algorithm to solve the resulting optimisation problem.

Understanding predator-prey relationships among insects is a challenging task in the domain of insect-colony research. This is due to several factors involved, such as determining whether a particular behavior is the result of a predator-prey interaction, a friend-foe interaction or another kind of interaction. In this paper, we analyze a series of predator-prey and friend-foe interactions in two colonies of carpenter ants to better understand and predict such behavior. Using the data gathered, we have also come up with a preliminary model for predicting such behavior under the specific conditions the experiment was conducted in. In this paper, we present the results of our data analysis as well as an overview of the processes involved.

The art of solving the Mastermind puzzle was initiated by Donald Knuth and is already more than 30 years old; despite that, it still receives much attention in operational research and computer games journals, not to mention the nature-inspired stochastic algorithm literature. In this paper we try to suggest a strategy that will allow nature-inspired algorithms to obtain results as good as those based on exhaustive search strategies; in order to do that, we first review, compare and improve current approaches to solving the puzzle; then we test one of these strategies with an estimation of distribution algorithm. Finally, we try to find a strategy that falls short of being exhaustive, and is then amenable for inclusion in nature inspired algorithms (such as evolutionary or particle swarm algorithms). This paper proves that by the incorporation of local entropy into the fitness function of the evolutionary algorithm it becomes a better player than a random one, and gives a rule of thumb on how to incorporate the best heuristic strategies to evolutionary algorithms without incurring in an excessive computational cost.

After building a classifier with modern tools of machine learning we typically have a black box at hand that is able to predict well for unseen data. Thus, we get an answer to the question what is the most likely label of a given unseen data point. However, most methods will provide no answer why the model predicted the particular label for a single instance and what features were most influential for that particular instance. The only method that is currently able to provide such explanations are decision trees. This paper proposes a procedure which (based on a set of assumptions) allows to explain the decisions of any classification method.

Slow feature analysis (SFA) is a method for extracting slowly varying features from a quickly varying multidimensional signal. An open source Matlab-implementation sfa-tk makes SFA easily useable. We show here that under certain circumstances, namely when the covariance matrix of the nonlinearly expanded data does not have full rank, this implementation runs into numerical instabilities. We propse a modified algorithm based on singular value decomposition (SVD) which is free of those instabilities even in the case where the rank of the matrix is only less than 10% of its size. Furthermore we show that an alternative way of handling the numerical problems is to inject a small amount of noise into the multidimensional input signal which can restore a rank-deficient covariance matrix to full rank, however at the price of modifying the original data and the need for noise parameter tuning.

Logics of knowledge based on possible-world semantics are u seful in many areas of knowledge representation and reasoning, ranging from security t o distributed computing to game theory. In these models, an agent is said to know a fact ϕ if ϕ is true in all the worlds she considers possible. While reasoning about knowledge with t his semantics has proved useful, as is well known, it suffers from what is known in the literature as the logical omniscience problem: under possible-world semantics, agents know all t autologies and know the logical consequences of their knowledge. While logical omniscience is certainly not always an issue, in many applications it is. For example, in the context of distributed computing, we are interested in polynomial-time algorithms, although in some cases the knowledge needed to p erform optimally may require calculations that cannot be performed in polynomial time (u nless P=NP) [Moses and Tuttle 1988]; in the context of security, we may want to reason about computationally bounded adversaries who cannot factor a large composite number, and thus cannot be logically omniscient; in game theory, we may be interested in the impac t of computational resources on solution concepts (for example, what will agents do if com puting a Nash equilibrium is difficult). Not surprisingly, many approaches for dealing with the logi cal omniscience problem have been suggested (see [Fagin, Halpern, Moses, and Vardi 1 995, Chapter 9] and [Moreno 1998]).

The present paper investigates consequence relations that are both non-monotonic and paraconsistent. More precisely, we put the focus on preferential consequence relations, i.e. those relations that can be defined by a binary preference relation on states labelled by valuations. We worked with a general notion of valuation that covers e.g. the classical valuations as well as certain kinds of many-valued valuations. In the many-valued cases, preferential consequence relations are paraconsistant (in addition to be non-monotonic), i.e. they are capable of drawing reasonable conclusions which contain contradictions. The first purpose of this paper is to provide in our general framework syntactic characterizations of several families of preferential relations. The second and main purpose is to provide, again in our general framework, characterizations of several families of preferential discriminative consequence relations. They are defined exactly as the plain version, but any conclusion such that its negation is also a conclusion is rejected (these relations bring something new essentially in the many-valued cases).

The on-line shortest path problem is considered under various mode ls of partial monitoring. Given a weighted directed acyclic graph whose edge weights can c hange in an arbitrary (adversarial) way, a decision maker has to choose in each round of a game a path between two distinguished vertices such that the loss of the chosen path (defin ed as the sum of the weights of its composing edges) be as small as possible. In a setting generalizing the multi-armed bandit problem, after choosing a path, the decision maker learns only the w eights of those edges that belong to the chosen path. For this problem, an algorithm is given who se average cumulative loss in n rounds exceeds that of the best path, matched off-line to the ent ire sequence of the edge weights, by a quantity that is proportional to 1 / n and depends only polynomially on the number of edges of the graph. The algorithm can be implemented with linear complexity in the number of rounds n and in the number of edges. An extension to the so-called label efficie nt setting is also given, in which the decision maker is informed about the w eights of the edges corresponding to the chosen path at a total of m n time instances. Another extension is shown where the decision maker competes against a time-varying pa th, a generalization of the problem of tracking the best expert. A version of the multi-armed b andit setting for shortest path is also discussed where the decision maker learns only the total weight of the chosen path but not the weights of the individual edges on the path. Applications to routing in packet switched networks along with simulation results are also presented.

The models of statistical physics used to study collective phenomena in some interdisciplinary contexts, such as social dynamics and opinion spreading, do not consider the effects of the memory on individual decision processes. On the contrary, in the Naming Game, a recently proposed model of Language formation, each agent chooses a particular state, or opinion, by means of a memory-based negotiation process, during which a variable number of states is collected and kept in memory. In this perspective, the statistical features of the number of states collected by the agents becomes a relevant quantity to understand the dynamics of the model, and the influence of topological properties on memory-based models. By means of a master equation approach, we analyze the internal agent dynamics of Naming Game in populations embedded on networks, finding that it strongly depends on very general topological properties of the system (e.g. average and fluctuations of the degree). However, the influence of topological properties on the microscopic individual dynamics is a general phenomenon that should characterize all those social interactions that can be modeled by memory-based negotiation processes.

Some alternatives to probability in the literature include sets of probability measure [Huber 1981; Walley 1991], Dempster-Shafer belief functions [Shafer 1976] and the closely related nonadditive measures [Schmeidler 1989], and possibility measures [Dubois and Prade 1990]. In this paper, we consider the notion of expectation for all these representations of uncertainty. We do not take a stand here on what the "right" way is to represent uncertainty; we simply investigate characterizations of expectation and reasoning about expectation, both for probability and for other representations of uncertainty. It is well known that a probability measure determines a unique expectation function that is linear (i.e., E (aX + bY) = aE (X) + bE (Y)), monotone (i.e., X Y implies E ( X) E (Y)), and maps constant functions to their value. Conversely, given an expectation function E (that is, a function from random variables to the reals) that is linear, monotone, and maps constant functions to their value, there is a unique probability measure µ such that E = E µ. That is, there is a 1-1 mapping from probability measures to (probabilistic) expectation functions. One of the goals of this paper is to provide similar characterizations of expectation for other representations of uncertainty. Some work along these lines has already been done, particulary with regard to sets of probability measures [Huber 1981; Walley 1991; 1981]. 1 However, there seems to be surprisingly little work on characterizing expectation in the context of other measures of uncertainty, such as belief functions [Shafer 1976] and possibility measures [Dubois and Prade 1990].