Goto

Collaborating Authors

 Oceania



Perseus: Randomized Point-based Value Iteration for POMDPs

Journal of Artificial Intelligence Research

Partially observable Markov decision processes (POMDPs) form an attractive and principled framework for agent planning under uncertainty. Point-based approximate techniques for POMDPs compute a policy based on a finite set of points collected in advance from the agent's belief space. We present a randomized point-based value iteration algorithm called Perseus. The algorithm performs approximate value backup stages, ensuring that in each backup stage the value of each point in the belief set is improved; the key observation is that a single backup may improve the value of many belief points. Contrary to other point-based methods, Perseus backs up only a (randomly selected) subset of points in the belief set, sufficient for improving the value of each belief point in the set. We show how the same idea can be extended to dealing with continuous action spaces. Experimental results show the potential of Perseus in large scale POMDP problems.


Solving Set Constraint Satisfaction Problems using ROBDDs

Journal of Artificial Intelligence Research

In this paper we present a new approach to modeling finite set domain constraint problems using Reduced Ordered Binary Decision Diagrams (ROBDDs). We show that it is possible to construct an efficient set domain propagator which compactly represents many set domains and set constraints using ROBDDs. We demonstrate that the ROBDD-based approach provides unprecedented flexibility in modeling constraint satisfaction problems, leading to performance improvements. We also show that the ROBDD-based modeling approach can be extended to the modeling of integer and multiset constraint problems in a straightforward manner. Since domain propagation is not always practical, we also show how to incorporate less strict consistency notions into the ROBDD framework, such as set bounds, cardinality bounds and lexicographic bounds consistency. Finally, we present experimental results that demonstrate the ROBDD-based solver performs better than various more conventional constraint solvers on several standard set constraint problems.


Calendar of Events

AI Magazine

(EDOC 2005). Moscow State University, Russia, King's Email: patrick.hung@uoit.ca In cooperation with the American Association for Artificial Intelligence General Chairs The 19th International FLAIRS Conference (FLAIRS 2006) will be held May 11-13 Philip Chan, Debasis Mitra 2006, in Melbourne Beach, Florida, USA. Coast" (centered around NASA's Kennedy Space Center), and has easy access to Florida Institute of Technology Orlando and the Disney World attractions. Submission of papers for presentation at the conference is now invited.


RoboCup 2004 Competitions and Symposium: A Small Kick for Robots, a Giant Score for Science

AI Magazine

RoboCup is an international initiative with the main goals of fostering research and education in artificial intelligence and robotics, as well as of promoting science and technology to world citizens. The idea behind RoboCup is to provide a standard problem for which a wide range of technologies can be integrated and examined, as well as being used for project-oriented education, and to organize annual events open to the general public, at which different solutions to the problem are compared. The eighth annual RoboCup -- RoboCup 2004 -- was held in Lisbon, Portugal, from 27 June to 5 July. In this article, a general description of RoboCup 2004 is presented, including summaries concerning teams, participants, distribution into leagues, main research advances, as well as detailed descriptions for each league.


Keys, Nominals, and Concrete Domains

Journal of Artificial Intelligence Research

Many description logics (DLs) combine knowledge representation on an abstract, logical level with an interface to 'concrete' domains like numbers and strings with built-in predicates such as >, +, and prefix-of. These hybrid DLs have turned out to be useful in several application areas, such as reasoning about conceptual database models. We propose to further extend such DLs with key constraints that allow the expression of statements like 'US citizens are uniquely identified by their social security number'. Based on this idea, we introduce a number of natural description logics and perform a detailed analysis of their decidability and computational complexity. It turns out that naive extensions with key constraints easily lead to undecidability, whereas more careful extensions yield NExpTime-complete DLs for a variety of useful concrete domains.


Application of SVMs for Colour Classification and Collision Detection with AIBO Robots

Neural Information Processing Systems

This article addresses the issues of colour classification and collision detection asthey occur in the legged league robot soccer environment of RoboCup. We show how the method of one-class classification with support vectormachines (SVMs) can be applied to solve these tasks satisfactorily usingthe limited hardware capacity of the prescribed Sony AIBO quadruped robots. The experimental evaluation shows an improvement over our previous methods of ellipse fitting for colour classification and the statistical approach used for collision detection.


Bounded Finite State Controllers

Neural Information Processing Systems

We describe a new approximation algorithm for solving partially observable MDPs. Our bounded policy iteration approach searches through the space of bounded-size, stochastic finite state controllers, combining several advantages of gradient ascent (efficiency, search through restricted controller space) and policy iteration (less vulnerability to local optima).


Application of SVMs for Colour Classification and Collision Detection with AIBO Robots

Neural Information Processing Systems

This article addresses the issues of colour classification and collision detection as they occur in the legged league robot soccer environment of RoboCup. We show how the method of one-class classification with support vector machines (SVMs) can be applied to solve these tasks satisfactorily using the limited hardware capacity of the prescribed Sony AIBO quadruped robots. The experimental evaluation shows an improvement over our previous methods of ellipse fitting for colour classification and the statistical approach used for collision detection.


Laplace Propagation

Neural Information Processing Systems

We present a novel method for approximate inference in Bayesian models and regularized risk functionals. It is based on the propagation of mean and variance derived from the Laplace approximation of conditional probabilities in factorizing distributions, much akin to Minka's Expectation Propagation. In the jointly normal case, it coincides with the latter and belief propagation, whereas in the general case, it provides an optimization strategy containing Support Vector chunking, the Bayes Committee Machine, and Gaussian Process chunking as special cases.