Asia
On a Modification to the Mean Field EM Algorithm in Factorial Learning
Dunmur, A. P., Titterington, D. M.
A modification is described to the use of mean field approximations inthe E step of EM algorithms for analysing data from latent structure models, as described by Ghahramani (1995), among others. Themodification involves second-order Taylor approximations to expectations computed in the E step. The potential benefits of the method are illustrated using very simple latent profile models. 1 Introduction Ghahramani (1995) advocated the use of mean field methods as a means to avoid the heavy computation involved in the E step of the EM algorithm used for estimating parameters within a certain latent structure model, and Ghahramani & Jordan (1995) used the same ideas in a more complex situation. Dunmur & Titterington (1996a) identified Ghahramani's model as a so-called latent profile model, they observed that Zhang (1992,1993) had used mean field methods for a similar purpose, and they showed, in a simulation study based on very simple examples, that the mean field version of the EM algorithm often performed very respectably. By this it is meant that, when data were generated from the model under analysis, the estimators of the underlying parameters were efficient, judging by empirical results, especially in comparison with estimators obtained by employing the'correct' EM algorithm: the examples therefore had to be simple enough that the correct EM algorithm is numerically feasible, although any success reported for the mean field 432 A. P. Dunmur and D. M. Titterington version is, one hopes, an indication that the method will also be adequate in more complex situations in which the correct EM algorithm is not implementable because of computational complexity. In spite of the above positive remarks, there were circumstances in which there was a perceptible, if not dramatic, lack of efficiency in the simple (naive) mean field estimators, and the objective of this contribution is to propose and investigate ways of refining the method so as to improve performance without detracting from the appealing, and frequently essential, simplicity of the approach. The procedure used here is based on a second order correction to the naive mean field well known in statistical physics and sometimes called the cavity or TAP method (Mezard, Parisi & Virasoro, 1987). It has been applied recently in cluster analysis (Hofmann & Buhmann, 1996). In Section 2 we introduce the structure of our model, Section 3 explains the refined mean field approach, Section 4 provides numerical results, and Section 5 contains a statement of our conclusions.
Learning Appearance Based Models: Mixtures of Second Moment Experts
Bregler, Christoph, Malik, Jitendra
This paper describes a new technique for object recognition based on learning appearance models. The image is decomposed into local regions which are described by a new texture representation called "Generalized Second Moments" thatare derived from the output of multiscale, multiorientation filter banks. Class-characteristic local texture features and their global composition is learned by a hierarchical mixture of experts architecture (Jordan & Jacobs). The technique is applied to a vehicle database consisting of 5 general car categories (Sedan, Van with backdoors, Van without backdoors, old Sedan, and Volkswagen Bug). This is a difficult problem with considerable in-class variation. The new technique has a 6.5% misclassification rate, compared to eigen-images which give 17.4% misclassification rate, and nearest neighbors which give 15 .7%
ICMAS '96: Norms, Obligations, and Conventions
In adjacent agents from dropping their commitments; (held in Kyoto, Japan, on 10-13 December domains (logical philosophy, social or better, how to regulate 1996). Both the program committee philosophy, decision theory), both legal agents dropping their commitments and the contributors included and social norms have received to a joint action to not disrupt the scientists from different backgrounds considerable, if not satisfactory, attention. The discussion addressed on, has contributed dramatically to These tasks have now entered the several issues: (1) What is the the attention given by the scientific MAS field's common knowledge. Often action is reduced to decision authorization, access regulation, For example, the existence of so-called (that is, a choice among one's privacy maintenance, respect of decency, Georgeff 1991) have shown that we and Tennenholtz 1992). Why? Don't we need a reciprocity.
Dynamic Non-Bayesian Decision Making
The model of a non-Bayesian agent who faces a repeated game with incomplete information against Nature is an appropriate tool for modeling general agent-environment interactions. In such a model the environment state (controlled by Nature) may change arbitrarily, and the feedback/reward function is initially unknown. The agent is not Bayesian, that is he does not form a prior probability neither on the state selection strategy of Nature, nor on his reward function. A policy for the agent is a function which assigns an action to every history of observations and actions. Two basic feedback structures are considered. In one of them -- the perfect monitoring case -- the agent is able to observe the previous environment state as part of his feedback, while in the other -- the imperfect monitoring case -- all that is available to the agent is the reward obtained. Both of these settings refer to partially observable processes, where the current environment state is unknown. Our main result refers to the competitive ratio criterion in the perfect monitoring case. We prove the existence of an efficient stochastic policy that ensures that the competitive ratio is obtained at almost all stages with an arbitrarily high probability, where efficiency is measured in terms of rate of convergence. It is further shown that such an optimal policy does not exist in the imperfect monitoring case. Moreover, it is proved that in the perfect monitoring case there does not exist a deterministic policy that satisfies our long run optimality criterion. In addition, we discuss the maxmin criterion and prove that a deterministic efficient optimal strategy does exist in the imperfect monitoring case under this criterion. Finally we show that our approach to long-run optimality can be viewed as qualitative, which distinguishes it from previous work in this area.
Worldwide Perspectives and Trends in Expert Systems: An Analysis Based on the Three World Congresses on Expert Systems
Some people believe that the expert system field is dead, yet others believe it is alive and well. To gain a better insight into these possible views, the first three world congresses on expert systems (which typically attract representatives from some 45-50 countries) are used to determine the health of the global expert system field in terms of applied technologies, applications, and management. This article highlights some of these findings.
Flaw Selection Strategies for Partial-Order Planning
Pollack, M. E., Joslin, D., Paolucci, M.
Several recent studies have compared the relative efficiency of alternative flaw selection strategies for partial-order causal link (POCL) planning. We review this literature, and present new experimental results that generalize the earlier work and explain some of the discrepancies in it. In particular, we describe the Least-Cost Flaw Repair (LCFR) strategy developed and analyzed by Joslin and Pollack (1994), and compare it with other strategies, including Gerevini and Schubert's (1996) ZLIFO strategy. LCFR and ZLIFO make very different, and apparently conflicting claims about the most effective way to reduce search-space size in POCL planning. We resolve this conflict, arguing that much of the benefit that Gerevini and Schubert ascribe to the LIFO component of their ZLIFO strategy is better attributed to other causes. We show that for many problems, a strategy that combines least-cost flaw selection with the delay of separable threats will be effective in reducing search-space size, and will do so without excessive computational overhead. Although such a strategy thus provides a good default, we also show that certain domain characteristics may reduce its effectiveness.
A Complete Classification of Tractability in RCC-5
We investigate the computational properties of the spatial algebra RCC-5 which is a restricted version of the RCC framework for spatial reasoning. The satisfiability problem for RCC-5 is known to be NP-complete but not much is known about its approximately four billion subclasses. We provide a complete classification of satisfiability for all these subclasses into polynomial and NP-complete respectively. In the process, we identify all maximal tractable subalgebras which are four in total.
The Fourth International Workshop on Artificial Intelligence in Economics and Management
Y. Reich (Tel-Aviv University) proposed The paper by M. Benaroch (Syracuse University) suggested the use of knowledge-based tools for mass customization of service products; it dealt in general Grundstein (Framatome, France) reported than the other methods. At the macroeconomic and J. Zahavi (both of Tel-Aviv University) level, Deinichenko et al. presented found that genetic algorithms an expert system that utilizes performed even better than a fuzzy knowledge to analyze economic on Artificial Intelligence linear programming model on their Thus, their conclusion was Academy of Sciences) and T. Szapiro (AIEM4) was held in Tel-Aviv, that AI techniques might provide (Warsaw School of Economics) noted Israel, from 8 to 10 January 1996, better results than rigid analytic the lack of models appropriate to the with participants from 13 countries. Service to customers in the financial for discerning patterns in the economic As a matter of course, almost every area was another focus of the and demographic data of developing presentation at the workshop workshop. Lange et al. described a economies. The paper by touched on AI techniques in one way system for customizing investment Edmonds and S. Moss (Manchester or another.
RoboCup: A Challenge Problem for AI
Kitano, Hiroaki, Asada, Minoru, Kuniyoshi, Yasuo, Noda, Itsuki, Osawa, Eiichi, Matsubara, Hitoshi
Although RoboCup's primary objective is a Although RoboCup's final target is a world For the Although it is obvious that building a robot robot (physical robot and software agent) to to play a soccer game is an immense challenge, play a soccer game reasonably well, a wide readers might wonder why we propose range of technologies need to be integrated, RoboCup. It is our intention to use RoboCup and numbers of technical breakthroughs as a vehicle to revitalize AI research by offering must be accomplished. When the accomplishment intelligent robotics, and sensor fusion. of such a goal has significant social The first RoboCup, RoboCup-97, will be held impact, it is considered a grand-challenge during the Fifteenth International Joint Conference project (Kitano et al. 1993). Building a robot on Artificial Intelligence (IJCAI-97) in to play a soccer game itself does not generate Nagoya, Japan, as part of IJCAI-97's special significant social and economic impact, but Accessibility Complete Incomplete and architectures can be evaluated. Computer Sensor Readings Symbolic Nonsymbolic chess is a typical example of the standard Control Central Distributed problem. Various search algorithms were evaluated and developed using this domain. With the recent accomplishment by the Deep Blue team, which beat Kasparov, a human grand Table 1. A major reason for the success of computer chess as a standard problem is that the evaluation of the accomplishment will certainly be considered the progress was clearly defined.