Instructional Material
Unsupervised On-line Learning of Decision Trees for Hierarchical Data Analysis
Held, Marcus, Buhmann, Joachim M.
An adaptive online algorithm is proposed to estimate hierarchical data structures for non-stationary data sources. The approach is based on the principle of minimum cross entropy to derive a decision tree for data clustering and it employs a metalearning idea (learning to learn) to adapt to changes in data characteristics. Its efficiency is demonstrated by grouping non-stationary artifical data and by hierarchical segmentation of LANDSAT images. 1 Introduction Unsupervised learning addresses the problem to detect structure inherent in unlabeled andunclassified data. N. The encoding usually is represented by an assignment matrix M (Mia), where Mia 1 if and only if Xi belongs to cluster L: 1 MiaV (Xi, Ya) measures the quality of a data partition, Le., optimal assignments and prototypes (M,y)OPt argminM,y1i (M,Y) minimize the inhomogeneity of clusters w.r.t. a given distance measure V. For reasons of simplicity we restrict the presentation to the ' sum-of-squared-error criterion V(x, y) To facilitate this minimization a deterministic annealing approach was proposed in [5] which maps the discrete optimization problem, i.e. how to determine the data assignments, viathe Maximum Entropy Principle [2] to a continuous parameter es- Unsupervised Online Learning ofDecision Trees for Data Analysis 515 timation problem.
On-line Learning from Finite Training Sets in Nonlinear Networks
Online learning is one of the most common forms of neural network training.We present an analysis of online learning from finite training sets for nonlinear networks (namely, soft-committee machines), advancingthe theory to more realistic learning scenarios. Dynamical equations are derived for an appropriate set of order parameters; these are exact in the limiting case of either linear networks or infinite training sets. Preliminary comparisons with simulations suggest that the theory captures some effects of finite training sets, but may not yet account correctly for the presence of local minima.
Report on the Seventh International Workshop on Nonmonotonic Reasoning
Brewka, Gerhard, Niemela, Ilkka
Fourth, causality is still an important issue; some formal models of causality have surprisingly close connections to standard nonmonotonic techniques. Fifth, the nonmonotonic logics being used most widely are the classical ones: default logic, circumscription, and by Isaac Levi; (3) Nonmonotonic Reasoning autoepistemic logic. Maybe the most remarkable trend he Seventh International Workshop was held in Trento, Italy, Tolerance by John McCarthy; (4) that became apparent during the on 30 May to 1 June 1998 in conjunction Learning to Make Nonmonotonic workshop was the new excitement with the Sixth International Inferences by Dan Roth; and (5) From among the participants. The depression Conference on the Principles of Features and Fluents to Thinking that plagued a number of people Knowledge Representation and Reasoning When Flying--Reasoning about in the field seems to be over. The workshop was Actions in an Intelligent UAV by Erik common feeling was that the theory sponsored by the American Association Sandewall.
Building of a Corporate Memory for Traffic-Accident Analysis
Dieng, Rose, Giboin, Alain, Amerge, Christelle, Corby, Olivier, Despres, Sylvie, Alpay, Laurence, Labidi, Sofiane, Lapalut, Stephane
This article presents an experiment of expertise capitalization in road traffic-accident analysis. We study the integration of models of expertise from different members of an organization into a coherent corporate expertise model. We present our elicitation protocol and the generic models and tools we exploited for knowledge modeling in this context of multiple experts. We compare the knowledge models obtained for seven experts in accidentology and their representation through conceptual graphs. Finally, we discuss the results of our experiment from a knowledge capitalization viewpoint.
Empirical Methods in AI
In the last few years, we have witnessed a major growth in the use of empirical methods in AI. In part, this growth has arisen from the availability of fast networked computers that allow certain problems of a practical size to be tackled for the first time. There is also a growing realization that results obtained empirically are no less valuable than theoretical results. Experiments can, for example, offer solutions to problems that have defeated a theoretical attack and provide insights that are not possible from a purely theoretical analysis. I identify some of the emerging trends in this area by describing a recent workshop that brought together researchers using empirical methods as far apart as robotics and knowledge-based systems.
The Eleventh International Workshop on Qualitative Reasoning
The Eleventh International Workshop on Qualitative Reasoning was held in Cortona, Italy, on 3 to 6 June 1997. Participants included scientists from both qualitative reasoning and quantitative mathematical modeling communities. This article summarizes the significant issues and discussion raised during the workshop.
Autonomous Agents as Synthetic Characters
Elliott, Clark, Brzezinski, Jacek
Humans are social creatures. Much of our intelligence derives from our ability to manipulate our environment through collaborative endeavors. Most extant computer programs and interfaces do little to take advantage of such manifestly human talents and interests, leaving broad avenues of human-computer communication unexplored. Although it is still considered controversial, there are many who believe the harnessing of social communication to be rich in possibilities for modern software. In this article, we look at a number of autonomous agent systems that embody their intelligence at least partially through the projection of a believable, engaging, synthetic persona. Among other topics, we touch briefly on samples of research that explore synthetic personality, representations of emotion, societies of fanciful and playful characters, intelligent and engaging automated tutors, and users projected as avatars into virtual worlds.
AAAI News
However, all eligible students are Intelligence (AAAI-98) will be Third Annual Genetic Programming encouraged to apply. After the conference, available in late March by writing to Conference (GP-98), July 22-25 an expense report will be required ncai@aaai.org Please note that the deadline Eleventh Annual Conference on scholarships@aaai.org or at 445 Burgess for early registrations is May 27, 1998. Computational Learning Theory Drive, Menlo Park, CA 94025, The conference will be held July (COLT '98), July 24-26 (theory.lcs.mit. All student scholarship recipients Monona Terrace Convention Center, Fifteenth International Conference will be required to participate in the designed by Frank Lloyd Wright, in on Machine Learning (ICML '98), July Student Volunteer Program to support Madison, Wisconsin.
Adaptive On-line Learning in Changing Environments
Murata, Noboru, Müller, Klaus-Robert, Ziehe, Andreas, Amari, Shun-ichi
An adaptive online algorithm extending the learning of learning idea is proposed and theoretically motivated. Relying only on gradient flow information it can be applied to learning continuous functions or distributions, even when no explicit loss function is given and the Hessian is not available. Its efficiency is demonstrated for a non-stationary blind separation task of acoustic signals.