Education
The Error Coding and Substitution PaCTs
A new class of plug in classification techniques have recently been developed inthe statistics and machine learning literature. A plug in classification technique(PaCT) is a method that takes a standard classifier (such as LDA or TREES) and plugs it into an algorithm to produce a new classifier. The standard classifier is known as the Plug in Classifier (PiC).These methods often produce large improvements over using a single classifier. In this paper we investigate one of these methods and give some motivation for its success.
Unsupervised On-line Learning of Decision Trees for Hierarchical Data Analysis
Held, Marcus, Buhmann, Joachim M.
An adaptive online algorithm is proposed to estimate hierarchical data structures for non-stationary data sources. The approach is based on the principle of minimum cross entropy to derive a decision tree for data clustering and it employs a metalearning idea (learning to learn) to adapt to changes in data characteristics. Its efficiency is demonstrated by grouping non-stationary artifical data and by hierarchical segmentation of LANDSAT images. 1 Introduction Unsupervised learning addresses the problem to detect structure inherent in unlabeled andunclassified data. N. The encoding usually is represented by an assignment matrix M (Mia), where Mia 1 if and only if Xi belongs to cluster L: 1 MiaV (Xi, Ya) measures the quality of a data partition, Le., optimal assignments and prototypes (M,y)OPt argminM,y1i (M,Y) minimize the inhomogeneity of clusters w.r.t. a given distance measure V. For reasons of simplicity we restrict the presentation to the ' sum-of-squared-error criterion V(x, y) To facilitate this minimization a deterministic annealing approach was proposed in [5] which maps the discrete optimization problem, i.e. how to determine the data assignments, viathe Maximum Entropy Principle [2] to a continuous parameter es- Unsupervised Online Learning ofDecision Trees for Data Analysis 515 timation problem.
On-line Learning from Finite Training Sets in Nonlinear Networks
Online learning is one of the most common forms of neural network training.We present an analysis of online learning from finite training sets for nonlinear networks (namely, soft-committee machines), advancingthe theory to more realistic learning scenarios. Dynamical equations are derived for an appropriate set of order parameters; these are exact in the limiting case of either linear networks or infinite training sets. Preliminary comparisons with simulations suggest that the theory captures some effects of finite training sets, but may not yet account correctly for the presence of local minima.
Learning Human-like Knowledge by Singular Value Decomposition: A Progress Report
Landauer, Thomas K., Laham, Darrell, Foltz, Peter W.
Singular value decomposition (SVD) can be viewed as a method for unsupervised training of a network that associates two classes of events reciprocally by linear connections through a single hidden layer. SVD was used to learn and represent relations among very large numbers of words (20k-60k) and very large numbers of natural text passages (lk-70k) in which they occurred. The result was 100-350 dimensional "semantic spaces" in which any trained or newly aibl word or passage could be represented as a vector, and similarities were measured by the cosine of the contained angle between vectors. Good accmacy in simulating human judgments and behaviors has been demonstrated by performance on multiple-choice vocabulary and domain knowledge tests, emulation of expert essay evaluations, and in several other ways. Examples are also given of how the kind of knowledge extracted by this method can be applied.
The 1997 AAAI Mobile Robot Competition and Exhibition
In July 1997, the Sixth Annual Association for the Advancement of Artificial Intelligence (AAAI) Mobile Robot Competition and Exhibition was held. The competition consisted of four new events: (1) Find Life on Mars; (2) Find the Remote; (3) Home Vacuum; and (4) Hors d'Oeuvres, Anyone? The robot exhibition was the largest in AAAI history. This article presents the history, motivation, and contributions for the event.
The 1997 AAAI Fall Symposia
Traum, David, Iwanska, Lucja, Redfield, Carol Luckhardt, Nayak, P. Pandurang, Williams, Brian C., Anderson, Michael, Dautenhahn, Kerstin
The Association for the Advancement of Artificial Intelligence held its 1997 Fall Symposia Series on 7 to 9 November in Cambridge, Massachusetts. This article contains summaries of the six symposia that were conducted: (1) Communicative Action in Humans and Machines, (2) Context in Knowledge Representation and Natural Language, (3) Intelligent Tutoring System Authoring Tools, (4) Model-Directed Autonomous Systems, (5) Reasoning with Diagrammatic Representations II, and (6) Socially Intelligent Agents.
The 1997 AAAI Fall Symposia
Traum, David, Iwanska, Lucja, Redfield, Carol Luckhardt, Nayak, P. Pandurang, Williams, Brian C., Anderson, Michael, Dautenhahn, Kerstin
The Association for the Advancement of Artificial Intelligence held its 1997 Fall Symposia Series on 7 to 9 November in Cambridge, Massachusetts. This article contains summaries of the six symposia that were conducted: (1) Communicative Action in Humans and Machines, (2) Context in Knowledge Representation and Natural Language, (3) Intelligent Tutoring System Authoring Tools, (4) Model-Directed Autonomous Systems, (5) Reasoning with Diagrammatic Representations II, and (6) Socially Intelligent Agents.