Decision Tree Learning
Computer Systems that Learn: Classification and Prediction Methods from Statistics
Weiss, S. M., Kulikowski, C. A.
Full text available for a fee. This book is a practical guide to classification learning systems and their applications. These computer programs learn from sample data and make predictions for new cases, sometimes exceeding the performance of humans. Practical learning systems from statistical pattern recognition, neural networks, and machine learning are presented. The authors examine prominent methods from each area, using an engineering approach and taking the practitioner's viewpoint. Intuitive explanations with a minimum of mathematics make the material accessible to anyone--regardless of experience or special interests. The underlying concepts of the learning methods are discussed with fully worked-out examples: their strengths and weaknesses, and the estimation of their future performance on specific applications. Throughout, the authors offer their own recommendations for selecting and applying learning methods such as linear discriminants, back-propagation neural networks, or decision trees. Learning systems are then contrasted with their rule-based counterparts from expert systems.Morgan Kaufmann, 1990
Induction of decision trees
The technology for building knowledge-based systems by inductive inference from examples hasbeen demonstrated successfully in several practical applications. This paper summarizes an approach to synthesizing decision trees that has been used in a variety of systems, and it describes one such system, ID3, in detail. Results from recent studies show ways in which the methodology can be modified to deal with information that is noisy and/or incomplete. A reported shortcoming of the basic algorithm is discussed and two means of overcoming it are compared. The paper concludes with illustrations of current research directionsMachine Learning, 1, p. 81-106