Quinlan, J. R.


FOIL: A midterm report

Classics

FOIL is a learning system that constructs Horn clause programs from examples. This paper summarises the development of FOIL from 1989 up to early 1993 and evaluates its effectiveness on a non-trivial sequence of learning tasks taken from a Prolog programming text. Although many of these tasks are handled reasonably well, the experiment highlights some weaknesses of the current implementation. Areas for further research are identified.


C4.5 Programs for Machine Learning

Classics

See also:Bagging, Boosting, and C4.5Improved Use of Continuous Attributes in C4.5Morgan Kaufmann


Induction of decision trees

Classics

The technology for building knowledge-based systems by inductive inference from examples hasbeen demonstrated successfully in several practical applications. This paper summarizes an approach to synthesizing decision trees that has been used in a variety of systems, and it describes one such system, ID3, in detail. Results from recent studies show ways in which the methodology can be modified to deal with information that is noisy and/or incomplete. A reported shortcoming of the basic algorithm is discussed and two means of overcoming it are compared. The paper concludes with illustrations of current research directionsMachine Learning, 1, p. 81-106


Induction of decision trees

Classics

The technology for building knowledge-based systems by inductive inference from examples hasbeen demonstrated successfully in several practical applications. This paper summarizes an approach to synthesizing decision trees that has been used in a variety of systems, and it describes one such system, ID3, in detail. Results from recent studies show ways in which the methodology can be modified to deal with information that is noisy and/or incomplete. A reported shortcoming of the basic algorithm is discussed and two means of overcoming it are compared. The paper concludes with illustrations of current research directionsMachine Learning, 1, p. 81-106