Nonlinear Discriminant Analysis Using Kernel Functions

Fishers linear discriminant analysis (LDA) is a classical multivari(cid:173) ate technique both for dimension reduction and classification. The data vectors are transformed into a low dimensional subspace such that the class centroids are spread out as much as possible. In this subspace LDA works as a simple prototype classifier with lin(cid:173) ear decision boundaries. However, in many applications the linear boundaries do not adequately separate the classes. We present a nonlinear generalization of discriminant analysis that uses the ker(cid:173) nel trick of representing dot products by kernel functions.