recursive maxima hunting
Feature selection in functional data classification with recursive maxima hunting
Dimensionality reduction is one of the key issues in the design of effective machine learning methods for automatic induction. In this work, we introduce recursive maxima hunting (RMH) for variable selection in classification problems with functional data. In this context, variable selection techniques are especially attractive because they reduce the dimensionality, facilitate the interpretation and can improve the accuracy of the predictive models. The method, which is a recursive extension of maxima hunting (MH), performs variable selection by identifying the maxima of a relevance function, which measures the strength of the correlation of the predictor functional variable with the class label. At each stage, the information associated with the selected variable is removed by subtracting the conditional expectation of the process. The results of an extensive empirical evaluation are used to illustrate that, in the problems investigated, RMH has comparable or higher predictive accuracy than standard simensionality reduction techniques, such as PCA and PLS, and state-of-the-art feature selection methods for functional data, such as maxima hunting.
Reviews: Feature selection in functional data classification with recursive maxima hunting
First let me say that while I know feature selection well, I haven't had the opportunity to read a lot of papers about functional feature selection. Therefore my background here is limited in terms of references. The paper is well organized and clear, in my opinion even though ironically wrt the contents it has a few redundancies - but that's fine. The experiments seem to be carried out thoroughly with one exception as the authors note themselves: the parameters s and r seem to be chosen a little arbitrarily and in my opinion more values of those should have been included in the cross validation procedure. It is also not very clear whether these values are fixed or not during the experiments on real data.
Feature selection in functional data classification with recursive maxima hunting
Torrecilla, José L., Suárez, Alberto
Dimensionality reduction is one of the key issues in the design of effective machine learning methods for automatic induction. In this work, we introduce recursive maxima hunting (RMH) for variable selection in classification problems with functional data. In this context, variable selection techniques are especially attractive because they reduce the dimensionality, facilitate the interpretation and can improve the accuracy of the predictive models. The method, which is a recursive extension of maxima hunting (MH), performs variable selection by identifying the maxima of a relevance function, which measures the strength of the correlation of the predictor functional variable with the class label. At each stage, the information associated with the selected variable is removed by subtracting the conditional expectation of the process.