The delta test: The 1-NN estimator as a feature selection criterion

Eirola, E.;Lendasse, Amaury;Corona, F.;Verleysen, Michel
(2014) 2014 International Joint Conference on Neural Networks (IJCNN 201) — Location: Beijing (China) (6.July.2014)

Files

No attached file found for this publication.

Details

Authors
  • Eirola, E.Aalto University/Finland
    Author
  • Lendasse, AmauryHelsinky University of Technology/Finland
    Author
  • Corona, F.Aalto University/Finland
    Author
  • Author
Abstract
Feature selection is essential in many machine learning problem, but it is often not clear on which grounds variables should be included or excluded. This paper shows that the mean squared leave-one-out error of the first-nearest-neighbour estimator is effective as a cost function when selecting input variables for regression tasks. A theoretical analysis of the estimator's properties is presented to support its use for feature selection. An experimental comparison to alternative selection criteria (including mutual information, least angle regression, and the RReliefF algorithm) demonstrates reliable performance on several regression tasks.
Affiliations

Citations

Eirola, E., Lendasse, A., Corona, F., & Verleysen, M. (2014). The delta test: The 1-NN estimator as a feature selection criterion. International Joint Conference on Neural Networks (IJCNN). Published. 2014 International Joint Conference on Neural Networks (IJCNN 201), Beijing (China). https://doi.org/10.1109/IJCNN.2014.6889560