The permutation test for feature selection by mutual information

(2006) 14th European Symposium on Artificial Neural Networks (ESANN 2006) — Location: Bruges (Belgium) (26.April.2006)

Files

121-Thepermutationtestforfeatureselectionbymutualinformation.pdf
  • Restricted Access
  • Adobe PDF
  • 369.25 KB

Details

Authors
Abstract
The estimation of mutual information for feature selection is often subject to inaccuracies due to noise, small sample size, bad choice of parameter for the estimator, etc. The choice of a threshold above which a feature will be considered useful is thus difficult to make. Therefore, the use of the permutation test to assess the reliability of the estimation is proposed. The permutation test allows performing a non-parametric hypothesis test to select the relevant features and to build a Feature Relevance Diagram that visually synthesizes the result of the test.
Affiliations

Citations

François, D., Wertz, V., & Verleysen, M. (2006). The permutation test for feature selection by mutual information. Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN 2006), p. 239-244. https://hdl.handle.net/2078.5/254062