Kernel-based dimensionality reduction using Renyi's α-entropy measures of similarity
(2017) Neurocomputing — Vol. 222, p. 36-46 (2017)
Files
1-s20-S092523121631164X-main-2.pdf
Restricted Access - Adobe PDF
- 2.88 MB
Details
- Authors
- Abstract
- Dimensionality reduction (DR) aims to reveal salient properties of high-dimensional (HD) data in a low-dimensional (LD) representation space. Two elements stipulate success of a DR approach: definition of a notion of pairwise relations in the HD and LD spaces, and measuring the mismatch between these relationships in the HD and LD representations of data. This paper introduces a new DR method, termed Kernel-based entropy dimensionality reduction (KEDR), to measure the embedding quality that is based on stochastic neighborhood preservation, involving a Gram matrix estimation of Renyi's α-entropy. The proposed approach is a data-driven framework for information theoretic learning, based on infinitely divisible matrices. Instead of relying upon regular Renyi's entropies, KEDR also computes the embedding mismatch through a parameterized mixture of divergences, resulting in an improved the preservation of both the local and global data structures. Our approach is validated on both synthetic and real-world datasets and compared to several state-of-the-art algorithms, including the Stochastic Neighbor Embedding-like techniques for which DR approach is a data-driven extension (from the perspective of kernel-based Gram matrices). In terms of visual inspection and quantitative evaluation of neighborhood preservation, the obtained results show that KEDR is competitive and promising DR method.
- Affiliations
Citations
Alvarez-Meza, A. M., Lee, J., Verleysen, M., & Castellanos-Dominguez, G. (2017). Kernel-based dimensionality reduction using Renyi’s α-entropy measures of similarity. Neurocomputing, 222, 36-46. https://doi.org/10.1016/j.neucom.2016.10.004 (Original work published 2017)