Is the general form of Renyi's entropy a contrast for source separation?
(2007) Independent Component Analysis and Signal Separation, ICA 2007 — ISBN: [3-540-74493-2], 129-136, published
Files
C36-IsthegeneralformofRenyisentropyacontrastforsourceseparation.pdf
Restricted Access - Adobe PDF
- 415.99 KB
Details
- Authors
- Abstract
- Renyi's entropy-based criterion has been proposed as an objective function for independent component analysis because of its relationship with Shannon's entropy and its computational advantages in specific cases. These criteria were suggested based on ''convincing" experiments. However, there is no theoretical proof that globally maximizing those functions would lead to separate the sources; actually, this was implicitly conjectured. In this paper, the problem is tackled in a theoretical way; it is shown that globally maximizing the Renyi's entropy-based criterion, in its general form, does not necessarily provide the expected independent signals. The contrast function property of the corresponding criteria simultaneously depend on the value of the Renyi parameter, and on the (unknown) source densities.
- Affiliations
Citations
Vrins, F., Dinh-Tuan Pham, & Verleysen, M. (2007). Is the general form of Renyi’s entropy a contrast for source separation? In Davies, M.E.; James, C.; Davies, M.; Abdallah, S.; Plumbley, M. (ed.), Independent Component Analysis and Signal Separation, ICA 2007 (pp. 129-136). Springer. https://hdl.handle.net/2078.5/92311