Is the general form of Renyi's entropy a contrast for source separation?

Vrins, Frédéric;Dinh-Tuan Pham;Verleysen, Michel
(2007) Independent Component Analysis and Signal Separation, ICA 2007 — ISBN: [3-540-74493-2], 129-136, published

Files

C36-IsthegeneralformofRenyisentropyacontrastforsourceseparation.pdf
  • Restricted Access
  • Adobe PDF
  • 415.99 KB
Request a copy

Details

Authors
Abstract
Renyi's entropy-based criterion has been proposed as an objective function for independent component analysis because of its relationship with Shannon's entropy and its computational advantages in specific cases. These criteria were suggested based on ''convincing" experiments. However, there is no theoretical proof that globally maximizing those functions would lead to separate the sources; actually, this was implicitly conjectured. In this paper, the problem is tackled in a theoretical way; it is shown that globally maximizing the Renyi's entropy-based criterion, in its general form, does not necessarily provide the expected independent signals. The contrast function property of the corresponding criteria simultaneously depend on the value of the Renyi parameter, and on the (unknown) source densities.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Vrins, F., Dinh-Tuan Pham, & Verleysen, M. (2007). Is the general form of Renyi’s entropy a contrast for source separation? In Davies, M.E.; James, C.; Davies, M.; Abdallah, S.; Plumbley, M. (ed.), Independent Component Analysis and Signal Separation, ICA 2007 (pp. 129-136). Springer. https://hdl.handle.net/2078.5/92311