Zero-Entropy Minimization for Blind Extraction of Bounded Sources (BEBS)

Renyi’s entropy can be used as a cost function for blind source separation (BSS). Previous works have emphasized the advantage of setting Renyi’s exponent to a value different from one in the context of BSS. In this paper, we focus on zero-order Renyi’s entropy minimization for the blind extraction of bounded sources (BEBS). We point out the advantage of choosing the extended zero-order Renyi’s entropy as a cost function in the context of BEBS, when the sources have non-convex supports.

[1]  Michel Verleysen,et al.  SWM : a class of convex contrasts for source separation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  V. V. Buldygin,et al.  Brunn-Minkowski inequality , 2000 .

[3]  Simon Haykin,et al.  Entropic Contrasts for Source Separation: Geometry and Stability , 2022 .

[4]  Allan Kardec Barros,et al.  Independent Component Analysis and Blind Source Separation , 2007, Signal Processing.

[5]  T. Cover,et al.  IEEE TRANSACTIONSON INFORMATIONTHEORY,VOL. IT-30,N0. 6,NOVEmER1984 Correspondence On the Similarity of the Entropy Power Inequality The preceeding equations allow the entropy power inequality and the Brunn-Minkowski Inequality to be rewritten in the equiv , 2022 .

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  John W. Fisher,et al.  ICA Using Spacings Estimates of Entropy , 2003, J. Mach. Learn. Res..

[8]  Michel Verleysen,et al.  On the entropy minimization of a linear mixture of variables for source separation , 2005, Signal Process..

[9]  Erwin Lutwak,et al.  Crame/spl acute/r-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information , 2005, IEEE Transactions on Information Theory.

[10]  Erwin Lutwak,et al.  Information-theoretic inequalities for contoured probability distributions , 2002, IEEE Trans. Inf. Theory.

[11]  Iván Durán-Díaz,et al.  The Minimum Support Criterion for Blind Signal Extraction: A Limiting Case of the Strengthened Young's Inequality , 2004, ICA.

[12]  Deniz Erdogmus,et al.  Blind source separation using Renyi's -marginal entropies , 2002, Neurocomputing.

[13]  Dinh-Tuan Pham,et al.  Local minima of information-theoretic criteria in blind source separation , 2005, IEEE Signal Processing Letters.