Non-negative Independent Component Analysis Algorithm Based on 2D Givens Rotations and a Newton Optimization

In this paper, we consider the Independent Component Analysis problem when the hidden sources are non-negative (Non-negative ICA). This problem is formulated as a non-linear cost function optimization over the special orthogonal matrix group SO(n). Using Givens rotations and Newton optimization, we developed an effective axis pair rotation method for Non-negative ICA. The performance of the proposed method is compared to those designed by Plumbley and simulations on synthetic data show the efficiency of the proposed algorithm.

[1]  Mark D. Plumbley.  Geometrical methods for non-negative ICA: Manifolds, Lie groups and toral subalgebras , 2005, Neurocomputing.

[2]  Mark D. Plumbley.  Algorithms for nonnegative independent component analysis , 2003, IEEE Trans. Neural Networks.

[3]  Mark D. Plumbley.  Optimization Using Fourier Expansion over a Geodesic for Non-negative ICA , 2004, ICA.

[4]  Feng Qianjin,et al.  Projected gradient methods for Non-negative Matrix Factorization based relevance feedback algorithm in medical image retrieval , 2011 .

[5]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[6]  Mark D. Plumbley.  Conditions for nonnegative independent component analysis , 2002, IEEE Signal Processing Letters.

[7]  Aapo Hyv.  Fast and Robust Fixed-Point Algorithms for Independent Component Analysis , 1999 .

[8]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[9]  Victoria Stodden,et al.  When Does Non-Negative Matrix Factorization Give a Correct Decomposition into Parts? , 2003, NIPS.

[10]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[11]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[12]  Toshihisa Tanaka,et al.  First results on uniqueness of sparse non-negative matrix factorization , 2005, 2005 13th European Signal Processing Conference.

[13]  P. Comon.  Independent Component Analysis , 1992 .

[14]  Yehoshua Y. Zeevi,et al.  Sparse ICA for blind separation of transmitted and reflected images , 2005, Int. J. Imaging Syst. Technol..

[15]  Fabian J. Theis,et al.  Extended Sparse Nonnegative Matrix Factorization , 2005, IWANN.

[16]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[17]  Erkki Oja,et al.  A "nonnegative PCA" algorithm for independent component analysis , 2004, IEEE Transactions on Neural Networks.

[18]  Yunxia Li,et al.  Improvement for Nonnegative PCA Algorithm for Independent Component Analysis , 2005, 2005 International Conference on Neural Networks and Brain.

[19]  P. Paatero.  Least squares formulation of robust non-negative factor analysis , 1997 .

[20]  D. Brie,et al.  Separation of Non-Negative Mixture of Non-Negative Sources Using a Bayesian Approach and MCMC Sampling , 2006, IEEE Transactions on Signal Processing.

[21]  C. Jutten,et al.  A Bayesian Nonlinear Source Separation Method for Smart Ion-Selective Electrode Arrays , 2009, IEEE Sensors Journal.

[22]  Hans Laurberg.  Uniqueness of Non-Negative Matrix Factorization , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[23]  Allan Kardec Barros,et al.  Independent Component Analysis and Blind Source Separation , 2007, Signal Processing.

[24]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..