A Contrast Function for Independent Component Analysis Without Permutation Ambiguity

This brief deals with the problem of blind source separation (BSS) via independent component analysis (ICA). We prove that a linear combination of the separator output fourth-order marginal cumulants (kurtoses) is a valid contrast function for ICA under prewhitening if the weights have the same sign as the source kurtoses. If, in addition, the source kurtoses are different and so are the linear combination weights, the contrast eliminates the permutation ambiguity typical to ICA, as the estimated sources are sorted at the separator output according to their kurtosis values in the same order as the weights. If the weights equal the source kurtoses, the contrast is a cumulant matching criterion based on the maximum-likelihood principle. The contrast can be maximized by means of a cost-efficient Jacobi-type pairwise iteration. In the real-valued two-signal case, the asymptotic variance of the resulting Givens angle estimator is determined in closed form, leading to the contrast weights with optimal finite-sample performance. A fully blind solution can be implemented by computing the optimum weights from the initial source estimates obtained by a classical ICA stage. An experimental study validates the features of the proposed technique and shows its superior performance compared to related previous methods.

[1]  Eric Moreau,et al.  Nonsymmetrical contrasts for sources separation , 1999, IEEE Trans. Signal Process..

[2]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[3]  Marc'Aurelio Ranzato,et al.  Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[5]  Hui Chen,et al.  Human Ear Recognition in 3D , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Danil V. Prokhorov,et al.  Enhanced Multi-Stream Kalman Filter Training for Recurrent Networks , 1998 .

[7]  Nicol N. Schraudolph,et al.  Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent , 2002, Neural Computation.

[8]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[9]  Pierre Comon,et al.  A Contrast for Independent Component Analysis With Priors on the Source Kurtosis Signs , 2008, IEEE Signal Processing Letters.

[10]  C. K. Totha,et al.  VEHICLE RECOGNITION FROM LIDAR DATA , 2003 .

[11]  Laurent Albera,et al.  Asymptotic performance of contrast-based blind source separation algorithms , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[12]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Juan José Murillo-Fuentes,et al.  Optimal Pairwise Fourth-Order Independent Component Analysis , 2006, IEEE Transactions on Signal Processing.

[14]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[15]  Asoke K. Nandi,et al.  Independent component analysis: Jacobi-like diagonalization of optimized composite-order cumulants , 2009, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[16]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[17]  Gerd Wanielik,et al.  3D LIDAR processing for vehicle safety and environment recognition , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[18]  Sergio Cruces,et al.  From blind signal extraction to blind instantaneous signal separation: criteria, algorithms, and stability , 2004, IEEE Transactions on Neural Networks.

[19]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[20]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.