Robust Sparse Component Analysis Based on a Generalized Hough Transform

An algorithm called Hough SCA is presented for recovering the matrix in, where is a multivariate observed signal, possibly is of lower dimension than the unknown sources. They are assumed to be sparse in the sense that at every time instant, has fewer nonzero elements than the dimension of. The presented algorithm performs a global search for hyperplane clusters within the mixture space by gathering possible hyperplane parameters within a Hough accumulator tensor. This renders the algorithm immune to the many local minima typically exhibited by the corresponding cost function. In contrast to previous approaches, Hough SCA is linear in the sample number and independent of the source dimension as well as robust against noise and outliers. Experiments demonstrate the flexibility of the proposed algorithm.

[1]  Fabian J. Theis,et al.  Optimization Algorithms for Sparse Representations and Applications , 2006 .

[2]  Fabian J. Theis,et al.  Median-based clustering for underdetermined blind signal processing , 2006, IEEE Signal Processing Letters.

[3]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[4]  V. Koivunen,et al.  Identifiability and Separability of Linear Ica Models Revisited , 2003 .

[5]  Terrence J. Sejnowski,et al.  Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.

[6]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[7]  Graduate School.  Department of Mathematics Why study mathematics ? , 2008 .

[8]  Juan K. Lin,et al.  Feature extraction approach to blind source separation , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[9]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[10]  Fabian J. Theis,et al.  Sparse component analysis and blind source separation of underdetermined mixtures , 2005, IEEE Transactions on Neural Networks.

[11]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[12]  Barak A. Pearlmutter,et al.  Blind source separation by sparse decomposition , 2000, SPIE Defense + Commercial Sensing.

[13]  Fabian J. Theis,et al.  A geometric algorithm for overcomplete linear ICA , 2004, Neurocomputing.

[14]  Paul S. Bradley,et al.  k-Plane Clustering , 2000, J. Glob. Optim..

[15]  Fabian J. Theis,et al.  On the use of sparse signal decomposition in the analysis of multi-channel surface electromyograms , 2006, Signal Process..

[16]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[17]  Fathi M. Salem,et al.  ALGEBRAIC OVERCOMPLETE INDEPENDENT COMPONENT ANALYSIS , 2003 .

[18]  Sergio Barbarossa,et al.  Analysis of multicomponent LFM signals by a combined Wigner-Hough transform , 1995, IEEE Trans. Signal Process..

[19]  Assaf Zeevi,et al.  The Hough transform estimator , 2004 .

[20]  Fabian J. Theis,et al.  A New Concept for Separability Problems in Blind Source Separation , 2004, Neural Computation.

[21]  Pedro J. Ballester.  Applications of the Hough Transform in Spectroscopy , 1994 .

[22]  P.V.C. Hough,et al.  Machine Analysis of Bubble Chamber Pictures , 1959 .

[23]  Abdelhak M. Zoubir,et al.  Direction finding of nonstationary signals using a time-frequency Hough transform , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[24]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[25]  Fabian J. Theis,et al.  Sparse Component Analysis: a New Tool for Data Mining , 2004 .

[26]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[27]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[28]  Fabian J. Theis,et al.  Robust overcomplete matrix recovery for sparse sources using a generalized Hough transform , 2004, ESANN.

[29]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[30]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[31]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.