Bayesian Source Separation of Linear and Linear-quadratic Mixtures Using Truncated Priors

In this work, we propose a Bayesian source separation method of linear-quadratic (LQ) and linear mixtures. Since our method relies on truncated prior distributions, it is particularly useful when the bounds of the sources and of the mixing coefficients are known in advance; this is the case, for instance, in non-negative matrix factorization. To implement our idea, we consider a Gibbs’ sampler equipped with latent variables, which are set to simplify the sampling steps. Experiments with synthetic data point out that the new proposal performs well in situations where classical ICA-based solutions fail to separate the sources. Moreover, in order to illustrate the application of our method to actual data, we consider the problem of separating scanned images.

[1]  Gaurav Sharma,et al.  Show-through cancellation in scans of duplex printed documents , 2001, IEEE Trans. Image Process..

[2]  Christian P. Robert,et al.  The Bayesian choice , 1994 .

[3]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[4]  Xiaodong Wang,et al.  Monte Carlo methods for signal processing: a review in the statistical signal processing context , 2005, IEEE Signal Processing Magazine.

[5]  D. Brie,et al.  Separation of Non-Negative Mixture of Non-Negative Sources Using a Bayesian Approach and MCMC Sampling , 2006, IEEE Transactions on Signal Processing.

[6]  Xiaodong Wang,et al.  Monte Carlo methods for signal processing , 2005 .

[7]  William E. Griffiths,et al.  A Gibbs’ Sampler for the Parameters of a Truncated Multivariate Normal Distribution , 2002 .

[8]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[9]  Yannick Deville,et al.  Blind Separation of Linear-Quadratic Mixtures of Real Sources Using a Recurrent Structure , 2009, IWANN.

[10]  Yannick Deville,et al.  Blind Maximum Likelihood Separation of a Linear-Quadratic Mixture , 2004, ICA.

[11]  Juha Karhunen,et al.  Advances in blind source separation (BSS) and independent component analysis (ICA) for nonlinear mixtures , 2004, Int. J. Neural Syst..

[12]  Farnood Merrikh-Bayat,et al.  A nonlinear blind source separation solution for removing the show-through effect in the scanned documents , 2008, 2008 16th European Signal Processing Conference.

[13]  Yannick Deville,et al.  Recurrent networks for separating extractable-target nonlinear mixtures. Part I: Non-blind configurations , 2009, Signal Process..

[14]  Visa Koivunen,et al.  Blind identifiability of class of nonlinear instantaneous ICA models , 2002, 2002 11th European Signal Processing Conference.

[15]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[16]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[17]  S. Walker,et al.  Sampling Truncated Normal, Beta, and Gamma Densities , 2001 .

[18]  Luís B. Almeida,et al.  Separating a Real-Life Nonlinear Image Mixture , 2005, J. Mach. Learn. Res..

[19]  Pierre Comon,et al.  Séparation de sources 2. Au-delà de l'aveugle et applications. , 2007 .

[20]  Yannick Deville,et al.  Recurrent networks for separating extractable-target nonlinear mixtures. Part II. Blind configurations , 2013, Signal Process..

[21]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[22]  Guillermo Bedoya Jimenez Non-linear blind signal separation for chemical solid-state sensor arrays , 2006 .

[23]  Anna Tonazzini,et al.  Fast correction of bleed-through distortion in grayscale documents by a blind source separation technique , 2007, International Journal of Document Analysis and Recognition (IJDAR).