Fast and effective model order selection method to determine the number of sources in a linear transformation model

This paper formally introduces the method named as RAE (ratio of adjacent eigenvalues) for model order selection, and proposes a new approach combining the recently developed SORTE (Second ORder sTatistic of the Eigenvalues) and RAE in the context for determining the number of sources in a linear transformation model. The underlying rationale for the combination discovered through sufficient simulations is that SORTE overestimated the true order in the model and RAE underestimated the true order when the signal to noise ratio (SNR) was low. Simulations further showed that after the new method, called RAESORTE, was optimized, the true number of sources was almost correctly estimated even when the SNR was -10 dB, which is extremely difficult for any other model order selection methods; moreover, RAE took much less time than SORTE known as computational efficiency. Hence, RAE and RAESORTE appear promising for the real-time and real world signal processing.

[1]  Phillip A. Regalia,et al.  On the behavior of information theoretic criteria for model order selection , 2001, IEEE Trans. Signal Process..

[2]  Piet M. T. Broersen,et al.  Autoregressive model order selection by a finite sample estimator for the Kullback-Leibler discrepancy , 1998, IEEE Trans. Signal Process..

[3]  Tülay Adali,et al.  Estimating the number of independent components for functional magnetic resonance imaging data , 2007, Human brain mapping.

[4]  Tom Minka,et al.  Automatic Choice of Dimensionality for PCA , 2000, NIPS.

[5]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[6]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[7]  Kyuwan Choi,et al.  Detecting the Number of Clusters in n-Way Probabilistic Clustering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  J. Cavanaugh.  A large-sample model selection criterion based on Kullback's symmetric divergence , 1999 .

[9]  Abdelhak M. Zoubir,et al.  Improving the performance of model-order selection criteria by partial-model selection search , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Andrzej Cichocki,et al.  Bayesian estimation of the number of principal components , 2006, 2006 14th European Signal Processing Conference.

[11]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[12]  H. Akaike.  A new look at the statistical model identification , 1974 .

[13]  Erik G. Larsson,et al.  Empirical Bayes Linear Regression with Unknown Model Order , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[14]  Albert H. Nuttall,et al.  Multidimensional probability density function approximations for detection, classification, and model order selection , 2001, IEEE Trans. Signal Process..

[15]  Victor Solo,et al.  Dimension Estimation in Noisy PCA With SURE and Random Matrix Theory , 2008, IEEE Transactions on Signal Processing.

[16]  Bin Yu,et al.  Model Selection and the Principle of Minimum Description Length , 2001 .

[17]  O. Tervonen,et al.  The effect of model order selection in group PICA , 2010, Human brain mapping.

[18]  Andrzej Cichocki,et al.  Efficient method for Tucker3 model selection , 2009 .

[19]  Jean Pierre Delmas,et al.  Blind channel approximation: effective channel order determination , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[20]  Tapani Ristaniemi,et al.  Determining the number of sources in high-density EEG recordings of event-related potentials by model order selection , 2011, 2011 IEEE International Workshop on Machine Learning for Signal Processing.

[21]  Victor Solo,et al.  Rank selection in noist PCA with sure and random matrix theory , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Y. Selen,et al.  Model-order selection: a review of information criterion rules , 2004, IEEE Signal Processing Magazine.