Sequential Extraction of Minor Components

Principal component analysis (PCA) and Minor component analysis (MCA) are similar but have different dynamical performances. Unexpectedly, a sequential extraction algorithm for MCA proposed by Luo and Unbehauen [11] does not work for MCA, while it works for PCA. We propose a different sequential-addition algorithm which works for MCA. We also show a conversion mechanism by which any PCA algorithms are converted to dynamically equivalent MCA algorithms and vice versa.

[1]  Qin Lin,et al.  A unified algorithm for principal and minor components extraction , 1998, Neural Networks.

[2]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[3]  Wei-Yong Yan,et al.  Global convergence of Oja's subspace algorithm for principal component extraction , 1998, IEEE Trans. Neural Networks.

[4]  R. Brockett.  Least squares matching problems , 1989 .

[5]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[6]  E. Oja,et al.  On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix , 1985 .

[7]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[8]  S. Amari,et al.  A self-stabilized minor subspace rule , 1998, IEEE Signal Processing Letters.

[9]  Erkki Oja,et al.  Neural Nets for Dual Subspace Pattern Recognition Method , 1991, Int. J. Neural Syst..

[10]  Shun-ichi Amari,et al.  Unified stabilization approach to principal and minor components extraction algorithms , 2001, Neural Networks.

[11]  Lei Xu,et al.  Least mean square error reconstruction principle for self-organizing neural-nets , 1993, Neural Networks.

[12]  Tianping Chen,et al.  Modified Oja's Algorithms For Principal Subspace and Minor Subspace extraction , 1997, Neural Processing Letters.

[13]  Erkki Oja,et al.  Modified Hebbian learning for curve and surface fitting , 1992, Neural Networks.

[14]  Juha Karhunen,et al.  A Unified Neural Bigradient Algorithm for robust PCA and MCA , 1996, Int. J. Neural Syst..

[15]  Fa-Long Luo,et al.  A Minor Component Analysis Algorithm , 1997, Neural Networks.

[16]  R. Brockett,et al.  Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[17]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[18]  Fa-Long Luo,et al.  A minor subspace analysis algorithm , 1997, IEEE Trans. Neural Networks.

[19]  Fa-Long Luo,et al.  Comments on: A unified algorithm for principal and minor components extraction , 1999, Neural Networks.