Tensor CP Decomposition With Structured Factor Matrices: Algorithms and Performance

The canonical polyadic decomposition (CPD) of high-order tensors, also known as Candecomp/Parafac, is very useful for representing and analyzing multidimensional data. This paper considers a CPD model having structured matrix factors, as e.g. Toeplitz, Hankel or circulant matrices, and studies its associated estimation problem. This model arises in signal processing applications such as Wiener-Hammerstein system identification and cumulant-based wireless communication channel estimation. After introducing a general formulation of the considered structured CPD (SCPD), we derive closed-form expressions for the Cramér-Rao bound (CRB) of its parameters under the presence of additive white Gaussian noise. Formulas for special cases of interest, as when the CPD contains identical factors, are also provided. Aiming at a more relevant statistical evaluation from a practical standpoint, we discuss the application of our formulas in a Bayesian context, where prior distributions are assigned to the model parameters. Three existing algorithms for computing SCPDs are then described: a constrained alternating least squares (CALS) algorithm, a subspace-based solution and an algebraic solution for SCPDs with circulant factors. Subsequently, we present three numerical simulation scenarios, in which several specialized estimators based on these algorithms are proposed for concrete examples of SCPD involving circulant factors. In particular, the third scenario concerns the identification of a Wiener-Hammerstein system via the SCPD of an associated Volterra kernel. The statistical performance of the proposed estimators is assessed via Monte Carlo simulations, by comparing their Bayesian mean-square error with the expected CRB.

[1]  Pierre Comon,et al.  Performance estimation for tensor CP decomposition with structured factors , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[3]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[4]  Louis L. Scharf,et al.  Signal processing applications of oblique projection operators , 1994, IEEE Trans. Signal Process..

[5]  Nikos D. Sidiropoulos,et al.  Tensor Algebra and Multidimensional Harmonic Retrieval in Signal Processing for MIMO Radar , 2010, IEEE Transactions on Signal Processing.

[6]  Gérard Favier,et al.  Tensor-based methods for system identification. Part 2: Three examples of tensor-based system identification methods , 2009 .

[7]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[8]  Rasmus Bro,et al.  A comparison of algorithms for fitting the PARAFAC model , 2006, Comput. Stat. Data Anal..

[9]  Souleymen Sahnoun,et al.  Tensor polyadic decomposition for antenna array processing , 2014 .

[10]  David E. Booth,et al.  Multi-Way Analysis: Applications in the Chemical Sciences , 2005, Technometrics.

[11]  Pierre Comon,et al.  Statistical efficiency of structured CPD estimation applied to Wiener-Hammerstein modeling , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[12]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[13]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[14]  Gérard Favier,et al.  An Algebraic Solution for the Candecomp/PARAFAC Decomposition with Circulant Factors , 2014, SIAM J. Matrix Anal. Appl..

[15]  Yonina C. Eldar,et al.  A Lower Bound on the Bayesian MSE Based on the Optimal Bias Function , 2008, IEEE Transactions on Information Theory.

[16]  Rémy Boyer Deterministic asymptotic Cramér-Rao bound for the multidimensional harmonic model , 2008, Signal Process..

[17]  H. V. Trees,et al.  Bayesian Bounds for Parameter Estimation and Nonlinear Filtering/Tracking , 2007 .

[18]  João Cesar M. Mota,et al.  Blind channel identification algorithms based on the Parafac decomposition of cumulant tensors: The single and multiuser cases , 2008, Signal Process..

[19]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[20]  A.K. Krishnamurthy,et al.  Multidimensional digital signal processing , 1985, Proceedings of the IEEE.

[21]  Edward J. Powers,et al.  Identification of cubic systems using higher order moments of i.i.d. signals , 1995, IEEE Trans. Signal Process..

[22]  Pierre Comon,et al.  Tensor decompositions with banded matrix factors , 2013 .

[23]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[24]  Louis L. Scharf,et al.  Geometry of the Cramer-Rao bound , 1993, Signal Process..

[25]  Gérard Favier,et al.  Non-iterative solution for PARAFAC with a Toeplitz matrix factor , 2009, 2009 17th European Signal Processing Conference.

[26]  Pierre Comon,et al.  Tensors : A brief introduction , 2014, IEEE Signal Processing Magazine.

[27]  Nikos D. Sidiropoulos,et al.  Cramer-Rao lower bounds for low-rank decomposition of multidimensional arrays , 2001, IEEE Trans. Signal Process..

[28]  Lieven De Lathauwer,et al.  Blind Signal Separation via Tensor Decomposition With Vandermonde Factor: Canonical Polyadic Decomposition , 2013, IEEE Transactions on Signal Processing.

[29]  André Lima Férrer de Almeida,et al.  Overview of constrained PARAFAC models , 2014, EURASIP J. Adv. Signal Process..

[30]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[31]  A.Y. Kibangou,et al.  Wiener-Hammerstein systems modeling using diagonal Volterra kernels coefficients , 2006, IEEE Signal Processing Letters.

[32]  Morten Mørup,et al.  Applications of tensor (multiway array) factorizations and decompositions in data mining , 2011, WIREs Data Mining Knowl. Discov..