Rectified ALS algorithm for multidimensional harmonic retrieval

MultiDimensional (MD) Harmonic Retrieval is a challenging multi-parameter estimation problem and is useful for a plethora of operational applications as for instance channel sounding or MIMO radar processing. The MD-harmonic model follows a structured Canonical Polyadic Decomposition (CPD) in the sense that the factors of the CPD are Vandermonde. A standard and popular estimation scheme to derive the CPD is the Alternating Least Squares (ALS) algorithm. Unfortunately, the ALS algorithm does not exploit the a priori known factor structure, which considerably degrades the estimation performance. In this work, a modified ALS-type algorithm is proposed. This new algorithm, called Rectified ALS (RecALS), is able to take into account the Vandermonde structure of the factors. The RecALS algorithm belongs to the Lift-and-Project family and exploits iterated projections on the set of Toeplitz rank-1 matrices. It exhibits a fast convergence and is very accurate in the sense that its Mean Square Error (MSE) is close to the Cramér-Rao Bound for a wide range of Signal to Noise Ratio (SNR).

[1]  Rémy Boyer.  Deterministic asymptotic Cramér-Rao bound for the multidimensional harmonic model , 2008, Signal Process..

[2]  Lieven De Lathauwer,et al.  Blind Signal Separation via Tensor Decomposition With Vandermonde Factor: Canonical Polyadic Decomposition , 2013, IEEE Transactions on Signal Processing.

[3]  Vin de Silva,et al.  Tensor rank and the ill-posedness of the best low-rank approximation problem , 2006, math/0607647.

[4]  James A. Cadzow,et al.  Signal enhancement-a composite property mapping algorithm , 1988, IEEE Trans. Acoust. Speech Signal Process..

[5]  V. Pisarenko.  The Retrieval of Harmonics from a Covariance Function , 1973 .

[6]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[7]  Souleymen Sahnoun,et al.  Joint Source Estimation and Localization , 2015, IEEE Transactions on Signal Processing.

[8]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[9]  P. L. Combettes.  The foundations of set theoretic estimation , 1993 .

[10]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[11]  Nikos D. Sidiropoulos,et al.  Parallel factor analysis in sensor array processing , 2000, IEEE Trans. Signal Process..

[12]  R. Dykstra,et al.  A Method for Finding Projections onto the Intersection of Convex Sets in Hilbert Spaces , 1986 .

[13]  Florence Alberge.  Iterative decoding as Dykstra's algorithm with alternate I-projection and reverse I-projection , 2008, 2008 16th European Signal Processing Conference.

[14]  Florian Roemer,et al.  Higher-Order SVD-Based Subspace Estimation to Improve the Parameter Estimation Accuracy in Multidimensional Harmonic Retrieval Problems , 2008, IEEE Transactions on Signal Processing.

[15]  Pierre Comon,et al.  Tensor CP Decomposition With Structured Factor Matrices: Algorithms and Performance , 2016, IEEE Journal of Selected Topics in Signal Processing.

[16]  Jun Liu,et al.  An Eigenvector-Based Approach for Multidimensional Frequency Estimation With Improved Identifiability , 2006, IEEE Transactions on Signal Processing.

[17]  Lieven De Lathauwer,et al.  A Block Component Model-Based Blind DS-CDMA Receiver , 2008, IEEE Transactions on Signal Processing.

[18]  Pierre Comon,et al.  Tensors : A brief introduction , 2014, IEEE Signal Processing Magazine.

[19]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[20]  Robert Boorstyn,et al.  Single tone parameter estimation from discrete-time observations , 1974, IEEE Trans. Inf. Theory.

[21]  André Lima Férrer de Almeida,et al.  PARAFAC-based unified tensor modeling for wireless communication systems with application to blind multiuser equalization , 2007, Signal Process..

[22]  Nikos D. Sidiropoulos,et al.  Tensor Algebra and Multidimensional Harmonic Retrieval in Signal Processing for MIMO Radar , 2010, IEEE Transactions on Signal Processing.

[23]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[24]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[25]  Ivan Markovsky,et al.  Low Rank Approximation - Algorithms, Implementation, Applications , 2018, Communications and Control Engineering.

[26]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2011, SIAM Rev..

[27]  R. Dykstra.  An Iterative Procedure for Obtaining $I$-Projections onto the Intersection of Convex Sets , 1985 .