Image Completion in Embedded Space Using Multistage Tensor Ring Decomposition

Tensor Completion is an important problem in big data processing. Usually, data acquired from different aspects of a multimodal phenomenon or different sensors are incomplete due to different reasons such as noise, low sampling rate or human mistake. In this situation, recovering the missing or uncertain elements of the incomplete dataset is an important step for efficient data processing. In this paper, a new completion approach using Tensor Ring (TR) decomposition in the embedded space has been proposed. In the proposed approach, the incomplete data tensor is first transformed into a higher order tensor using the block Hankelization method. Then the higher order tensor is completed using TR decomposition with rank incremental and multistage strategy. Simulation results show the effectiveness of the proposed approach compared to the state of the art completion algorithms, especially for very high missing ratios and noisy cases.

[1]  Hidekata Hontani,et al.  Missing Slice Recovery for Tensors Using a Low-Rank Model in Embedded Space , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Lieven De Lathauwer,et al.  A Tensor-Based Method for Large-Scale Blind Source Separation Using Segmentation , 2017, IEEE Transactions on Signal Processing.

[3]  V. Aggarwal,et al.  Efficient Low Rank Tensor Ring Completion , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Andrzej Cichocki,et al.  Smooth PARAFAC Decomposition for Tensor Completion , 2015, IEEE Transactions on Signal Processing.

[5]  Qibin Zhao,et al.  Tensor-ring Nuclear Norm Minimization and Application for Visual : Data Completion , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Forecasting time series with structural breaks with Singular Spectrum Analysis, using a general form of recurrent formula , 2016, 1605.02188.

[7]  Lei Chen,et al.  Block Hankel Tensor ARIMA for Multiple Short Time Series Forecasting , 2020, AAAI.

[8]  S. Sanei,et al.  Tensor Based Singular Spectrum Analysis for Automatic Scoring of Sleep EEG , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Andrzej Cichocki,et al.  Matrix and tensor completion using tensor ring decomposition with sparse representation , 2020, Mach. Learn. Sci. Technol..

[10]  J. Suykens,et al.  Nuclear Norms for Tensors and Their Use for Convex Multilinear Estimation , 2011 .

[11]  Jianting Cao,et al.  Higher-dimension Tensor Completion via Low-rank Tensor Ring Decomposition , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[12]  Minh N. Do,et al.  Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train , 2016, IEEE Transactions on Image Processing.

[13]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Stephan Günnemann,et al.  Introduction to Tensor Decompositions and their Applications in Machine Learning , 2017, ArXiv.

[15]  Andrzej Cichocki,et al.  Adaptive Rank Selection for Tensor Ring Decomposition , 2021, IEEE Journal of Selected Topics in Signal Processing.

[16]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[17]  Emmanuel Sirimal Silva,et al.  Time Series Imputation via L1 Norm-Based Singular Spectrum Analysis , 2018 .

[18]  Andrzej Cichocki,et al.  Low-Rank Tensor Networks for Dimensionality Reduction and Large-Scale Optimization Problems: Perspectives and Challenges PART 1 , 2016, ArXiv.

[19]  Jianting Cao,et al.  High-order tensor completion via gradient-based optimization under tensor train format , 2019, Signal Process. Image Commun..

[20]  Qiquan Shi,et al.  Matrix and Tensor Completion in Multiway Delay Embedded Space Using Tensor Train, With Application to Signal Reconstruction , 2020, IEEE Signal Processing Letters.

[21]  Nina Golyandina,et al.  Multivariate and 2D Extensions of Singular Spectrum Analysis with the Rssa Package , 2013, 1309.5050.

[22]  Alexey Ozerov,et al.  Multichannel Nonnegative Matrix Factorization in Convolutive Mixtures for Audio Source Separation , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[23]  Kun Li,et al.  Tensor Completion From Structurally-Missing Entries by Low-TT-Rankness and Fiber-Wise Sparsity , 2018, IEEE Journal of Selected Topics in Signal Processing.

[24]  Hossein Hassani,et al.  An improved SSA forecasting result based on a filtered recurrent forecasting algorithm , 2017 .

[25]  Ce Zhu,et al.  Robust Low-Rank Tensor Ring Completion , 2020, IEEE Transactions on Computational Imaging.

[26]  Chao Li,et al.  Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion , 2018, AAAI.

[27]  Lars Grasedyck,et al.  Variants of Alternating Least Squares Tensor Completion in the Tensor Train Format , 2015, SIAM J. Sci. Comput..

[28]  Qibin Zhao,et al.  An Effective Tensor Completion Method Based on Multi-linear Tensor Ring Decomposition , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[29]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[30]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .

[31]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .