On-The-Fly Approximation of Multivariate Total Variation Minimization

In the context of change-point detection, addressed by Total Variation minimization strategies, an efficient on-the-fly algorithm has been designed leading to exact solutions for univariate data. In this contribution, an extension of such an on-the-fly strategy to multivariate data is investigated. The proposed algorithm relies on the local validation of the Karush-Kuhn-Tucker conditions on the dual problem. Showing that the non-local nature of the multivariate setting precludes to obtain an exact on-the-fly solution, we devise an on-the-fly algorithm delivering an approximate solution, whose quality is controlled by a practitioner-tunable parameter, acting as a trade-off between quality and computational cost. Performance assessment shows that high quality solutions are obtained on-the-fly while benefiting of computational costs several orders of magnitude lower than standard iterative procedures. The proposed algorithm thus provides practitioners with an efficient multivariate change-point detection on-the-fly procedure.

[1]  Holger Hoefling A Path Algorithm for the Fused Lasso Signal Approximator , 2009, 0910.0526.

[2]  Stephan Didas,et al.  Splines in Higher Order TV Regularization , 2006, International Journal of Computer Vision.

[3]  Lionel Moisan,et al.  Total Variation as a Local Filter , 2011, SIAM J. Imaging Sci..

[4]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[5]  Jean-Yves Tourneret,et al.  Joint Segmentation of Multivariate Astronomical Time Series: Bayesian Sampling With a Hierarchical Model , 2007, IEEE Transactions on Signal Processing.

[6]  Pavlo A. Krokhmal,et al.  An algorithm for online detection of temporal changes in operator cognitive state using real-time psychophysiological data , 2010, Biomed. Signal Process. Control..

[7]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[8]  Jean-Philippe Vert,et al.  The group fused Lasso for multiple change-point detection , 2011, 1106.4199.

[9]  P. Jaccard Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines , 1901 .

[10]  P. L. Combettes,et al.  A proximal decomposition method for solving convex variational inverse problems , 2008, 0807.2617.

[11]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[12]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[13]  A. Chambolle,et al.  An introduction to Total Variation for Image Analysis , 2009 .

[14]  Zaïd Harchaoui,et al.  Catching Change-points with Lasso , 2007, NIPS.

[15]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[16]  Markus Grasmair,et al.  The Equivalence of the Taut String Algorithm and BV-Regularization , 2006, Journal of Mathematical Imaging and Vision.

[17]  Franck Picard,et al.  A statistical approach for array CGH data analysis , 2005, BMC Bioinformatics.

[18]  Stephen P. Boyd,et al.  An ADMM Algorithm for a Class of Total Variation Regularized Estimation Problems , 2012, 1203.1828.

[19]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[20]  M. Godinez,et al.  On-line fetal heart rate monitor by phonocardiography , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[21]  P. Davies,et al.  Local Extremes, Runs, Strings and Multiresolution , 2001 .

[22]  C. Vogel Computational Methods for Inverse Problems , 1987 .

[23]  Massimo Fornasier,et al.  Theoretical Foundations and Numerical Methods for Sparse Recovery , 2010, Radon Series on Computational and Applied Mathematics.

[24]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[25]  Otmar Scherzer,et al.  Tube Methods for BV Regularization , 2003, Journal of Mathematical Imaging and Vision.

[26]  S. Geer,et al.  Locally adaptive regression splines , 1997 .

[27]  J. Marilleau,et al.  Tomographic Reconstruction From A Limited Number Of Projections , 1983, Other Conferences.

[28]  Suvrit Sra,et al.  Fast Newton-type Methods for Total Variation Regularization , 2011, ICML.

[29]  Laurent Condat,et al.  A Direct Algorithm for 1-D Total Variation Denoising , 2013, IEEE Signal Processing Letters.

[30]  Patrick Flandrin,et al.  Discovering the structure of complex networks by minimizing cyclic bandwidth sum , 2014, 1410.6108.

[31]  Jieping Ye,et al.  An efficient algorithm for a class of fused lasso problems , 2010, KDD.

[32]  José R. Dorronsoro,et al.  Group Fused Lasso , 2013, ICANN.

[33]  Jean-Philippe Vert,et al.  Fast detection of multiple change-points shared by many signals using group LARS , 2010, NIPS.

[34]  A. Gramfort,et al.  Mixed-norm estimates for the M/EEG inverse problem using accelerated gradient methods , 2012, Physics in medicine and biology.

[35]  A. Rinaldo Properties and refinements of the fused lasso , 2008, 0805.0234.

[36]  J. Pesquet,et al.  A Parallel Inertial Proximal Optimization Method , 2012 .

[37]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[38]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[39]  Céline Robardet,et al.  Heuristic for solving cyclic bandwidth sum problem by following the structure of the graph , 2014, ArXiv.