A Fast Parallel Algorithm for Convolutional Sparse Coding

The current leading algorithms for convolutional sparse coding are not inherently parallelizable, and therefore are not able to fully exploit modern multi-core architectures. We address this deficiency by developing a new algorithm that partitions the dictionary and the corresponding coefficient maps into groups, solving the main subproblems for all of the groups in parallel. Theoretical complexities and implementational details are discussed and validated with computational experiments, which indicate speed improvements by about a factor of 5, depending on the specific problem.

[1]  Lei Zhang,et al.  Convolutional Sparse Coding for Image Super-Resolution , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Brendt Wohlberg,et al.  Efficient convolutional sparse coding , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Anders P. Eriksson,et al.  Fast Convolutional Sparse Coding , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Brendt Wohlberg,et al.  Convolutional sparse representation of color images , 2016, 2016 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[5]  Brendt Wohlberg.  Convolutional sparse representations as an image model for impulse noise restoration , 2016, 2016 IEEE 12th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[6]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[7]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[8]  Gordon Wetzstein,et al.  Fast and flexible convolutional sparse coding , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Mário A. T. Figueiredo,et al.  Deconvolving Images With Unknown Boundaries Using the Alternating Direction Method of Multipliers , 2012, IEEE Transactions on Image Processing.

[10]  Gordon Wetzstein,et al.  Convolutional Sparse Coding for High Dynamic Range Imaging , 2016, Comput. Graph. Forum.

[11]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[12]  Won-Ki Jeong,et al.  Compressed sensing reconstruction of dynamic contrast enhanced MRI using GPU-accelerated convolutional sparse coding , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[13]  José Carlos Príncipe,et al.  A fast proximal method for convolutional sparse coding , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[14]  Brendt Wohlberg,et al.  SPORCO: A Python package for standard and convolutional sparse representations , 2017, SciPy.

[15]  Vishal M. Patel,et al.  Convolutional Sparse and Low-Rank Coding-Based Rain Streak Removal , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[16]  Rabab Kreidieh Ward,et al.  Image Fusion With Convolutional Sparse Representation , 2016, IEEE Signal Processing Letters.

[17]  Brendt Wohlberg,et al.  Efficient Algorithms for Convolutional Sparse Representations , 2016, IEEE Transactions on Image Processing.

[18]  Brendt Wohlberg,et al.  Boundary handling for convolutional sparse representations , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Vishal M. Patel,et al.  Convolutional Sparse Coding-based Image Decomposition , 2016, BMVC.