Energy-efficient histogram on FPGA

The construction of histograms is an integral part of image processing pipelines, useful for image editing features such as histogram matching, thresholding and histogram equalization. In the past, research done on kernels used in image processing pipelines target advancements to achieve high throughput, area efficiency and low cost. However, a growing topic of interest that has not been fully explored is the use of energy efficiency as a key metric. In this work, we focus on developing an energy-efficient histogram implementation with a minimum frame rate of at least 30 frames per second. We determine the components that consume the most power and propose an optimized histogram implementation with the utilization of multiple optimizations to achieve notable improvement in energy efficiency while maintaining suitable throughput for usage within image processing pipelines. These optimizations include a data-defined memory activation schedule, a careful data layout and circuit-level pipelining. Our architecture is implemented on commonly-used image sizes which vary from 240 × l28 to 1216×912 and assume a pixel width of 16 bits per pixel. The post place-and-route results show that our optimized architecture has up to 15.3× higher energy efficiency when compared against the baseline architecture.

[1]  Jianhua Tao,et al.  A Fast Implementation of Adaptive Histogram Equalization , 2006 .

[2]  W. James MacLean,et al.  An Evaluation of the Suitability of FPGAs for Embedded Vision Systems , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  A.M. Alsuwailem,et al.  A new approach for real-time histogram equalization using FPGA , 2005, 2005 International Symposium on Intelligent Signal Processing and Communication Systems.

[4]  Tao Jianhua,et al.  A Fast Implementation of Adaptive Histogram Equalization , 2006, 2006 8th international Conference on Signal Processing.

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Andrew Hogue,et al.  Histogram-based search: A comparative study , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Jung-Hua Wang,et al.  Histogram-based fuzzy filter for image restoration , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[8]  Patrick Hébert,et al.  Median Filtering in Constant Time , 2007, IEEE Transactions on Image Processing.

[9]  Wayne Luk,et al.  Novel FPGA-based implementation of median and weighted median filters for image processing , 2005, International Conference on Field Programmable Logic and Applications, 2005..

[10]  MedioniGérard,et al.  Finding Waldo, or Focus of Attention Using Local Color Information , 1995 .

[11]  Gérard G. Medioni,et al.  Finding Waldo, or Focus of Attention Using Local Color Information , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  FengWu-chun,et al.  The Green500 List , 2007 .

[13]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[14]  KimLee-Sup,et al.  An advanced contrast enhancement using partially overlapped sub-block histogram equalization , 2001 .

[15]  Matti Pietikäinen,et al.  A discriminative feature space for detecting and recognizing faces , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..