A New Class of Color Filter Arrays with Optimal Sensing Properties

Digital color cameras acquire color images by means of a sensor on which a color filter array (CFA) is overlaid. The Bayer CFA dominates the consumer market, but few attention has been directed to the design of alternative CFAs in the literature. Recent works of Hirakawa et al. introduced new insights in this field, by focusing on the spectral properties of CFAs and operating directly in the Fourier domain. However, this new paradigm is generic and leaves open questions about the optimization of the many available parameters. In this work, we investigate the link between them and the light sensitivity and color discrimination capabilities of the CFA. Indeed, these characteristics determine the quality of the whole imaging pipeline, since they directly control its sensitivity to noise. By optimizing the key parameters, we obtain a class of new CFAs with optimal properties, in which the shortest 2 × 3 pattern shows up as the best compromise. Moreover, a simple and efficient linear demosaicking algorithm is associated to these CFAs, that fully exploits their spectral properties. Practical experiments confirm the superiority of our new design.

[1]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Kevin J. Parker,et al.  Color Filter Arrays Based on Mutually Exclusive Blue Noise Patterns , 1999, J. Vis. Commun. Image Represent..

[3]  Patrick J. Wolfe,et al.  Spatio-Spectral Color Filter Array Design for Enhanced Image Fidelity , 2007, 2007 IEEE International Conference on Image Processing.

[4]  Patrick J. Wolfe,et al.  Second-generation color filter array and demosaicking designs , 2008, Electronic Imaging.

[5]  Keigo Hirakawa Cross-talk explained , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Patrick J. Wolfe,et al.  Advancing the digital camera pipeline for mobile multimedia: Key challenges from a signal processing perspective , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Laurence Meylan,et al.  HDR CFA image rendering , 2006, 2006 14th European Signal Processing Conference.

[8]  Javier Portilla,et al.  Low-complexity linear demosaicing using joint spatial-chromatic image statistics , 2005, IEEE International Conference on Image Processing 2005.

[9]  R.W. Schafer,et al.  Demosaicking: color filter array interpolation , 2005, IEEE Signal Processing Magazine.

[10]  Manu Parmar,et al.  A perceptually based design methodology for color filter arrays [image reconstruction] , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[12]  Rastislav Lukac,et al.  Color filter arrays: design and performance analysis , 2005, IEEE Transactions on Consumer Electronics.

[13]  황준 Image sensor with improved light sensitivity and fabricating method of the same , 2001 .

[14]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[15]  Yap-Peng Tan,et al.  Adaptive Filtering for Color Filter Array Demosaicking , 2007, IEEE Transactions on Image Processing.

[16]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[17]  K. Martin,et al.  Vector filtering for color imaging , 2005, IEEE Signal Processing Magazine.

[18]  Eric Dubois,et al.  Frequency-domain methods for demosaicking of Bayer-sampled color images , 2005, IEEE Signal Processing Letters.

[19]  Patrick J. Wolfe,et al.  Spatio-Spectral Color Filter Array Design for Optimal Image Recovery , 2008, IEEE Transactions on Image Processing.

[20]  Soo-Chang Pei,et al.  Effective color interpolation in CCD color filter arrays using signal correlation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Y. Hel-Or The Canonical Correlations of Color Images and their use for Demosaicing , 2004 .