Compact all-CMOS spatiotemporal compressive sensing video camera with pixel-wise coded exposure.

We present a low power all-CMOS implementation of temporal compressive sensing with pixel-wise coded exposure. This image sensor can increase video pixel resolution and frame rate simultaneously while reducing data readout speed. Compared to previous architectures, this system modulates pixel exposure at the individual photo-diode electronically without external optical components. Thus, the system provides reduction in size and power compare to previous optics based implementations. The prototype image sensor (127 × 90 pixels) can reconstruct 100 fps videos from coded images sampled at 5 fps. With 20× reduction in readout speed, our CMOS image sensor only consumes 14μW to provide 100 fps videos.

[1]  Peter Kohl,et al.  Temporal Pixel Multiplexing for simultaneous high-speed high-resolution imaging , 2010, Nature Methods.

[2]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[3]  Qionghai Dai,et al.  Dual-coded compressive hyperspectral imaging. , 2014, Optics letters.

[4]  Xin Yuan,et al.  Compressive Hyperspectral Imaging With Side Information , 2015, IEEE Journal of Selected Topics in Signal Processing.

[5]  Hong Qiao,et al.  GNCCP—Graduated NonConvexityand Concavity Procedure , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Lawrence Carin,et al.  Spectral-temporal compressive imaging. , 2015, Optics letters.

[7]  Abbas El Gamal,et al.  CMOS Image Sensor With Per-Column ΣΔ ADC and Programmable Compressed Sensing , 2013, IEEE Journal of Solid-State Circuits.

[8]  David J Brady,et al.  Spatial light modulator based color polarization imaging. , 2015, Optics express.

[9]  Shree K. Nayar,et al.  Efficient Space-Time Sampling with Pixel-Wise Coded Exposure for High-Speed Imaging , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.