Neural Networks for Segmenting Neuronal Structures in EM Stacks

A pixel classifier is driving our winning approach to neural structure segmentation in electron microscopy images. Without explicit feature computation, the label of each pixel (membrane or nonmembrane) is predicted from raw pixel values in a square window centered on it. The classifier is a special type of feed-forward neural network trained by plain gradient descent. The input layer maps each window pixel to a neuron. It is followed by a succession of convolutional and maxpooling layers which preserve 2D information and extract features with increasing levels of abstraction. The output layer produces a calibrated probability for each class, and is subjected to very mild post-processing. The approach outperformed all other entries of the competition in all considered metrics: values for rand error, warping error and pixel error were 48 · 10−3, 434 · 10−6 and 60 · 10−3, respectively.

[1]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[4]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Sven Behnke,et al.  Hierarchical Neural Networks for Image Interpretation , 2003, Lecture Notes in Computer Science.

[6]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[7]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[8]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Vincent Lepetit,et al.  Fast Ray features for learning irregular shapes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  P. Fua,et al.  Learning rotational features for filament detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Vincent Lepetit,et al.  A Fully Automated Approach to Segmentation of Irregularly Shaped Cellular Structures in EM Images , 2010, MICCAI.

[12]  Joachim M. Buhmann,et al.  Neuron geometry extraction by perceptual grouping in ssTEM images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[14]  Klaus Kofler,et al.  Performance and Scalability of GPU-Based Convolutional Neural Networks , 2010, 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing.

[15]  Luca Maria Gambardella,et al.  Deep, Big, Simple Neural Nets for Handwritten Digit Recognition , 2010, Neural Computation.

[16]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[17]  Joachim M. Buhmann,et al.  Geometrical Consistent 3D Tracing of Neuronal Processes in ssTEM Data , 2010, MICCAI.

[18]  Luca Maria Gambardella,et al.  Convolutional Neural Network Committees for Handwritten Character Classification , 2011, 2011 International Conference on Document Analysis and Recognition.

[19]  Luca Maria Gambardella,et al.  Flexible, High Performance Convolutional Neural Networks for Image Classification , 2011, IJCAI.

[20]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Giacomo Boracchi,et al.  Foveated self-similarity in nonlocal image filtering , 2012, Electronic Imaging.