DeepNeuron: an open deep learning toolbox for neuron tracing

Reconstructing three-dimensional (3D) morphology of neurons is essential for understanding brain structures and functions. Over the past decades, a number of neuron tracing tools including manual, semiautomatic, and fully automatic approaches have been developed to extract and analyze 3D neuronal structures. Nevertheless, most of them were developed based on coding certain rules to extract and connect structural components of a neuron, showing limited performance on complicated neuron morphology. Recently, deep learning outperforms many other machine learning methods in a wide range of image analysis and computer vision tasks. Here we developed a new Open Source toolbox, DeepNeuron, which uses deep learning networks to learn features and rules from data and trace neuron morphology in light microscopy images. DeepNeuron provides a family of modules to solve basic yet challenging problems in neuron tracing. These problems include but not limited to: (1) detecting neuron signal under different image conditions, (2) connecting neuronal signals into tree(s), (3) pruning and refining tree morphology, (4) quantifying the quality of morphology, and (5) classifying dendrites and axons in real time. We have tested DeepNeuron using light microscopy images including bright-field and confocal images of human and mouse brain, on which DeepNeuron demonstrates robustness and accuracy in neuron tracing.

[1]  Hanchuan Peng,et al.  Deep models for brain EM image segmentation: novel insights and improved performance , 2016, Bioinform..

[2]  Hanchuan Peng,et al.  Automatic tracing of ultra-volumes of neuronal images , 2016, Nature Methods.

[3]  Yuan Liu,et al.  The DIADEM and Beyond , 2011, Neuroinformatics.

[4]  Shaoqun Zeng,et al.  High-throughput dual-colour precision imaging for brain-wide connectome with cytoarchitectonic landmarks at the cellular level , 2016, Nature Communications.

[5]  Giorgio A. Ascoli,et al.  Automated reconstruction of neuronal morphology: An overview , 2011, Brain Research Reviews.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Jinhyun Kim,et al.  neuTube 1.0: A New Design for Efficient Neuron Reconstruction Software Based on the SWC Format 123 , 2015, eNeuro.

[8]  Hanchuan Peng,et al.  Virtual finger boosts three-dimensional imaging and microsurgery as well as terabyte volume image visualization and analysis , 2014, Nature Communications.

[9]  Shih-Fu Chang,et al.  Automatic Reconstruction of Neural Morphologies with Multi-Scale Tracking , 2012, Front. Neural Circuits.

[10]  Tianming Liu,et al.  SmartTracing: self-learning-based Neuron reconstruction , 2015, Brain Informatics.

[11]  Hanchuan Peng,et al.  Extensible visualization and analysis for multidimensional images using Vaa3D , 2014, Nature Protocols.

[12]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[13]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[18]  Sean L. Hill,et al.  BigNeuron: Large-Scale 3D Neuron Reconstruction from Optical Microscopy Images , 2015, Neuron.

[19]  Julio Chapeton,et al.  Active learning of neuron morphology for accurate automated tracing of neurites , 2014, Front. Neuroanat..

[20]  Badrinath Roysam,et al.  The FARSIGHT Trace Editor: An Open Source Tool for 3-D Inspection and Efficient Pattern Analysis Aided Editing of Automated Neuronal Reconstructions , 2011, Neuroinformatics.

[21]  Shuiwang Ji,et al.  Deep Learning Segmentation of Optical Microscopy Images Improves 3-D Neuron Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[22]  J. Douglas Armstrong,et al.  Bioinformatics Applications Note Systems Biology Simple Neurite Tracer: Open Source Software for Reconstruction, Visualization and Analysis of Neuronal Processes , 2022 .

[23]  Eugene W. Myers,et al.  BlastNeuron for Automated Comparison, Retrieval and Clustering of 3D Neuron Morphologies , 2015, Neuroinformatics.