Multimodality white matter tract segmentation using CNN

Diffusion-weighted MRI tractography combining with fiber clustering is a typical approaches of white matter tract segmentation. However, due to the anatomical accuracy of the diffusion-weighted images (DWI) and complicated processing procedure, this approach suffer many inherent limitations that it is difficult to handle complex fibers well and might introduce subtle errors in further processing steps. In this paper, we proposed a novel white matter tract segmentation method with dual input convolutional neural network to fuse two modal data. Specifically, the structural tensor of T1-Weighted (T1W) MR images was introduced to complement to the peaks of fiber orientation distribution function (fODF). The proposed method has been experimented with 105 subjects of Human Connect project and proved to more accurately identify white matter bundles than existing methods.

[1]  Joost van de Weijer,et al.  Adaptive Structure Tensors and their Applications , 2006, Visualization and Processing of Tensor Fields.

[2]  Carl-Fredrik Westin,et al.  The white matter query language: a novel approach for describing human white matter anatomy , 2015, Brain Structure and Function.

[3]  C. Beaulieu,et al.  The basis of anisotropic water diffusion in the nervous system – a technical review , 2002, NMR in biomedicine.

[4]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[5]  G. Gratton,et al.  Combining structural and functional neuroimaging data for studying brain connectivity: a review. , 2008, Psychophysiology.

[6]  Jacques-Donald Tournier,et al.  Diffusion tensor imaging and beyond , 2011, Magnetic resonance in medicine.

[7]  Martin Styner,et al.  Early postnatal myelin content estimate of white matter via T1w/T2w ratio , 2015, Medical Imaging.

[8]  Jan Hering,et al.  White matter microstructure variations contribute to neurological soft signs in healthy adults , 2017, Human brain mapping.

[9]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[10]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[11]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[12]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[13]  Nicholas A. Bock,et al.  Visualizing the entire cortical myelination pattern in marmosets with magnetic resonance imaging , 2009, Journal of Neuroscience Methods.

[14]  Alan Connelly,et al.  MRtrix: Diffusion tractography in crossing fiber regions , 2012, Int. J. Imaging Syst. Technol..

[15]  Christophe Lenglet,et al.  Structure tensor analysis of serial optical coherence scanner images for mapping fiber orientations and tractography in the brain , 2015, Journal of biomedical optics.

[16]  G. A. Hossein-Zadeh,et al.  Assessment of functional and structural connectivity between motor cortex and thalamus using fMRI and DWI , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  G. Hagemann,et al.  Fast, accurate, and reproducible automatic segmentation of the brain in T1‐weighted volume MRI data , 1999, Magnetic resonance in medicine.

[18]  Daniel C. Alexander,et al.  Structure Tensor Informed Fiber Tractography (STIFT) by combining gradient echo MRI and diffusion weighted imaging , 2012, NeuroImage.

[19]  Peiyu He,et al.  Functional Informed Fiber Tracking Using Combination of Diffusion and Functional MRI , 2019, IEEE Transactions on Biomedical Engineering.

[20]  Joel G. Melville,et al.  Technical review , 1991 .

[21]  Alan Connelly,et al.  Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution , 2007, NeuroImage.

[22]  Maxime Descoteaux,et al.  Recognition of white matter bundles using local and global streamline-based registration and clustering , 2017, NeuroImage.

[23]  Carl-Fredrik Westin,et al.  Unbiased Groupwise Registration of White Matter Tractography , 2012, MICCAI.