Multikernel Capsule Network for Schizophrenia Identification

Schizophrenia seriously affects the quality of life. To date, both simple (e.g., linear discriminant analysis) and complex (e.g., deep neural network) machine-learning methods have been utilized to identify schizophrenia based on functional connectivity features. The existing simple methods need two separate steps (i.e., feature extraction and classification) to achieve the identification, which disables simultaneous tuning for the best feature extraction and classifier training. The complex methods integrate two steps and can be simultaneously tuned to achieve optimal performance, but these methods require a much larger amount of data for model training. To overcome the aforementioned drawbacks, we proposed a multikernel capsule network (MKCapsnet), which was developed by considering the brain anatomical structure. Kernels were set to match partition sizes of the brain anatomical structure in order to capture interregional connectivities at the varying scales. With the inspiration of the widely used dropout strategy in deep learning, we developed capsule dropout in the capsule layer to prevent overfitting of the model. The comparison results showed that the proposed method outperformed the state-of-the-art methods. Besides, we compared performances using different parameters and illustrated the routing process to reveal characteristics of the proposed method. MKCapsnet is promising for schizophrenia identification. Our study first utilized the capsule neural network for analyzing functional connectivity of magnetic resonance imaging (MRI) and proposed a novel multikernel capsule structure with the consideration of brain anatomical parcellation, which could be a new way to reveal brain mechanisms. In addition, we provided useful information in the parameter setting, which is informative for further studies using a capsule network for other neurophysiological signal classification.

[1]  Robertas Alzbutas,et al.  Convolutional capsule network for classification of breast cancer histology images , 2018, ICIAR.

[2]  A. Bezerianos,et al.  Machine learning technique reveals intrinsic characteristics of schizophrenia: an alternative method , 2018, Brain Imaging and Behavior.

[3]  Dinesh Bhugra,et al.  Perspectives Open access, freely available online The Global Prevalence of Schizophrenia , 2022 .

[4]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[5]  Xi-Nian Zuo,et al.  REST: A Toolkit for Resting-State Functional Magnetic Resonance Imaging Data Processing , 2011, PloS one.

[6]  Vince D. Calhoun,et al.  A Hybrid Machine Learning Method for Fusing fMRI and Genetic Data: Combining both Improves Classification of Schizophrenia , 2010, Front. Hum. Neurosci..

[7]  Philip S. Yu,et al.  Zero-shot User Intent Detection via Capsule Neural Networks , 2018, EMNLP.

[8]  Chaogan Yan,et al.  DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI , 2010, Front. Syst. Neurosci..

[9]  Vince D. Calhoun,et al.  Classification of schizophrenia patients based on resting-state functional network connectivity , 2013, Front. Neurosci..

[10]  P. Buckley Rare Structural Variants Disrupt Multiple Genes in Neurodevelopmental Pathways in Schizophrenia , 2009 .

[11]  Hien Van Nguyen,et al.  Fast CapsNet for Lung Cancer Screening , 2018, MICCAI.

[12]  Oscar Marín,et al.  Interneuron dysfunction in psychiatric disorders , 2012, Nature Reviews Neuroscience.

[13]  S. Lawrie,et al.  Towards the identification of imaging biomarkers in schizophrenia, using multivariate pattern classification at a single-subject level , 2013, NeuroImage: Clinical.

[14]  Karl J. Friston,et al.  The dysconnection hypothesis (2016) , 2016, Schizophrenia Research.

[15]  Vince D. Calhoun,et al.  Deep neural network with weight sparsity control and pre-training extracts hierarchical features and enhances classification performance: Evidence from whole-brain resting-state functional connectivity patterns of schizophrenia , 2016, NeuroImage.

[16]  Juan Bustillo,et al.  Functional imaging of the hemodynamic sensory gating response in schizophrenia , 2013, Human brain mapping.

[17]  A. Singleton,et al.  Rare Structural Variants Disrupt Multiple Genes in Neurodevelopmental Pathways in Schizophrenia , 2008, Science.

[18]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[19]  Vince D. Calhoun,et al.  Characterization of groups using composite kernels and multi-source fMRI analysis data: Application to schizophrenia , 2011, NeuroImage.

[20]  Vince D. Calhoun,et al.  Classification of schizophrenia and bipolar patients using static and dynamic resting-state fMRI brain connectivity , 2016, NeuroImage.

[21]  Cameron S. Carter,et al.  Automated classification of fMRI during cognitive control identifies more severely disorganized subjects with schizophrenia , 2012, Schizophrenia Research.

[22]  Vince D. Calhoun,et al.  Improving Classification Rate of Schizophrenia Using a Multimodal Multi-Layer Perceptron Model with Structural and Functional MR , 2018, ArXiv.

[23]  Toshiyuki Someya,et al.  Diagnostic classification of schizophrenia by neural network analysis of blood-based gene expression signatures , 2010, Schizophrenia Research.

[24]  H. Yamasue,et al.  Classification of First-Episode Schizophrenia Patients and Healthy Subjects by Automated MRI Measures of Regional Brain Volume and Cortical Thickness , 2011, PloS one.

[25]  M. Kubicki,et al.  Review of functional and anatomical brain connectivity findings in schizophrenia , 2013, Current opinion in psychiatry.

[26]  Yufeng Zang,et al.  DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI , 2010 .

[27]  Dewen Hu,et al.  Discriminative analysis of resting-state functional connectivity patterns of schizophrenia using low dimensional embedding of fMRI , 2010, NeuroImage.

[28]  Chen Xu,et al.  MS-CapsNet: A Novel Multi-Scale Capsule Network , 2018, IEEE Signal Processing Letters.

[29]  Yasuhiro Kawasaki,et al.  Differentiation of first-episode schizophrenia patients from healthy controls using ROI-based multiple structural brain variables , 2010, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[30]  Wilson Rivera,et al.  Capsule Networks for Protein Structure Classification and Prediction , 2018, ArXiv.

[31]  S. Sponheim,et al.  Sensitivity and specificity of select biological indices in characterizing psychotic patients and their relatives , 2003, Schizophrenia Research.

[32]  Min Yang,et al.  Investigating Capsule Networks with Dynamic Routing for Text Classification , 2018, EMNLP.

[33]  A. Mechelli,et al.  Dysconnectivity in schizophrenia: Where are we now? , 2011, Neuroscience & Biobehavioral Reviews.

[34]  Jiang Li,et al.  Seagrass Detection in Coastal Water Through Deep Capsule Networks , 2018, PRCV.

[35]  Dinggang Shen,et al.  Multivariate examination of brain abnormality using both structural and functional MRI , 2007, NeuroImage.

[36]  S. Sponheim,et al.  Using biological indices to classify schizophrenia and other psychotic patients , 2001, Schizophrenia Research.

[37]  Konstantinos N. Plataniotis,et al.  Brain Tumor Type Classification via Capsule Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).