Multi-dimensional classification of GABAergic interneurons with Bayesian network-modeled label uncertainty

Interneuron classification is an important and long-debated topic in neuroscience. A recent study provided a data set of digitally reconstructed interneurons classified by 42 leading neuroscientists according to a pragmatic classification scheme composed of five categorical variables, namely, of the interneuron type and four features of axonal morphology. From this data set we now learned a model which can classify interneurons, on the basis of their axonal morphometric parameters, into these five descriptive variables simultaneously. Because of differences in opinion among the neuroscientists, especially regarding neuronal type, for many interneurons we lacked a unique, agreed-upon classification, which we could use to guide model learning. Instead, we guided model learning with a probability distribution over the neuronal type and the axonal features, obtained, for each interneuron, from the neuroscientists' classification choices. We conveniently encoded such probability distributions with Bayesian networks, calling them label Bayesian networks (LBNs), and developed a method to predict them. This method predicts an LBN by forming a probabilistic consensus among the LBNs of the interneurons most similar to the one being classified. We used 18 axonal morphometric parameters as predictor variables, 13 of which we introduce in this paper as quantitative counterparts to the categorical axonal features. We were able to accurately predict interneuronal LBNs. Furthermore, when extracting crisp (i.e., non-probabilistic) predictions from the predicted LBNs, our method outperformed related work on interneuron classification. Our results indicate that our method is adequate for multi-dimensional classification of interneurons with probabilistic labels. Moreover, the introduced morphometric parameters are good predictors of interneuron type and the four features of axonal morphology and thus may serve as objective counterparts to the subjective, categorical axonal features.

[1]  G. Ascoli,et al.  NeuroMorpho.Org: A Central Resource for Neuronal Morphologies , 2007, The Journal of Neuroscience.

[2]  Friedhelm Schwenker,et al.  Fuzzy-Input Fuzzy-Output One-Against-All Support Vector Machines , 2007, KES.

[3]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[4]  Gérard Govaert,et al.  Learning from an imprecise teacher : probabilistic and evidential approaches , 2015 .

[5]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[6]  Jessica A. Turner,et al.  Automated annotation of functional imaging experiments via multi-label classification , 2013, Front. Neurosci..

[7]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[8]  Rafael Yuste,et al.  Quantitative morphologic classification of layer 5 neurons from mouse primary visual cortex , 2003, The Journal of comparative neurology.

[9]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[10]  Sahibsingh A. Dudani.  The Distance-Weighted k-Nearest-Neighbor Rule , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  David G. Stork,et al.  Pattern Classification , 1973 .

[12]  Adam Józwik,et al.  A learning scheme for a fuzzy k-NN rule , 1983, Pattern Recognit. Lett..

[13]  Michael P. Wellman,et al.  Graphical Representations of Consensus Belief , 1999, UAI.

[14]  Friedhelm Schwenker,et al.  Pattern classification and clustering: A review of partially supervised learning approaches , 2014, Pattern Recognit. Lett..

[15]  Concha Bielza,et al.  Bayesian network modeling of the consensus between experts: An application to neuron classification , 2014 .

[16]  Concha Bielza,et al.  Predicting human immunodeficiency virus inhibitors using multi-dimensional Bayesian network classifiers , 2013, Artif. Intell. Medicine.

[17]  J. Rossier,et al.  Classification of fusiform neocortical interneurons based on unsupervised clustering. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Gerardo Hermosillo,et al.  Learning From Crowds , 2010, J. Mach. Learn. Res..

[19]  Concha Bielza,et al.  Bayesian networks in neuroscience: a survey , 2014, Front. Comput. Neurosci..

[20]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  Marco Scutari,et al.  Learning Bayesian Networks with the bnlearn R Package , 2009, 0908.3817.

[22]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[23]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[24]  Radhakrishnan Nagarajan,et al.  Bayesian Networks in R , 2013 .

[25]  R. Yuste,et al.  Classification of neocortical interneurons using affinity propagation , 2013, Front. Neural Circuits.

[26]  R. Malach.  Cortical columns as devices for maximizing neuronal diversity , 1994, Trends in Neurosciences.

[27]  José M. Peña,et al.  Finding Consensus Bayesian Network Structures , 2011, J. Artif. Intell. Res..

[28]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[29]  Touradj Ebrahimi,et al.  Classification of EEG signals using Dempster Shafer theory and a k-nearest neighbor classifier , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[30]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[31]  Demian Battaglia,et al.  Classification of NPY-Expressing Neocortical Interneurons , 2009, The Journal of Neuroscience.

[32]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[33]  Concha Bielza,et al.  New insights into the classification and nomenclature of cortical GABAergic interneurons , 2013, Nature Reviews Neuroscience.

[34]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[35]  Henry Markram,et al.  A hierarchical structure of cortical interneuron electrical diversity revealed by automated statistical analysis. , 2013, Cerebral cortex.

[36]  Günther Palm,et al.  A Study of the Robustness of KNN Classifiers Trained Using Soft Labels , 2006, ANNPR.

[37]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[38]  Concha Bielza,et al.  Classifying GABAergic interneurons with semi-supervised projected model-based clustering , 2015, Artif. Intell. Medicine.

[39]  P. Somogyi,et al.  Salient features of synaptic organisation in the cerebral cortex 1 Published on the World Wide Web on 3 March 1998. 1 , 1998, Brain Research Reviews.

[40]  R. Yuste,et al.  Neural Circuits Original Research Article Materials and Methods Preparation of Brain Slices , 2022 .

[41]  A. van Harreveld,et al.  Extracellular space in the cerebral cortex of the mouse. , 1967, Journal of Anatomy.

[42]  A. Jówik,et al.  A learning scheme for a fuzzy k-NN rule , 1983 .

[43]  Concha Bielza,et al.  Multi-dimensional classification with Bayesian networks , 2011, Int. J. Approx. Reason..

[44]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[45]  Eduardo Calixto,et al.  Quantitative morphometry of electrophysiologically identified CA3b interneurons reveals robust local geometry and distinct cell classes , 2009, The Journal of comparative neurology.

[46]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[47]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .

[48]  Larry W. Swanson,et al.  The neuron classification problem , 2007, Brain Research Reviews.

[49]  Lawrence Kruger,et al.  The cerebral cortex of the mouse (a first contribution--the "acoustic" cortex). , 1992 .

[50]  A. P. Dawid,et al.  Maximum Likelihood Estimation of Observer Error‐Rates Using the EM Algorithm , 1979 .

[51]  J. Lacaille,et al.  Interneuron Diversity series: Hippocampal interneuron classifications – making things as simple as possible, not simpler , 2003, Trends in Neurosciences.

[52]  Friedhelm Schwenker,et al.  Investigating fuzzy-input fuzzy-output support vector machines for robust voice quality classification , 2013, Comput. Speech Lang..

[53]  M. C. Angulo,et al.  Molecular and Physiological Diversity of Cortical Nonpyramidal Cells , 1997, The Journal of Neuroscience.

[54]  Andrew Luk,et al.  A Re-Examination of the Distance-Weighted k-Nearest Neighbor Classification Rule , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[55]  Sen Song,et al.  A genetic and computational approach to structurally classify neuronal types , 2014, Nature Communications.

[56]  Radhakrishnan Nagarajan,et al.  Bayesian Networks in R: with Applications in Systems Biology , 2013 .

[57]  Pietro Perona,et al.  The Multidimensional Wisdom of Crowds , 2010, NIPS.

[58]  V. Mountcastle.  Perceptual Neuroscience: The Cerebral Cortex , 1998 .

[59]  Josedel Sagrado,et al.  Qualitative Combination of Bayesian , 2003 .

[60]  R. Yuste,et al.  Correlation between axonal morphologies and synaptic input kinetics of interneurons from mouse visual cortex. , 2007, Cerebral cortex.

[61]  Rafael Yuste,et al.  Dendritic size of pyramidal neurons differs among mouse cortical regions. , 2006, Cerebral cortex.

[62]  Xueliang Li,et al.  On a Relation Between , 2012 .

[63]  Bruce Abramson,et al.  The Topological Fusion of Bayes Nets , 1992, UAI.

[64]  R. Lorente de Nó.  The cerebral cortex of the mouse (a first contribution--the "acoustic" cortex). , 1992, Somatosensory & motor research.

[65]  Kobra Etminani,et al.  DemocraticOP: A Democratic way of aggregating Bayesian network parameters , 2013, Int. J. Approx. Reason..

[66]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[67]  Javier R. Movellan,et al.  Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise , 2009, NIPS.

[68]  Concha Bielza,et al.  Bayesian Network Classifiers for Categorizing Cortical GABAergic Interneurons , 2015, Neuroinformatics.

[69]  E M Glaser,et al.  Neuron imaging with Neurolucida--a PC-based system for image combining microscopy. , 1990, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[70]  S. Hestrin,et al.  Cell-type identity: a key to unlocking the function of neocortical circuits , 2009, Current Opinion in Neurobiology.

[71]  H. Markram,et al.  Anatomical, physiological, molecular and circuit properties of nest basket cells in the developing somatosensory cortex. , 2002, Cerebral cortex.

[72]  Y. Kawaguchi,et al.  Physiological, morphological, and histochemical characterization of three classes of interneurons in rat neostriatum , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[73]  Serafín Moral,et al.  Qualitative combination of Bayesian networks , 2003, Int. J. Intell. Syst..

[74]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[75]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[76]  R. Yuste,et al.  Comparison Between Supervised and Unsupervised Classifications of Neuronal Cell Types: A Case Study , 2010, Developmental neurobiology.

[77]  Moritz Helmstaedter,et al.  The relation between dendritic geometry, electrical excitability, and axonal projections of L2/3 interneurons in rat barrel cortex. , 2009, Cerebral cortex.

[78]  Shipeng Yu,et al.  Eliminating Spammers and Ranking Annotators for Crowdsourced Labeling Tasks , 2012, J. Mach. Learn. Res..

[79]  David A. Forsyth,et al.  Utility data annotation with Amazon Mechanical Turk , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[80]  L. Luo,et al.  Representation of the Glomerular Olfactory Map in the Drosophila Brain , 2002, Cell.

[81]  Harold W. Gutch,et al.  Beyond the frontiers of neuronal types , 2012, Front. Neural Circuits.

[82]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[83]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[84]  Moritz Helmstaedter,et al.  L2/3 interneuron groups defined by multiparameter analysis of axonal projection, dendritic geometry, and electrical excitability. , 2009, Cerebral cortex.

[85]  Linda C. van der Gaag,et al.  Multi-dimensional Bayesian Network Classifiers , 2006, Probabilistic Graphical Models.