Landmark detection in 2D bioimages for geometric morphometrics: a multi-resolution tree-based approach

The detection of anatomical landmarks in bioimages is a necessary but tedious step for geometric morphometrics studies in many research domains. We propose variants of a multi-resolution tree-based approach to speed-up the detection of landmarks in bioimages. We extensively evaluate our method variants on three different datasets (cephalometric, zebrafish, and drosophila images). We identify the key method parameters (notably the multi-resolution) and report results with respect to human ground truths and existing methods. Our method achieves recognition performances competitive with current existing approaches while being generic and fast. The algorithms are integrated in the open-source Cytomine software and we provide parameter configuration guidelines so that they can be easily exploited by end-users. Finally, datasets are readily available through a Cytomine server to foster future research.

[1]  Robert W. Lucky,et al.  The Grand Challenge , 1993 .

[2]  Stefan Schulte-Merker,et al.  A bone to pick with zebrafish. , 2013, BoneKEy reports.

[3]  D A Kane,et al.  Jaw and branchial arch mutants in zebrafish I: branchial arches. , 1996, Development.

[4]  Almudena Estalrrich,et al.  A geometric morphometrics comparative analysis of Neandertal humeri (epiphyses-fused) from the El Sidrón cave site (Asturias, Spain). , 2015, Journal of human evolution.

[5]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[6]  Raphaël Marée,et al.  Towards generic image classification using tree-based learning: An extensive empirical study , 2016, Pattern Recognit. Lett..

[7]  Horst Bischof,et al.  Global localization of 3D anatomical structures by pre-filtered Hough Forests and discrete optimization , 2013, Medical Image Anal..

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Ken W. Y. Cho,et al.  Combinatorial roles for BMPs and Endothelin 1 in patterning the dorsal-ventral axis of the craniofacial skeleton , 2011, Development.

[10]  Pietro Perona,et al.  Robust Face Landmark Estimation under Occlusion , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Marianne Elias,et al.  Morpho morphometrics: Shared ancestry and selection drive the evolution of wing size and shape in Morpho butterflies , 2016, Evolution; international journal of organic evolution.

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Bostjan Likar,et al.  A Game-Theoretic Framework for Landmark-Based Image Segmentation , 2012, IEEE Transactions on Medical Imaging.

[14]  Mariano Alcañiz Raya,et al.  Automatic Localization of Cephalometric Landmarks , 2001, J. Biomed. Informatics.

[15]  Stefan Schulte-Merker,et al.  Not all bones are created equal - using zebrafish and other teleost species in osteogenesis research. , 2011, Methods in cell biology.

[16]  Chengwen Chu,et al.  Evaluation and Comparison of Anatomical Landmark Detection Methods for Cephalometric X-Ray Images: A Grand Challenge , 2015, IEEE Transactions on Medical Imaging.

[17]  Timothy F. Cootes,et al.  A benchmark for comparison of dental radiography analysis algorithms , 2016, Medical Image Anal..

[18]  Raphaël Marée,et al.  Automated Multimodal Volume Registration based on Supervised 3D Anatomical Landmark Detection , 2017, VISIGRAPP.

[19]  D. Varricchio,et al.  Morphometric Analysis of the Forelimb and Pectoral Girdle of the Cretaceous Ornithopod Dinosaur Oryctodromeus cubicularis and Implications for Digging , 2015 .

[20]  Amandeep Kaur,et al.  Automatic cephalometric landmark detection using Zernike moments and template matching , 2015, Signal Image Video Process..

[21]  C. Zollikofer,et al.  Three-dimensional geometric morphometrics for studying floral shape variation. , 2010, Trends in plant science.

[22]  Paul M. Thompson,et al.  Random forest classification of depression status based on subcortical brain morphometry following electroconvulsive therapy , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[23]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[24]  F. Bookstein,et al.  Morphometric Tools for Landmark Data: Geometry and Biology , 1999 .

[25]  Ching-Wei Wang,et al.  Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms , 2016, Scientific Reports.

[26]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[27]  Linda G. Shapiro,et al.  Automated Detection of 3D Landmarks for the Elimination of Non-Biological Variation in Geometric Morphometric Analyses , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[28]  C. Kimmel,et al.  Specification and morphogenesis of the zebrafish larval head skeleton. , 2001, Developmental biology.

[29]  Louis Wehenkel,et al.  Zebrafish Bone and General Physiology Are Differently Affected by Hormones or Changes in Gravity , 2015, PloS one.

[30]  Laurent D. Cohen,et al.  Automatic Detection and Segmentation of Kidneys in 3D CT Images Using Random Forests , 2012, MICCAI.

[31]  Christian Peter Klingenberg,et al.  Evolution and development of shape: integrating quantitative approaches , 2010, Nature Reviews Genetics.

[32]  Raphaël Marée,et al.  Automatic Localization of Interest Points in Zebrafish Images with Tree-Based Methods , 2011, PRIB.

[33]  Timothy F. Cootes,et al.  Fully Automatic Cephalometric Evaluation using Random Forest Regression-Voting , 2015, ISBI 2015.

[34]  Christian Schlötterer,et al.  Developmental Stability: A Major Role for Cyclin G in Drosophila melanogaster , 2011, PLoS genetics.

[35]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[36]  Gilles Louppe,et al.  Collaborative analysis of multi-gigapixel imaging data using Cytomine , 2016, Bioinform..

[37]  Matthieu Guillaumin,et al.  Incremental Learning of Random Forests for Large-Scale Image Classification , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Raphaël Marée,et al.  Automatic Cephalometric X-Ray Landmark Detection Challenge 2014: A tree-based algorithm , 2014 .

[39]  Christopher. Simons,et al.  Machine learning with Python , 2017 .

[40]  Anja C. Schunke,et al.  Semi-automatic landmark point annotation for geometric morphometrics , 2014, Frontiers in Zoology.

[41]  Thomas Windhausen,et al.  BMP Signaling Regulates Bone Morphogenesis in Zebrafish through Promoting Osteoblast Function as Assessed by Their Nitric Oxide Production , 2015, Molecules.

[42]  Christian Peter Klingenberg,et al.  MORPHOLOGICAL INTEGRATION BETWEEN DEVELOPMENTAL COMPARTMENTS IN THE DROSOPHILA WING , 2000, Evolution; international journal of organic evolution.

[43]  Ioannis Patras,et al.  Sieving Regression Forest Votes for Facial Feature Detection in the Wild , 2013, 2013 IEEE International Conference on Computer Vision.

[44]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[45]  Marc Muller,et al.  RUNX3, EGR1 and SOX9B Form a Regulatory Cascade Required to Modulate BMP-Signaling during Cranial Cartilage Development in Zebrafish , 2012, PloS one.

[46]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[47]  Marc Muller,et al.  Fgf receptors Fgfr1a and Fgfr2 control the function of pharyngeal endoderm in late cranial cartilage development. , 2013, Differentiation; research in biological diversity.

[48]  Paul A. Bromiley,et al.  Robust and Accurate Shape Model Matching Using Random Forest Regression-Voting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.