Automated Multimodal Volume Registration based on Supervised 3D Anatomical Landmark Detection

We propose a new method for automatic 3D multimodal registration based on anatomical landmark detection. Landmark detectors are learned independantly in the two imaging modalities using Extremely Randomized Trees and multi-resolution voxel windows. A least-squares fitting algorithm is then used for rigid registration based on the landmark positions as predicted by these detectors in the two imaging modalities. Experiments are carried out with this method on a dataset of pelvis CT and CBCT scans related to 45 patients. On this dataset, our fully automatic approach yields results very competitive with respect to a manually assisted stateof-the-art rigid registration algorithm.

[1]  Raphaël Marée,et al.  Automatic Localization of Interest Points in Zebrafish Images with Tree-Based Methods , 2011, PRIB.

[2]  Jatinder R. Palta,et al.  An image quality comparison study between XVI and OBI CBCT systems , 2011, Journal of applied clinical medical physics.

[3]  P. V. Lukashevich,et al.  Medical image registration based on SURF detector , 2011, Pattern Recognition and Image Analysis.

[4]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Chengwen Chu,et al.  Evaluation and Comparison of Anatomical Landmark Detection Methods for Cephalometric X-Ray Images: A Grand Challenge , 2015, IEEE Transactions on Medical Imaging.

[6]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[7]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[8]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[9]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[10]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[11]  Luc Van Gool,et al.  Random Forests for Real Time 3D Face Analysis , 2012, International Journal of Computer Vision.

[12]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[13]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[14]  Linda G. Shapiro,et al.  Automated Detection of 3D Landmarks for the Elimination of Non-Biological Variation in Geometric Morphometric Analyses , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.