An approach to multimodal biomedical image registration utilizing particle swarm optimization

Biomedical image registration, or geometric alignment of two-dimensional and/or three-dimensional (3D) image data, is becoming increasingly important in diagnosis, treatment planning, functional studies, computer-guided therapies, and in biomedical research. Registration based on intensity values usually requires optimization of some similarity metric between the images. Local optimization techniques frequently fail because functions of these metrics with respect to transformation parameters are generally nonconvex and irregular and, therefore, global methods are often required. In this paper, a new evolutionary approach, particle swarm optimization, is adapted for single-slice 3D-to-3D biomedical image registration. A new hybrid particle swarm technique is proposed that incorporates initial user guidance. Multimodal registrations with initial orientations far from the ground truth were performed on three volumes from different modalities. Results of optimizing the normalized mutual information similarity metric were compared with various evolutionary strategies. The hybrid particle swarm technique produced more accurate registrations than the evolutionary strategies in many cases, with comparable convergence. These results demonstrate that particle swarm approaches, along with evolutionary techniques and local methods, are useful in image registration, and emphasize the need for hybrid approaches for difficult registration problems.

[1]  A. Evans,et al.  MRI simulation-based evaluation of image-processing and classification methods , 1999, IEEE Transactions on Medical Imaging.

[2]  Adel Said Elmaghraby,et al.  The Continuous Tabu Search as an Optimizer for 2D-to-3D Biomedical Image Registration , 2001, MICCAI.

[3]  M. Zanca,et al.  A comparative study of Powell's and Downhill Simplex algorithms for a fast multimodal surface matching in brain imaging. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[4]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[5]  Georgia D. Tourassi,et al.  Similarity metrics based on nonadditive entropies for 2D-3D multimodal biomedical image registration , 2003, SPIE Medical Imaging.

[6]  Terry M. Peters,et al.  Determining Epicardial Surface Motion Using Elastic Registration: Towards Virtual Reality Guidance of Minimally Invasive Cardiac Interventions , 2003, MICCAI.

[7]  P. Suganthan Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[8]  P.M. Shankar,et al.  Non-Rayleigh statistics of ultrasonic backscattered signals , 1994, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[9]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[10]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[11]  Joseph V. Hajnal,et al.  Registration Methodology: Concepts and Algorithms , 2001 .

[12]  Ponnada A Narayana,et al.  Global optimization of mutual information: application to three-dimensional retrospective registration of magnetic resonance images. , 2002, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[13]  Hazim El-Mounayri,et al.  NC end milling optimiza-tion using evolutionary computation , 2002 .

[14]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[15]  A. Cockshott,et al.  Improving the fermentation medium for Echinocandin B production part II: Particle swarm optimization , 2001 .

[16]  Konstantinos E. Parsopoulos,et al.  Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method , 2002 .

[17]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[18]  Derek L. G. Hill,et al.  Registration Methodology: Concepts and Algorithms , 2001 .

[19]  Bostjan Likar,et al.  A hierarchical approach to elastic registration based on mutual information , 2001, Image Vis. Comput..

[20]  Nicholas Ayache,et al.  Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information , 2001, IEEE Transactions on Medical Imaging.

[21]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[22]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[23]  David Atkinson,et al.  A study of the motion and deformation of the heart due to respiration , 2002, IEEE Transactions on Medical Imaging.

[24]  Uwe Pietrzyk Registration of MRI and PET Images for Clinical Applications , 2001 .

[25]  Reto Meuli,et al.  Robust parameter estimation of intensity distributions for brain magnetic resonance images , 1998, IEEE Transactions on Medical Imaging.

[26]  Max A. Viergever,et al.  Mutual information matching in multiresolution contexts , 2001, Image Vis. Comput..

[27]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[28]  L. Christman,et al.  A view to the future. , 1987, Nursing outlook.

[29]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[30]  Christian Roux,et al.  Genetic algorithms for a robust 3-D MR-CT registration , 2000, IEEE Transactions on Information Technology in Biomedicine.

[31]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[32]  Mark Jenkinson,et al.  The role of registration in functional magnetic resonance imaging , 2001 .

[33]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[34]  Joseph V. Hajnal,et al.  Registration of MR and CT Images for Clinical Applications , 2001 .

[35]  Konstantina S. Nikita,et al.  Automatic retinal image registration scheme using global optimization techniques , 1999, IEEE Transactions on Information Technology in Biomedicine.

[36]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[37]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[38]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..