Semi-automatic Brain Tumor Segmentation by Constrained MRFs Using Structural Trajectories

Quantifying volume and growth of a brain tumor is a primary prognostic measure and hence has received much attention in the medical imaging community. Most methods have sought a fully automatic segmentation, but the variability in shape and appearance of brain tumor has limited their success and further adoption in the clinic. In reaction, we present a semi-automatic brain tumor segmentation framework for multi-channel magnetic resonance (MR) images. This framework does not require prior model construction and only requires manual labels on one automatically selected slice. All other slices are labeled by an iterative multi-label Markov random field optimization with hard constraints. Structural trajectories-the medical image analog to optical flow and 3D image over-segmentation are used to capture pixel correspondences between consecutive slices for pixel labeling. We show robustness and effectiveness through an evaluation on the 2012 MICCAI BRATS Challenge Dataset; our results indicate superior performance to baselines and demonstrate the utility of the constrained MRF formulation.

[1]  Ben Glocker,et al.  Classification Forests for Semantic Segmentation of Brain Lesions in Multi-channel MRI , 2013 .

[2]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[3]  Yanxi Liu,et al.  Computer Vision for Biomedical Image Applications, First International Workshop, CVBIA 2005, Beijing, China, October 21, 2005, Proceedings , 2005, CVBIA.

[4]  Xinjian Chen,et al.  3D automatic anatomy segmentation based on graph cut-oriented active appearance models , 2010, 2010 IEEE International Conference on Image Processing.

[5]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[6]  Andrew Blake,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[7]  Ron Kikinis,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002 , 2002, Lecture Notes in Computer Science.

[8]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[9]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Alan L. Yuille,et al.  Efficient Multilevel Brain Tumor Segmentation With Integrated Bayesian Model Classification , 2008, IEEE Transactions on Medical Imaging.

[11]  Hervé Delingette,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012 , 2012, Lecture Notes in Computer Science.

[12]  Gözde B. Ünal,et al.  Tumor-Cut: Segmentation of Brain Tumors on Contrast Enhanced MR Images for Radiosurgery Applications , 2012, IEEE Transactions on Medical Imaging.

[13]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Jiří Matas,et al.  Computer Vision - ECCV 2004 , 2004, Lecture Notes in Computer Science.

[15]  Guido Gerig,et al.  A brain tumor segmentation framework based on outlier detection , 2004, Medical Image Anal..

[16]  Mark W. Schmidt,et al.  Segmenting Brain Tumors with Conditional Random Fields and Support Vector Machines , 2005, CVBIA.

[17]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[18]  Toshiya Nakaguchi,et al.  Liver Segmentation Approach Using Graph Cuts and Iteratively Estimated Shape and Intensity Constrains , 2012, MICCAI.

[19]  Chenliang Xu,et al.  Evaluation of super-voxel methods for early video processing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Martin Jägersand,et al.  An interactive graph cut method for brain tumor segmentation , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[21]  Sébastien Ourselin,et al.  Robust Registration of Multi-modal Images: Towards Real-Time Clinical Applications , 2002, MICCAI.

[22]  Kurt Keutzer,et al.  Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow , 2010, ECCV.

[23]  Mahesh R. Patel,et al.  Diagnosis and staging of brain tumors. , 2004, Seminars in roentgenology.

[24]  Dewey Odhner,et al.  A system for brain tumor volume estimation via MR imaging and fuzzy connectedness. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[25]  Bjoern H. Menze,et al.  Proceedings of the MICCAI Challenge on Multimodal Brain Tumor Image Segmentation (BRATS) 2012 , 2012 .

[26]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.