An Improved Multi-task Learning Approach with Applications in Medical Diagnosis

We propose a family of multi-task learning algorithms for collaborative computer aided diagnosis which aims to diagnose multiple clinically-related abnormal structures from medical images. Our formulations eliminate features irrelevant to all tasks, and identify discriminative features for each of the tasks. A probabilistic model is derived to justify the proposed learning formulations. By equivalence proof, some existing regularization-based methods can also be interpreted by our probabilistic model as imposing a Wishart hyperprior. Convergence analysis highlights the conditions under which the formulations achieve convexity and global convergence. Two real-world medical problems: lung cancer prognosis and heart wall motion analysis, are used to validate the proposed algorithms.

[1]  S. Armato,et al.  Automated detection of lung nodules in CT scans: preliminary results. , 2001, Medical physics.

[2]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[3]  Michael I. Jordan,et al.  Multi-task feature selection , 2006 .

[4]  Daniel A. Keim,et al.  On Knowledge Discovery and Data Mining , 1997 .

[5]  Pat Langley,et al.  Editorial: On Machine Learning , 1986, Machine Learning.

[6]  Tong Zhang,et al.  A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , 2005, J. Mach. Learn. Res..

[7]  Tommi S. Jaakkola,et al.  Maximum-Margin Matrix Factorization , 2004, NIPS.

[8]  Jinbo Bi,et al.  Probabilistic Joint Feature Selection for Multi-task Learning , 2007, SDM.

[9]  Tom Heskes,et al.  Empirical Bayes for Learning to Learn , 2000, ICML.

[10]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[11]  Anton Schwaighofer,et al.  Learning Gaussian processes from multiple tasks , 2005, ICML.

[12]  James C. Bezdek,et al.  Some Notes on Alternating Optimization , 2002, AFSS.

[13]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[14]  Michio Sugeno,et al.  Advances in Soft Computing — AFSS 2002 , 2002, Lecture Notes in Computer Science.

[15]  Tony Jebara,et al.  Multi-task feature and kernel selection for SVMs , 2004, ICML.

[16]  Jinbo Bi,et al.  LungCAD: a clinically approved, machine learning system for lung cancer detection , 2007, KDD '07.

[17]  Lior Wolf,et al.  Feature selection for unsupervised and supervised inference: the emergence of sparsity in a weighted-based approach , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  James C. Bezdek,et al.  Convergence of Alternating Optimization , 2003, Neural Parallel Sci. Comput..

[19]  Kenji Suzuki,et al.  Radiologic classification of small adenocarcinoma of the lung: radiologic-pathologic correlation and its prognostic impact. , 2006, The Annals of thoracic surgery.

[20]  J Roehrig,et al.  The promise of computer aided detection in digital mammography. , 1999, European journal of radiology.