MLHN: A Hypernetwork Model for Multi-Label Classification

Multi-label classification has attracted significant attentions in machine learning. In multi-label classification, exploiting correlations among labels is an essential but nontrivial task. First, labels may be correlated in various degrees. Second, the scalability may suffer from the large number of labels, because the number of combinations among labels grows exponentially as the number of labels increases. In this paper, a multi-label hypernetwork (MLHN) is proposed to deal with these problems. By extending the traditional hypernetwork model, MLHN can represent arbitrary order correlations among labels. The classification model of MLHN is simple and the computational complexity of MLHN is linear with respect to the number of labels, which contribute to the good scalability of MLHN. We perform experiments on a variety of datasets. The results illustrate that the proposed MLHN achieves competitive performances against state-of-the-art multi-label classification algorithms in terms of both effectiveness and scalability with respect to the number of labels.

[1]  Eyke Hüllermeier,et al.  Multilabel classification via calibrated label ranking , 2008, Machine Learning.

[2]  Byoung-Tak Zhang,et al.  A molecular evolutionary algorithm for learning hypernetworks on simulated DNA computers , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[3]  Byoung-Tak Zhang,et al.  Evolving hypernetwork classifiers for microRNA expression profile analysis , 2007, 2007 IEEE Congress on Evolutionary Computation.

[4]  Sunita Sarawagi,et al.  Discriminative Methods for Multi-labeled Classification , 2004, PAKDD.

[5]  Byoung-Tak Zhang,et al.  Evolving hypernetworks for pattern classification , 2007, 2007 IEEE Congress on Evolutionary Computation.

[6]  Chin-Hui Lee,et al.  A MFoM learning approach to robust multiclass multi-label text categorization , 2004, ICML.

[7]  Yang Wang,et al.  High-Order Pattern Discovery from Discrete-Valued Data , 1997, IEEE Trans. Knowl. Data Eng..

[8]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[9]  Lei Wu,et al.  Lift: Multi-Label Learning with Label-Specific Features , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.

[11]  Yang Song,et al.  A sparse gaussian processes classification framework for fast tag suggestions , 2008, CIKM '08.

[12]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[13]  Shie-Jue Lee,et al.  FSKNN: Multi-label text categorization based on fuzzy similarity and k nearest neighbors , 2012, Expert Syst. Appl..

[14]  Byoung-Tak Zhang,et al.  Evolutionary layered hypernetworks for identifying microRNA-mRNA regulatory modules , 2010, IEEE Congress on Evolutionary Computation.

[15]  Byoung-Tak Zhang,et al.  Hypernetworks: A Molecular Evolutionary Architecture for Cognitive Learning and Memory , 2008, IEEE Computational Intelligence Magazine.

[16]  Grigorios Tsoumakas,et al.  MULAN: A Java Library for Multi-Label Learning , 2011, J. Mach. Learn. Res..

[17]  Amanda Clare,et al.  Knowledge Discovery in Multi-label Phenotype Data , 2001, PKDD.

[18]  Shie-Jue Lee,et al.  Multilabel Text Categorization Based on Fuzzy Relevance Clustering , 2014, IEEE Transactions on Fuzzy Systems.

[19]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[20]  Grigorios Tsoumakas,et al.  Random K-labelsets for Multilabel Classification , 2022 .

[21]  Byoung-Tak Zhang,et al.  Evolutionary concept learning from cartoon videos by multimodal hypernetworks , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Zhi-Hua Zhou,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006, IEEE Transactions on Knowledge and Data Engineering.

[23]  Byoung-Tak Zhang,et al.  Mutual information-based evolution of hypernetworks for brain data analysis , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[24]  Grigorios Tsoumakas,et al.  Multilabel Text Classification for Automated Tag Suggestion , 2008 .

[25]  Kun Zhang,et al.  Multi-label learning by exploiting label dependency , 2010, KDD.

[26]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[27]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[28]  Jin Wang,et al.  Ensemble of Cost-Sensitive Hypernetworks for Class-Imbalance Learning , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.