A new approach for multi-label classification based on default hierarchies and organizational learning

Learning Classifier Systems (LCSs) are a class of expert systems that use a knowledge base of decision rules and a genetic algorithm (GA) [9] as a discovery mechanism. The set of decision rules allows the LCS to represent and learn control strategies, while the robust search ability of the GA allows it to search for new rules based on the performance of existing rules. LCS were first designed to solve machine learning problems, especially classification problems. Classification problems are problems where instances of a data set belong to a set of classes, and the system needs to infer, based on past experience, the correct class (or classes) of new, previously unseen, instances. However, the features of LCSs are also very useful for solving reinforcement learning problems, a class of problems where the system should learn to operate in the environment based only on performance feedback. This paper considers LCSs as an approach to classification problems, more specifically a more complex kind of classification called multi-label classification. This paper analyses the default hierarchy formation theory presented by [14] as a way of favoring the hierarchical arrangement of rules, and also the organizational learning theory [17] for adjusting the degree of individual and collective behaviors. We suggest a new method, combining both organizational learning and default hierarchy formation, for solving multi-label problems. The preliminary results with a simple multi-label problem show the potential of this method. Final discussion presents the conclusions and directions for further research.

[1]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[2]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[3]  John H. Holland,et al.  COGNITIVE SYSTEMS BASED ON ADAPTIVE ALGORITHMS1 , 1978 .

[4]  Xavier Llorà,et al.  Multiobjective Learning Classifier Systems : An Overview , 2005 .

[5]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[6]  Jaume Bacardit,et al.  Bloat Control and Generalization Pressure Using the Minimum Description Length Principle for a Pittsburgh Approach Learning Classifier System , 2005, IWLCS.

[7]  Sandip Sen,et al.  Newboole: A Fast GBML System , 1990, ML.

[8]  R. Coase,et al.  The Firm, the Market, and the Law , 1990 .

[9]  Jason R. Wilcox,et al.  Organizational Learning Within A Learning Classifier System , 1995 .

[10]  Xavier Llorà,et al.  The compact classifier system: scalability analysis and first results , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  Zhi-Hua Zhou,et al.  A k-nearest neighbor based algorithm for multi-label classification , 2005, 2005 IEEE International Conference on Granular Computing.

[12]  Alessandro Sperduti,et al.  Speeding up the solution of multilabel problems with Support Vector Machines , 2003 .

[13]  Alex Alves Freitas,et al.  A new ant colony algorithm for multi-label classification with applications in bioinfomatics , 2006, GECCO.

[14]  David E. Goldberg,et al.  Reinforcement learning with classifier systems: Adaptive default hierarchy formation , 1992, Appl. Artif. Intell..

[15]  Jerry M. Mendel,et al.  Adaptive, learning, and pattern recognition systems : theory and applications , 1970 .

[16]  Jerry M. Mendel,et al.  Reinforcement-learning control and pattern recognition systems , 1994 .

[17]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[18]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.