Decision templates for the classification of bioacoustic time series

Abstract Time series classification based on decision templates is the topic of this paper. The decision templates are built over several local feature vectors which are extracted from local time windows of the time series. To learn characteristic classifier outputs a set of decision templates is determined for each class. In the classification phase class memberships based on the decision templates and the classifier outputs are calculated. These class memberships are combined to compute the final classification result. We present algorithms to calculate multiple decision templates per class, and demonstrate their behaviour on two data sets, a synthetic data set, and a data set derived from a real world pattern recognition problem, the classification of bioacoustic time series. The fuzzy- k -nearest neighbour classifier is utilized as base classifier for both data sets.

[1]  Yoav Freund,et al.  Boosting a weak learning algorithm by majority , 1995, COLT '90.

[2]  Kagan Tumer,et al.  Input Decimation Ensembles: Decorrelation through Dimensionality Reduction , 2001, Multiple Classifier Systems.

[3]  Ludmila I. Kuncheva,et al.  Multiple Classifier Systems , 2004 .

[4]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[5]  Ludmila I. Kuncheva,et al.  Using measures of similarity and inclusion for multiple classifier fusion by decision templates , 2001, Fuzzy Sets Syst..

[6]  Tin Kam Ho Data Complexity Analysis for Classifier Combination , 2001, Multiple Classifier Systems.

[7]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[8]  Robert P. W. Duin,et al.  Is independence good for combining classifiers? , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[9]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[10]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[11]  Ludmila I. Kuncheva,et al.  Relationships between combination methods and measures of diversity in combining classifiers , 2002, Inf. Fusion.

[12]  Ludmila I. Kuncheva,et al.  Feature Subsets for Classifier Combination: An Enumerative Experiment , 2001, Multiple Classifier Systems.

[13]  Robert P. W. Duin,et al.  Combining One-Class Classifiers , 2001, Multiple Classifier Systems.

[14]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[15]  Lawrence R. Rabiner,et al.  An algorithm for determining the endpoints of isolated utterances , 1975, Bell Syst. Tech. J..

[16]  Günther Palm,et al.  Classification of Time Series Utilizing Temporal and Decision Fusion , 2001, Multiple Classifier Systems.

[17]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[18]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Derek Partridge,et al.  Diversity between Neural Networks and Decision Trees for Building Multiple Classifier Systems , 2000, Multiple Classifier Systems.