Formalizing the Problem of Music Description

The lack of a formalism for “the problem of music description” results in, among other things: ambiguity in what problem a music description system must address, how it should be evaluated, what criteria define its success, and the paradox that a music description system can reproduce the “ground truth” of a music dataset without attending to the music it contains. To address these issues, we formalize the problem of music description such that all elements of an instance of it are made explicit. This can thus inform the building of a system, and how it should be evaluated in a meaningful way. We provide illustrations of this formalism applied to three examples drawn from the literature.

[1]  Zhouyu Fu,et al.  A Survey of Audio-Based Music Classification and Annotation , 2011, IEEE Transactions on Multimedia.

[2]  Bob L. Sturm.  Making Explicit the Formalism Underlying Evaluation in Music Information Retrieval Research: A Look at the MIREX Automatic Mood Classification Task , 2013, CMMR.

[3]  Gerhard Widmer,et al.  Improvements of Audio-Based Music Similarity and Genre Classificaton , 2005, ISMIR.

[4]  Elias Pampalk,et al.  Introduction–From Genres to Tags: A Little Epistemology of Music Information Retrieval Research , 2008 .

[5]  R. A. Bailey,et al.  Design of comparative experiments , 2008 .

[6]  A. W. Kimball,et al.  Errors of the Third Kind in Statistical Consulting , 1957 .

[7]  Bob L. Sturm.  A Simple Method to Determine if a Music Information Retrieval System is a “Horse” , 2014, IEEE Transactions on Multimedia.

[8]  Julián Urbano Merino,et al.  Evaluation in audio music similarity , 2013 .

[9]  Alessandro L. Koerich,et al.  The Latin Music Database , 2008, ISMIR.

[10]  György Fazekas,et al.  Multidisciplinary Perspectives on Music Emotion Recognition: Implications for Content and Context-Based Models , 2012 .

[11]  Thierry Bertin-Mahieux,et al.  Automatic Tagging of Audio: The State-of-the-Art , 2011 .

[12]  Thierry Bertin-Mahieux,et al.  The Million Song Dataset , 2011, ISMIR.

[13]  P. Gács,et al.  Algorithms , 1992 .

[14]  Geraint A. Wiggins.  Semantic Gap?? Schemantic Schmap!! Methodological Considerations in the Scientific Study of Music , 2009, 2009 11th IEEE International Symposium on Multimedia.

[15]  Gert R. G. Lanckriet,et al.  Semantic Annotation and Retrieval of Music and Sound Effects , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[16]  Roger B. Dannenberg,et al.  TagATune: A Game for Music and Sound Annotation , 2007, ISMIR.

[17]  Arthur Flexer,et al.  Statistical evaluation of music information retrieval experiments , 2006 .

[18]  J. Stephen Downie,et al.  Ten Years of ISMIR: Reflections on Challenges and Opportunities , 2009, ISMIR.

[19]  Bob L. Sturm.  The State of the Art Ten Years After a State of the Art: Future Research in Music Information Retrieval , 2013, ArXiv.

[20]  Geraint A. Wiggins,et al.  How Many Beans Make Five? The Consensus Problem in Music-Genre Classification and a New Evaluation Method for Single-Genre Categorisation Systems , 2007, ISMIR.

[21]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[22]  David S. Watson,et al.  A Machine Learning Approach to Musical Style Recognition , 1997, ICMC.

[23]  Edward R. Dougherty,et al.  Scientific knowledge is possible with small-sample classification , 2013, EURASIP J. Bioinform. Syst. Biol..

[24]  Xavier Serra,et al.  Evaluation in Music Information Retrieval , 2013, Journal of Intelligent Information Systems.

[25]  Homer H. Chen,et al.  Music Emotion Recognition , 2011 .

[26]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[27]  George Tzanetakis,et al.  Musical genre classification of audio signals , 2002, IEEE Trans. Speech Audio Process..