Engaging Users in Audio Labelling as a Movie Browsing Game with a Purpose

Nowadays, movies, video, audio and games have a strong presence in human life, being a massive source of entertainment. Increasingly, movies and videos are becoming accessible as enormous collections over the Internet, in social media and interactive TV, demanding for more powerful ways to search, browse and view them, that benefit from video content-based analysis and classification techniques. From the point of view of the content-based analysis methods, a challenging aspect is the constitution of collections of labelled data. Inspired by the Game With A Purpose approach we propose SoundsLike, a game that pursues two goals: 1) entertaining the user in movie browsing; 2) use this interaction to collect data and improve our content-based sound analysis techniques. SoundsLike is integrated in MovieClouds, an interactive web application designed to access, explore and visualize movies based on the information conveyed in the different tracks or perspectives of its content.

[1]  Roger B. Dannenberg,et al.  TagATune: A Game for Music and Sound Annotation , 2007, ISMIR.

[2]  Michael Burmester,et al.  Hedonic and ergonomic quality aspects determine a software's appeal , 2000, CHI.

[3]  Min Chen,et al.  Video visualization , 2003 .

[4]  Dalia Cohen,et al.  Rhythmic Patterns Reflecting Cognitive Constraints and Aesthetic Ideals , 2008 .

[5]  Daniel P. W. Ellis,et al.  Please Scroll down for Article Journal of New Music Research a Web-based Game for Collecting Music Metadata a Web-based Game for Collecting Music Metadata , 2022 .

[6]  Alexander G. Hauptmann Lessons for the Future from a Decade of Informedia Video Analysis Research , 2005, CIVR.

[7]  Manuel Blum,et al.  Verbosity: a game for collecting common-sense facts , 2006, CHI.

[8]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.

[9]  Rilla Khaled,et al.  Itʼs Not Just Whether You Win or Lose: Thoughts on Gamification and Culture , 2011 .

[10]  Gert R. G. Lanckriet,et al.  User-centered design of a social game to tag music , 2009, HCOMP '09.

[11]  Nuno Silva,et al.  Going Through the Clouds: Search Overviews and Browsing of Movies , 2012, MindTrek.

[12]  Eva Oliveira,et al.  VIRUS: video information retrieval using subtitles , 2010, MindTrek.

[13]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[14]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[15]  Gert R. G. Lanckriet,et al.  A Game-Based Approach for Collecting Semantic Annotations of Music , 2007, ISMIR.

[16]  Marisa E. Campbell CHI 2004 , 2004, INTR.

[17]  Ioannis Stamelos,et al.  A methodology on extracting reusable software candidate components from open source games , 2012, MindTrek.