Going Through the Clouds: Search Overviews and Browsing of Movies

Movies are one of the biggest sources of entertainment, in individual and social contexts, and increasingly accessible as enormous collections of videos and movies over the Internet, in social media and interactive TV. These richer environments demand for new and more powerful ways to search, browse and view videos and movies, that may benefit from video content-based analysis and classification techniques. In this paper, we present and evaluate extended features of content processing, search, overview and browsing in the MovieClouds, from overview clouds at the movies space down to the movies, based on the information conveyed in the different tracks or perspectives of its content, especially audio and subtitles where most of the semantics is expressed. Tag clouds are adopted as a unifying-paradigm, complemented with other approaches, to extend to movies the power, flexibility, engagement and fun usually associated with clouds, in a consistent way. Evaluation results were very encouraging, reinforcing the previous approach and reflecting the improvements and new features.

[1]  Min Chen,et al.  Video visualization , 2003 .

[2]  Martin Wattenberg,et al.  TIMELINESTag clouds and the case for vernacular visualization , 2008, INTR.

[3]  Hsin-Min Wang,et al.  Colorizing tags in tag cloud: a novel query-by-tag music search system , 2011, ACM Multimedia.

[4]  Guy J. Brown,et al.  Computational Auditory Scene Analysis: Principles, Algorithms, and Applications , 2006 .

[5]  Pedro Martins,et al.  Being Happy, Healthy and Whole Watching Movies That Affect Our Emotions , 2011, ACII.

[6]  Alexander G. Hauptmann Lessons for the Future from a Decade of Informedia Video Analysis Research , 2005, CIVR.

[7]  Roger Wattenhofer,et al.  Social audio features for advanced music retrieval interfaces , 2010, ACM Multimedia.

[8]  Tao Li,et al.  Detecting emotion in music , 2003, ISMIR.

[9]  David M. Nichols,et al.  How people find videos , 2008, JCDL '08.

[10]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[11]  Ya-Xi Chen,et al.  Exploratory browsing: enhancing the browsing experience with media collections , 2010 .

[12]  Eva Oliveira,et al.  Towards Emotional Interaction: Using Movies to Automatically Learn Users' Emotional States , 2011, INTERACT.

[13]  Fabio Vignoli,et al.  Visual Playlist Generation on the Artist Map , 2005, ISMIR.

[14]  Christopher Ahlberg,et al.  Tight Coupling: Guiding User Actions in a Direct Manipulation Retrieval System , 1995, BCS HCI.

[15]  Mohan S. Kankanhalli,et al.  Audio Based Event Detection for Multimedia Surveillance , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[16]  Steffen Lohmann,et al.  Comparison of Tag Cloud Layouts: Task-Related Performance and Visual Exploration , 2009, INTERACT.

[17]  Eva Oliveira,et al.  VIRUS: video information retrieval using subtitles , 2010, MindTrek.

[18]  C.-C. Jay Kuo,et al.  Environmental sound recognition using MP-based features , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Kam-Fai Wong,et al.  Interpreting TF-IDF term weights as making relevance decisions , 2008, TOIS.

[20]  Michael Burmester,et al.  Hedonic and ergonomic quality aspects determine a software's appeal , 2000, CHI.

[21]  Pedro Martins,et al.  MovieClouds: content-based overviews and exploratory browsing of movies , 2011, MindTrek.

[22]  Gonçalo Marques,et al.  A Music Classification Method based on Timbral Features , 2009, ISMIR.

[23]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[24]  Stathes Hadjiefthymiades,et al.  Semantic Video Classification Based on Subtitles and Domain Terminologies , 2007, KAMC.