Social- and Interactive-Television Applications Based on Real-Time Ambient-Audio Identification

This paper describes mass personalization, a framework for combining mass media with a highly personalized Web-based experience. We introduce four applications for mass personalization: personalized content layers, ad hoc social communities, real-time popularity ratings and virtual media library services. Using the ambient audio originating from the television, the four applications are available with no more effort than simple television channel surfing. Our audio identification system does not use dedicated interactive TV hardware and does not compromise the user’s privacy. Feasibility tests of the proposed applications are provided both with controlled conversational interference and with “living-room” evaluations.

[1]  Mark S. Ackerman,et al.  Personal and Ubiquitous Computing , 2004, Personal and Ubiquitous Computing.

[2]  Pattie Maes,et al.  Just-in-time information retrieval agents , 2000, IBM Syst. J..

[3]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[4]  A. Korhonen,et al.  Large Scale Analysis of Verb Subcategorization differences between Child Directed Speech and Adult Speech , .

[5]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[6]  Monika Henzinger,et al.  Query-Free News Search , 2003, WWW '03.

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Derek Hoiem,et al.  Computer vision for music identification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Francine Chen,et al.  A trainable document summarizer , 1995, SIGIR '95.

[10]  Eric Horvitz,et al.  Collaborative filtering by personality diagnosis , 2000, UAI 2000.

[11]  James A. Landay,et al.  A Context/Communication Information Agent , 2001, Personal and Ubiquitous Computing.