Ensembles of Support Vector Data Description for Active Learning Based Annotation of Affective Corpora

The present work aims primary at developing an approach to detect irregular and spontaneous facial gestures in video sequences. The developed approach should help a system distinguish between neutral facial expressions characterized by the absence of facial gestures and facial events characterized by the presence of observable facial gestures in video sequences. For this purpose, an active learning approach is proposed in order to avoid the task of annotating an entire video sequence before proceeding with the classification. It is well known that the annotation task is hard, expensive and error prone. Each video sequence is segmented into smaller segments that are then to be investigated and annotated based on the absence or presence of facial gestures. The approach consists in first selecting a set of samples classified as uncharacteristic through the majority vote of a committee of support vector data description (SVDD) models generated randomly. The base learner then focuses on the selected outliers and not on the whole annotated corpus. Different query strategies are used to select the most informative samples among the selected outliers. Those samples are then annotated by the user and added to a pool of annotated samples. The latter is subsequently used to train the base learner again before the next iteration can take place. Experiments suggest that the proposed active learning approach performs as well as a system trained on a fully annotated corpus, while dramatically reducing the cost of annotation.

[1]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[2]  Aurobinda Routray,et al.  A one-class classification framework using SVDD: Application to an imbalanced geological dataset , 2014, Proceedings of the 2014 IEEE Students' Technology Symposium.

[3]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[4]  Stéphane Ayache,et al.  Evaluation of active learning strategies for video indexing , 2007, Signal Process. Image Commun..

[5]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[6]  Detection of Emotional Events utilizing Support Vector Methods in an Active Learning HCI Scenario , 2014, ERM4HCI '14.

[7]  Daniel McDuff,et al.  Crowdsourcing Techniques for Affective Computing , 2015 .

[8]  Wei-Cheng Chang A Revisit to Support Vector Data Description ( SVDD ) , 2013 .

[9]  Frank Honold,et al.  Multimodal Interaction History and its use in Error Detection and Recovery , 2014, ICMI.

[10]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[11]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[12]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[13]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[14]  Dana Angluin Queries revisited , 2004, Theor. Comput. Sci..

[15]  Chandan Srivastava,et al.  Support Vector Data Description , 2011 .

[16]  Jingrui He,et al.  Analysis of Rare Categories , 2012, Cognitive Technologies.

[17]  Patrick Thiam,et al.  Majority-Class Aware Support Vector Domain Oversampling for Imbalanced Classification Problems , 2014, ANNPR.

[18]  Andrew McCallum,et al.  Toward Optimal Active Learning through Sampling Estimation of Error Reduction , 2001, ICML.

[19]  David A. Cohn,et al.  Training Connectionist Networks with Queries and Selective Sampling , 1989, NIPS.

[20]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[21]  Dana Angluin,et al.  Queries and concept learning , 1988, Machine Learning.

[22]  Shigeo Abe Support Vector Machines for Pattern Classification , 2010, Advances in Pattern Recognition.

[23]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[25]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[26]  Kristen Grauman,et al.  Active Learning of an Action Detector from Untrimmed Videos , 2013, 2013 IEEE International Conference on Computer Vision.