Correlation between stimulated emotion extracted from EEG and its manifestation on facial expression

Determining correlation between aroused emotion and its manifestation on facial expression, voice, gesture and posture have interesting applications in psychotherapy. A set of audiovisual stimulus, selected by a group of experts, is used to excite emotion of the subjects. EEG and facial expression of the subjects excited by the selected audio-visual stimulus are collected, and the nonlinear-correlation from EEG to facial expression, and vice-versa is obtained by employing feed-forward neural network trained with back-propagation algorithm. Experiments undertaken reveals that the trained network can reproduce the correlated EEG-facial expression trained instances with 100 % accuracy, and is also able to predict facial expression (EEG) from unknown EEG (facial expression) of the same subject with an accuracy of around 95.2%.

[1]  Ganesh K. Venayagamoorthy,et al.  Recognition of facial expressions using Gabor wavelets and learning vector quantization , 2008, Eng. Appl. Artif. Intell..

[2]  Qing Zhang,et al.  Analysis of positive and negative emotions in natural scene using brain activity and GIST , 2009, Neurocomputing.

[3]  Amit Konar,et al.  Emotional Intelligence: A Cybernetic Approach (Studies in Computational Intelligence) , 2008 .

[4]  Amit Konar,et al.  Emotional Intelligence: A Cybernetic Approach , 2009, Studies in Computational Intelligence.

[5]  Amit Konar,et al.  Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Amit Konar,et al.  A recurrent neural model for parameter estimation of mixed emotions from facial expressions of the subjects , 2009, 2009 International Joint Conference on Neural Networks.

[7]  G Rippon Individual differences in electrodermal and electroencephalographic asymmetries. , 1990, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  A. Ben-Ze'ev The Subtlety of Emotions , 2000 .

[9]  R. Gunderman,et al.  Emotional intelligence. , 2011, Journal of the American College of Radiology : JACR.