Individual Classification of Emotions Using EEG

Many studies suggest that EEG signals provide enough information for the detection of human emotions with feature based classification methods. However, very few studies have reported a classification method that reliably works for individual participants (classification accuracy well over 90%). Further, a necessary condition for real life applications is a method that allows, irrespective of the immense individual difference among participants, to have minimal variance over the individual classification accuracy. We conducted offline computer aided emotion classification experiments using strict experimental controls. We analyzed EEG data collected from nine participants using validated film clips to induce four different emotional states (amused, disgusted, sad and neutral). The classification rate was evaluated using both unsupervised and supervised learning algorithms (in total seven “state of the art” algorithms were tested). The largest classification accuracy was computed by means of Support Vector Machine. Accuracy rate was on average 97.2%. The experimental protocol effectiveness was further supported by very small variance among individual participants’ classification accuracy (within interval: 96.7%, 98.3%). Classification accuracy evaluated on reduced number of electrodes suggested, consistently with psychological constructionist approaches, that we were able to classify emotions considering cortical activity from areas involved in emotion representation. The experimental protocol therefore appeared to be a key factor to improve the classification outcome by means of data quality improvements.

[1]  E. Rolls,et al.  The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology , 2004, Progress in Neurobiology.

[2]  John J. B. Allen,et al.  Voluntary facial expression and hemispheric asymmetry over the frontal cortex. , 2001, Psychophysiology.

[3]  Thierry Pun,et al.  Valence-arousal evaluation using physiological signals in an emotion recall paradigm , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[4]  B. Mesquita,et al.  The experience of emotion. , 2007, Annual review of psychology.

[5]  R. Levenson Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. , 1988 .

[6]  H. Burroughs,et al.  Managing Indoor Air Quality , 2020 .

[7]  A. Manstead,et al.  Social context effects on facial activity in a negative emotional setting. , 2001, Emotion.

[8]  I. Knez Effects of indoor lighting on mood and cognition , 1995 .

[9]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[10]  J. Gross,et al.  Relations between Affect and Personality: Support for the Affect-Level and Affective-Reactivity Views , 1998 .

[11]  S. Rauch,et al.  Neurobiology of emotion perception I: the neural basis of normal emotion perception , 2003, Biological Psychiatry.

[12]  Jeffrey B. Henriques,et al.  Resting frontal brain asymmetry predicts affective responses to films. , 1990, Journal of personality and social psychology.

[13]  Olga Sourina,et al.  Real-Time EEG-Based Human Emotion Recognition and Visualization , 2010, 2010 International Conference on Cyberworlds.

[14]  John E. Flynn,et al.  The Effects of Light Source Color on User Impression and Satisfaction , 1977 .

[15]  P. Ekman,et al.  Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology. I. , 1990, Journal of personality and social psychology.

[16]  Con Stough,et al.  Assessing Emotional Intelligence , 2009 .

[17]  Kai Keng Ang,et al.  EEG-based Emotion Recognition Using Self-Organizing Map for Boundary Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[18]  A. Isen,et al.  Positive Affect Facilitates Integration of Information and Decreases Anchoring in Reasoning among Physicians , 1997 .

[19]  J. Russell A circumplex model of affect. , 1980 .

[20]  C. Anderson,et al.  Hot Temperatures, Hostile Affect, Hostile Cognition, and Arousal: Tests of a General Model of Affective Aggression , 1995 .

[21]  P. Ekman,et al.  A new pan-cultural facial expression of emotion , 1986 .

[22]  Zahra Khalili,et al.  Emotion recognition system using brain and peripheral signals: Using correlation dimension to improve the results of EEG , 2009, 2009 International Joint Conference on Neural Networks.

[23]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[24]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[25]  P. Philippot Inducing and assessing differentiated emotion-feeling states in the laboratory. , 1993, Cognition & emotion.

[26]  Sazali Yaacob,et al.  Asymmetric ratio and FCM based salient channel selection for human emotion detection using EEG , 2008 .

[27]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[28]  J. Malouff,et al.  Development and validation of a measure of emotional intelligence. , 1998 .

[29]  A. Schaefer,et al.  Please Scroll down for Article Cognition & Emotion Assessing the Effectiveness of a Large Database of Emotion-eliciting Films: a New Tool for Emotion Researchers , 2022 .

[30]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[31]  P. Tetlock,et al.  Accounting for the effects of accountability. , 1999, Psychological bulletin.

[32]  D. Lindsley,et al.  Chapter 1 – The Electroencephalogram: Autonomous Electrical Activity in Man and Animals , 1974 .

[33]  Hideo Kusaka,et al.  Psychophysical Analysis of the “Sensation of Reality” Induced by a Visual Wide-Field Display , 1980 .

[34]  Navjot Bhullar,et al.  The Assessing Emotions Scale. , 2009 .

[35]  Alan J. Fridlund,et al.  Audience effects in affective imagery: Replication and extension to dysphoric imagery , 1992 .

[36]  Wijnand A. IJsselsteijn,et al.  How affective technologies can influence intimate interactions and improve social connectedness , 2014, Int. J. Hum. Comput. Stud..

[37]  T. Paus,et al.  Functional connectivity of the anterior cingulate cortex within the human frontal lobe: a brain-mapping meta-analysis , 2000, Experimental Brain Research.

[38]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[39]  Sonja A. Kotz,et al.  Recognizing Emotions in a Foreign Language , 2009 .

[40]  L. F. Barrett Discrete Emotions or Dimensions? The Role of Valence Focus and Arousal Focus , 1998 .

[41]  Mark H. Davis The effects of dispositional empathy on emotional reactions and helping: A multidimensional approach , 1983 .

[42]  R. E. Wheeler,et al.  Frontal brain asymmetry and emotional reactivity: a biological substrate of affective style. , 2007, Psychophysiology.

[43]  Thierry Pun,et al.  A channel selection method for EEG classification in emotion assessment based on synchronization likelihood , 2007, 2007 15th European Signal Processing Conference.