EEG Beta Range Dynamics and Emotional Judgments of Face and Voices

The purpose of this study is to clarify multi-modal brain processing related to human emotional judgment. This study aimed to induce a controlled perturbation in the emotional system of the brain by multi-modal stimuli, and to investigate whether such emotional stimuli could induce reproducible and consistent changes in the brain dynamics. As we were especially interested in the temporal dynamics of the brain responses, we studied EEG signals. We exposed twelve subjects to auditory, visual, or combined audio-visual stimuli. Audio stimuli consisted of voice recordings of the Japanese word ‘arigato’ (thank you) pronounced with three different intonations (Angry A, Happy H or Neutral N). Visual stimuli consisted of faces of women expressing the same emotional valences (A, H or N). Audio-visual stimuli were composed using either congruent combinations of faces and voices (e.g. H x H) or non-congruent (e.g. A x H). The data was collected with a 32-channel Biosemi EEG system. We report here significant changes in EEG power and topographies between those conditions. The obtained results demonstrate that EEG could be used as a tool to investigate emotional valence and discriminate various emotions.

[1]  A. Young,et al.  Task instructions modulate neural responses to fearful facial expressions , 2003, Biological Psychiatry.

[2]  Charles Spence,et al.  Is visual dominance modulated by the threat value of visual and auditory stimuli? , 2009, Experimental Brain Research.

[3]  Á. Pascual-Leone,et al.  Reciprocal modulation and attenuation in the prefrontal cortex: An fMRI study on emotional–cognitive interaction , 2004, Human brain mapping.

[4]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[5]  Andrzej Cichocki,et al.  Neurodynamics of Emotional Judgments in the Human Brain , 2016, IJCCI.

[6]  Julie Grèzes,et al.  Human and animal sounds influence recognition of body language , 2008, Brain Research.

[7]  Simon J Graham,et al.  An fMRI study investigating cognitive modulation of brain regions associated with emotional processing of visual stimuli , 2003, Neuropsychologia.

[8]  M. Pell,et al.  Seeing Emotion with Your Ears: Emotional Prosody Implicitly Guides Visual Attention to Faces , 2012, PloS one.

[9]  K. Nakamura,et al.  Activation of the right inferior frontal cortex during assessment of facial emotion. , 1999, Journal of neurophysiology.

[10]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[11]  Peter Boesiger,et al.  Segregated neural representation of distinct emotion dimensions in the prefrontal cortex—an fMRI study , 2006, NeuroImage.

[12]  R. Adolphs,et al.  Emotion and consciousness , 2007, Trends in Cognitive Sciences.

[13]  J. Gabrieli,et al.  Rethinking Feelings: An fMRI Study of the Cognitive Regulation of Emotion , 2002, Journal of Cognitive Neuroscience.