Neural Mechanisms of Social Emotion Perception: An EEG Hyper-Scanning Study

EEG-based hyper-scanning refers to two or more subjects engaged in a task together or performing the same action together while neurophysiological signals are simultaneously recorded from them. This is one of the manners for investigating between-subject neural activities involved in social interactions. Emotion perception plays an important role in human social interactions. Interaction and emotional state influence each other. In this study, we aim to investigate how between-subject interaction modulates emotion perception based on event related potentials (ERPs), connectivity analysis and classification analysis. We found that there are distinct differences appearing between paired subjects who performed the task together, which are early ERP components (N250 and N400), late ERP components (P1500 and N1500), and the greater amplitude in N250 for the seconding responding subject compared to the first one. In the exploration of connectivity using phase locking value (PLV), we found that there are significant differences among different frequency bands for each subject under positive and negative stimuli and the significant difference of hyper-connectivity existed in the gamma frequency band between positive and negative stimulus trials. In the classification analysis, we compared the hyper-features for two individual subjects separately, the performance was improved when hyper-features of the PLV was employed compared to the features of power spectrum density.

[1]  Mukesh Dhamala,et al.  Hyperscanning : Simultaneous fMRI during Linked Social Interactions , 2001 .

[2]  Yong Peng,et al.  EEG-based emotion recognition using discriminative graph regularized extreme learning machine , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[3]  Xu Cui,et al.  NIRS-based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation , 2012, NeuroImage.

[4]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[5]  S. Moscovici,et al.  Social Influence And Social Change , 1976 .

[6]  Jacqueline Nadel,et al.  From social behaviour to brain synchronization: Review and perspectives in hyperscanning , 2011 .

[7]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[8]  S. Rossi,et al.  Simultaneous recording of electroencephalographic data in musicians playing in ensemble , 2011, Cortex.

[9]  Chaozhe Zhu,et al.  Interpersonal brain synchronization in the right temporo-parietal junction during face-to-face economic exchange. , 2016, Social cognitive and affective neuroscience.

[10]  L. Astolfi,et al.  Social neuroscience and hyperscanning techniques: Past, present and future , 2014, Neuroscience & Biobehavioral Reviews.

[11]  F. Wallois,et al.  Usefulness of simultaneous EEG–NIRS recording in language studies , 2012, Brain and Language.

[12]  Karl Marx,et al.  Ludwig Feuerbach und der Ausgang der klassischen deutschen Philosophie , 2020, Friedrich Engels: Werke, Artikel, Entwürfe Mai 1883 bis September 1886.

[13]  Laura Astolfi,et al.  Investigating Cooperative Behavior in Ecological Settings: An EEG Hyperscanning Study , 2016, PloS one.

[14]  Athanasios V. Vasilakos,et al.  Brain computer interface: control signals review , 2017, Neurocomputing.

[15]  E. Gordon,et al.  Social phobics do not see eye to eye: a visual scanpath study of emotional expression processing. , 2003, Journal of anxiety disorders.

[16]  Hossein Esteky,et al.  A study of N250 event-related brain potential during face and non-face detection tasks. , 2009, Journal of vision.

[17]  Claudio Del Percio,et al.  Brains “in concert”: Frontal oscillatory alpha rhythms and empathy in professional musicians , 2012, NeuroImage.

[18]  Markus F. Neumann,et al.  N250r and N400 ERP correlates of immediate famous face repetition are independent of perceptual load , 2008, Brain Research.

[19]  P. Read Montague,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[20]  F. Cincotti,et al.  Cortical Activity and Connectivity of Human Brain during the Prisoner's Dilemma: an EEG Hyperscanning Study , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Marco Congedo,et al.  Music Performance As an Experimental Approach to Hyperscanning Studies , 2016, Front. Hum. Neurosci..

[22]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[23]  Timothy B. Smith,et al.  Social Relationships and Mortality Risk: A Meta-analytic Review , 2010, PLoS medicine.

[24]  武村 次郎,et al.  Vorbemerkung zu "Ludwig Feuerbach und der Ausgang der klassischen deutschen Philosophie" , 2020, Friedrich Engels: Werke, Artikel, Entwürfe, Oktober 1886 bis Februar 1891.

[25]  Martin Vinck,et al.  Improved measures of phase-coupling between spikes and the Local Field Potential , 2011, Journal of Computational Neuroscience.

[26]  Matthias Scheutz,et al.  What we can and cannot (yet) do with functional near infrared spectroscopy , 2014, Front. Neurosci..

[27]  S. Shimojo,et al.  Interpersonal body and neural synchronization as a marker of implicit social interaction , 2012, Scientific Reports.

[28]  A. Burton,et al.  N250r: a face-selective brain response to stimulus repetitions , 2004, Neuroreport.

[29]  K. Yun,et al.  Decoding covert motivations of free riding and cooperation from multi-feature pattern analysis of EEG signals. , 2015, Social cognitive and affective neuroscience.

[30]  M. Lassonde,et al.  Nonlinear hemodynamic responses in human epilepsy: A multimodal analysis with fNIRS-EEG and fMRI-EEG , 2012, Journal of Neuroscience Methods.

[31]  Paul M. Parizel,et al.  Comparing the Neural Basis of Decision Making in Social Dilemmas of People With Different Social Value Orientations, a fMRI Study , 2011 .

[32]  A. Burgess On the interpretation of synchronization in EEG hyperscanning studies: a cautionary note , 2013, Front. Hum. Neurosci..

[33]  Jakob Heinzle,et al.  Flow of affective information between communicating brains , 2011, NeuroImage.

[34]  Gary H. Glover,et al.  A quantitative comparison of NIRS and fMRI across multiple cognitive tasks , 2011, NeuroImage.

[35]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[36]  Falk Eippert,et al.  When seeing outweighs feeling: a role for prefrontal cortex in passive control of negative affect in blindsight , 2009 .

[37]  J. House,et al.  Social relationships and health. , 1988, Science.

[38]  Yifei Lu,et al.  Combining Eye Movements and EEG to Enhance Emotion Recognition , 2015, IJCAI.

[39]  Laura Astolfi,et al.  Defecting or Not Defecting: How to “Read” Human Behavior during Cooperative Games by EEG Measurements , 2010, PloS one.

[40]  Masamichi J. Hayashi,et al.  “Stay Tuned”: Inter-Individual Neural Synchronization During Mutual Gaze and Joint Attention , 2010, Front. Integr. Neurosci..

[41]  Hung T. Nguyen,et al.  Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[42]  Tang Honghong,et al.  The application of functional near-infrared spectroscopy in social cognitive neuroscience , 2017 .

[43]  Scott Makeig,et al.  ERP Features and EEG Dynamics : An ICA Perspective , 2009 .

[44]  Steven E. Barkan,et al.  Sociology : Understanding and Changing the Social World , 2011 .

[45]  Anatole Lécuyer,et al.  Author manuscript, published in "IEEE Transactions on Computational Intelligence and AI in games (2013)" Two Brains, One Game: Design and Evaluation of a Multi-User BCI Video Game Based on Motor Imagery , 2022 .

[46]  K. Kubota,et al.  Synchronous activity of two people's prefrontal cortices during a cooperative task measured by simultaneous near-infrared spectroscopy. , 2011, Journal of biomedical optics.

[47]  P. Churchland,et al.  The Neural Mechanisms of Moral Cognition: A Multiple-Aspect Approach to Moral Judgment and Decision-Making , 2003 .