Emotional faces boost up steady-state visual responsesforbrain–computer interface

Steady-state visual evoked potentials (SSVEPs) can be used successfully for brain–computer interfaces (BCI) with multiple commands and high information transfer rates. Inthis study, we investigated a novel affective SSVEP paradigm using flickering video clips of emotional human faces, and evaluated their performance in an 8-command BCI controlling a robotic arm in near real-time. Single-trial affective SSVEP responses, estimated using a new phase-locking value variability and a wavelet energy variability measures, were significantly enhanced compared with blurred-face flicker and standard checkerboards. For multicommand SSVEP-based BCI, affective face-flicker boosted up the information transfer rates from 50 to 64 bits/min, while reducing user fatigue and enhancing visual attention and reliability. In the 5–12 Hz flicker frequency range, the strongest affective SSVEP responses were obtained at 10 Hz. These findings suggest new directions for SSVEP-based neural applications, including affective BCI and enhanced steady-state clinical probes.

[1]  Liqing Zhang,et al.  Noninvasive BCIs: Multiway Signal-Processing Array Decompositions , 2008, Computer.

[2]  Sergio Cruces,et al.  Blind source extraction in Gaussian noise , 2000 .

[3]  Andrzej Cichocki,et al.  Fast Multi-command SSVEP Brain Machine Interface without Training , 2008, ICANN.

[4]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[5]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Matthias M. Müller,et al.  Early modulation of visual perception by emotional arousal: Evidence from steady-state visual evoked brain potentials , 2003, Cognitive, affective & behavioral neuroscience.

[7]  Markus Junghöfer,et al.  Neural systems of visual attention responding to emotional gestures , 2009, NeuroImage.

[8]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[9]  Andrzej Cichocki,et al.  Dynamic online target control of SSVEP-based brain–computer interface with multiple commands , 2007, Neuroscience Research.

[10]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[11]  Andreas Keil,et al.  Time course of competition for visual processing resources between emotional pictures and foreground task. , 2008, Cerebral cortex.

[12]  Thomas Elbert,et al.  Emotion Processing in the Visual Brain: A MEG Analysis , 2008, Brain Topography.

[13]  A. Cichocki,et al.  Optimization of SSVEP brain responses with application to eight-command Brain–Computer Interface , 2010, Neuroscience Letters.

[14]  Harald T. Schupp,et al.  Emotional Facilitation of Sensory Processing in the Visual Cortex , 2003, Psychological science.

[15]  Maurizio Codispoti,et al.  Fuzzy picture processing: effects of size reduction and blurring on emotional processing. , 2008, Emotion.

[16]  Matthias M. Müller,et al.  Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention , 2000, Clinical Neurophysiology.

[17]  D. Regan Steady-state evoked potentials. , 1977, Journal of the Optical Society of America.

[18]  Wade Junek,et al.  Mind Reading: The Interactive Guide to Emotions , 2007 .

[19]  Andrzej Cichocki,et al.  Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm , 2007, Comput. Intell. Neurosci..

[20]  Andrzej Cichocki,et al.  BRAIN CONTROL OF ROBOTIC ARM USING AFFECTIVE STEADY-STATE VISUAL EVOKED POTENTIALS , 2010 .