BRAIN CONTROL OF ROBOTIC ARM USING AFFECTIVE STEADY-STATE VISUAL EVOKED POTENTIALS

The recent emergence of successfully performing BrainComputer Interfaces (BCI) has given new hope to the disabled and elderly populations for improvements in quality of life. However, most non-invasive BCI systems which allow direct brain-to-machine control still have rather limited capabilities. Visual-flicker-based SSVEPBCI systems have received increased attention due to their potential capability to provide a large number of commands with high reliability. Yet, researchers have had limited success improving further the single-trial extraction of the weak SSVEP oscillations buried in strong brain ‘noise’. In a previous study we have shown that the optimization of the stimulus properties is essential for the enhanced performance of SSVEP–based BCI designs. This paper presents substantial enhancements in the brain response and the processing algorithms necessary for reliable multi-command SSVEP-BCI systems. The visual perception of flickering emotional video, instead of neutral checkerboards, enhanced substantially the measurable SSVEP responses of the brain. Furthermore, a single-trial phase-locking gradient measure was found to be more reliable and resulted in decreased variability when compared to wavelet energy changes. When BCI users operated a robotic arm with this Hybrid BCI platform, the speed, reliability, and information transfer rates were substantially improved when utilizing the proposed affective flicker paradigm.

[1]  A. H Kemp,et al.  Gender differences in the cortical electrophysiological processing of visual emotional stimuli , 2004, NeuroImage.

[2]  M. Junghöfer,et al.  Attention and emotion: an ERP analysis of facilitated emotional stimulus processing , 2003, Neuroreport.

[3]  Klaus R. Scherer,et al.  Antecedents of and Reactions to Emotions in the United States and Japan , 1988 .

[4]  Matthias M. Müller,et al.  Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention , 2000, Clinical Neurophysiology.

[5]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[6]  Thomas Elbert,et al.  Emotion Processing in the Visual Brain: A MEG Analysis , 2008, Brain Topography.

[7]  A. Cichocki,et al.  Optimization of SSVEP brain responses with application to eight-command Brain–Computer Interface , 2010, Neuroscience Letters.

[8]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[9]  Matthias M. Müller,et al.  Early modulation of visual perception by emotional arousal: Evidence from steady-state visual evoked brain potentials , 2003, Cognitive, affective & behavioral neuroscience.

[10]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[11]  Andrzej Cichocki,et al.  Dynamic online target control of SSVEP-based brain–computer interface with multiple commands , 2007, Neuroscience Research.

[12]  Harald T. Schupp,et al.  Emotional Facilitation of Sensory Processing in the Visual Cortex , 2003, Psychological science.

[13]  Clemens Brunner,et al.  Online Control of a Brain-Computer Interface Using Phase Synchronization , 2006, IEEE Transactions on Biomedical Engineering.

[14]  D. Regan.  Steady-state evoked potentials. , 1977, Journal of the Optical Society of America.

[15]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[16]  Wai Yie Leong,et al.  Blind Source Extraction , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[17]  Andreas Keil,et al.  Time course of competition for visual processing resources between emotional pictures and foreground task. , 2008, Cerebral cortex.

[18]  R. Silberstein,et al.  Steady State Visually Evoked Potential Correlates of Static and Dynamic Emotional Face Processing , 2009, Brain Topography.

[19]  M. Bradley,et al.  Emotional arousal and activation of the visual cortex: an fMRI analysis. , 1998, Psychophysiology.

[20]  S. Baron-Cohen,et al.  Mind Reading: The Interactive Guide to Emotions , 2003 .

[21]  Wade Junek,et al.  Mind Reading: The Interactive Guide to Emotions , 2007 .

[22]  Andrzej Cichocki,et al.  Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm , 2007, Comput. Intell. Neurosci..

[23]  Sergio Cruces,et al.  Blind source extraction in Gaussian noise , 2000 .

[24]  Pradeep J Nathan,et al.  Augmentation of serotonin enhances pleasant and suppresses unpleasant cortical electrophysiological responses to visual emotional stimuli in humans , 2004, NeuroImage.