Optimizing the Face Paradigm of BCI System by Modified Mismatch Negative Paradigm

Many recent studies have focused on improving the performance of event-related potential (ERP) based brain computer interfaces (BCIs). The use of a face pattern has been shown to obtain high classification accuracies and information transfer rates (ITRs) by evoking discriminative ERPs (N200 and N400) in addition to P300 potentials. Recently, it has been proved that the performance of traditional P300-based BCIs could be improved through a modification of the mismatch pattern. In this paper, a mismatch inverted face pattern (MIF-pattern) was presented to improve the performance of the inverted face pattern (IF-pattern), one of the state of the art patterns used in visual-based BCI systems. Ten subjects attended in this experiment. The result showed that the mismatch inverted face pattern could evoke significantly larger vertex positive potentials (p < 0.05) and N400s (p < 0.05) compared to the inverted face pattern. The classification accuracy (mean accuracy is 99.58%) and ITRs (mean bit rate is 27.88 bit/min) of the mismatch inverted face pattern was significantly higher than that of the inverted face pattern (p < 0.05).

[1]  Xingyu Wang,et al.  A combined brain–computer interface based on P300 potentials and motion-onset visual evoked potentials , 2012, Journal of Neuroscience Methods.

[2]  S M M Martens,et al.  Overlap and refractory effects in a brain–computer interface speller based on the visual P300 event-related potential , 2009, Journal of neural engineering.

[3]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[4]  Tobias Kaufmann,et al.  Spelling is Just a Click Away – A User-Centered Brain–Computer Interface Including Auto-Calibration and Predictive Text Entry , 2012, Front. Neurosci..

[5]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[6]  Rui Xu,et al.  Toward a minimally invasive brain–computer interface using a single subdural channel: A visual speller study , 2013, NeuroImage.

[7]  M A Bobes,et al.  Different scalp topography of brain potentials related to expression and identity matching of faces. , 2000, Brain research. Cognitive brain research.

[8]  Peter E. Clayson,et al.  How does noise affect amplitude and latency measurement of event-related potentials (ERPs)? A methodological critique and simulation study. , 2013, Psychophysiology.

[9]  Cuntai Guan,et al.  Unsupervised Brain Computer Interface Based on Intersubject Information and Online Adaptation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  J. Wolpaw.  Brain-computer interfaces. , 2013, Handbook of clinical neurology.

[11]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[12]  D. Jeffreys.  A face-responsive potential recorded from the human scalp , 2004, Experimental Brain Research.

[13]  Chang-Hwan Im,et al.  EEG-Based Brain-Computer Interfaces: A Thorough Literature Survey , 2013, Int. J. Hum. Comput. Interact..

[14]  Motohiro Kimura,et al.  Attention switching function of memory-comparison-based change detection system in the visual modality. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  D Thompson,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[17]  Andreas Keil,et al.  Face-Evoked Steady-State Visual Potentials: Effects of Presentation Rate and Face Inversion , 2012, Front. Hum. Neurosci..

[18]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[19]  M. Kimura.  Visual mismatch negativity and unintentional temporal-context-based prediction in vision. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  Motohiro Kimura,et al.  Probability-independent and -dependent ERPs reflecting visual change detection. , 2006, Psychophysiology.

[21]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[22]  István Czigler,et al.  Visual Mismatch Negativity and Categorization , 2014, Brain Topography.

[23]  Xingyu Wang,et al.  A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm , 2015, Int. J. Neural Syst..

[24]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[25]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  T. Penney,et al.  Repetition related ERP effects in a visual object target detection task. , 2001, Brain research. Cognitive brain research.

[27]  Eric W. Sellers,et al.  A general P300 brain–computer interface presentation paradigm based on performance guided constraints , 2012, Neuroscience Letters.

[28]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[29]  Rami Saab,et al.  A Hybrid Brain–Computer Interface Based on the Fusion of P300 and SSVEP Scores , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Erich Schröger,et al.  Human Visual System Automatically Encodes Sequential Regularities of Discrete Events , 2010, Journal of Cognitive Neuroscience.

[31]  Andrzej Cichocki,et al.  Whether generic model works for rapid ERP-based BCI calibration , 2013, Journal of Neuroscience Methods.

[32]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[33]  C. C. Duncan,et al.  Event-related potentials in clinical research : Guidelines for eliciting , recording , and quantifying mismatch negativity , P 300 , and N 400 , 2017 .

[34]  José del R. Millán,et al.  Brain-Computer Interfaces , 2015 .

[35]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[36]  Xingyu Wang,et al.  Spatial-Temporal Discriminant Analysis for ERP-Based Brain-Computer Interface , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[38]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[39]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[40]  Fanglin Chen,et al.  A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP , 2014, IEEE Transactions on Biomedical Engineering.

[41]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[42]  Valéria Csépe,et al.  Electroencephalography effects to semantic and non-semantic mismatch in properties of visually presented single-characters: The N2b and the N400 , 2007, Neuroscience Letters.

[43]  A. Cichocki,et al.  An optimized ERP brain–computer interface based on facial expression changes , 2014, Journal of neural engineering.

[44]  István Czigler,et al.  ERPs and deviance detection: Visual mismatch negativity to repeated visual stimuli , 2006, Neuroscience Letters.

[45]  E. Schröger,et al.  Top-down attention affects sequential regularity representation in the human visual system. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[46]  Risto N t nen.  Attention and brain function , 1992 .

[47]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[48]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[49]  Xingyu Wang,et al.  An ERP-Based BCI using an oddball Paradigm with Different Faces and Reduced errors in Critical Functions , 2014, Int. J. Neural Syst..

[50]  Clemens Brunner,et al.  An adaptive P 300-based control system , 2011 .

[51]  Yuping Wang,et al.  The sequential processing of visual feature conjunction mismatches in the human brain. , 2004, Psychophysiology.

[52]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.