An Affordable Bio-Sensing and Activity Tagging Platform for HCI Research

We present a novel multi-modal bio-sensing platform capable of integrating multiple data streams for use in real-time applications. The system is composed of a central compute module and a companion headset. The compute node collects, time-stamps and transmits the data while also providing an interface for a wide range of sensors including electroencephalogram, photoplethysmogram, electrocardiogram, and eye gaze among others. The companion headset contains the gaze tracking cameras. By integrating many of the measurements systems into an accessible package, we are able to explore previously unanswerable questions ranging from open-environment interactions to emotional response studies. Though some of the integrated sensors are designed from the ground-up to fit into a compact form factor, we validate the accuracy of the sensors and find that they perform similarly to, and in some cases better than, alternatives.

[1]  Mariano Sigman,et al.  Fixation-related potentials in visual search: a combined EEG and eye tracking study. , 2012, Journal of vision.

[2]  E. Donchin,et al.  EEG-based communication: prospects and problems. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[4]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[5]  Charles Sodini,et al.  A continuous, wearable, and wireless heart monitor using head ballistocardiogram (BCG) and head electrocardiogram (ECG) , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  M. Samuels,et al.  The brain-heart connection. , 2007, Circulation.

[7]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[9]  Scott Makeig,et al.  BCILAB: a platform for brain–computer interface development , 2013, Journal of neural engineering.

[10]  Guang-Zhong Yang,et al.  A Flexible, Low Noise Reflective PPG Sensor Platform for Ear-Worn Heart Rate Monitoring , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[11]  Scott P. Johnson,et al.  A Critical Test of Temporal and Spatial Accuracy of the Tobii T60XL Eye Tracker. , 2012, Infancy : the official journal of the International Society on Infant Studies.

[12]  Andreas Bulling,et al.  Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction , 2014, UbiComp Adjunct.

[13]  David Da He,et al.  A wearable heart monitor at the ear using ballistocardiogram (BCG) and electrocardiogram (ECG) with a nanowatt ECG heartbeat detection circuit , 2013 .

[14]  Tzyy-Ping Jung,et al.  Online recursive independent component analysis for real-time source separation of high-density EEG , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  L. Tarassenko,et al.  Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE , 2014 .

[16]  Benjamin Blankertz,et al.  Gaze-independent BCI-spelling using rapid serial visual presentation (RSVP) , 2013, Clinical Neurophysiology.

[17]  Rosalind W. Picard,et al.  Motion-tolerant magnetic earring sensor and wireless earpiece for wearable photoplethysmography , 2010, IEEE Transactions on Information Technology in Biomedicine.

[18]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[19]  Katsumi Aoki,et al.  Flying characteristics of the new official rubber baseball , 2009, J. Vis..

[20]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  E. Wall,et al.  Neurocardiology: close interaction between heart and brain , 2013 .

[23]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[24]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[25]  Nathalie Guyader,et al.  An eye fixation-related potentials analysis of the P300 potential for fixations onto a target object when exploring natural scenes. , 2015, Journal of vision.

[26]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.