Using Highlighting to Train Attentional Expertise

Acquiring expertise in complex visual tasks is time consuming. To facilitate the efficient training of novices on where to look in these tasks, we propose an attentional highlighting paradigm. Highlighting involves dynamically modulating the saliency of a visual image to guide attention along the fixation path of a domain expert who had previously viewed the same image. In Experiment 1, we trained naive subjects via attentional highlighting on a fingerprint-matching task. Before and after training, we asked subjects to freely inspect images containing pairs of prints and determine whether the prints matched. Fixation sequences were automatically scored for the degree of expertise exhibited using a Bayesian discriminative model of novice and expert gaze behavior. Highlighted training causes gaze behavior to become more expert-like not only on the trained images but also on transfer images, indicating generalization of learning. In Experiment 2, to control for the possibility that the increase in expertise is due to mere exposure, we trained subjects via highlighting of fixation sequences from novices, not experts, and observed no transition toward expertise. In Experiment 3, to determine the specificity of the training effect, we trained subjects with expert fixation sequences from images other than the one being viewed, which preserves coarse-scale statistics of expert gaze but provides no information about fine-grain features. Observing at least a partial transition toward expertise, we obtain only weak evidence that the highlighting procedure facilitates the learning of critical local features. We discuss possible improvements to the highlighting procedure.

[1]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[2]  C. Nodine,et al.  An Analysis of Perceptual and Cognitive Factors in Radiographic Interpretation , 1980, Perception.

[3]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[4]  Drew H. Abney,et al.  Journal of Experimental Psychology : Human Perception and Performance Influence of Musical Groove on Postural Sway , 2015 .

[5]  Tayyar Sen,et al.  The Effects of Task Variables and Prolonged Performance on Saccadic Eye Movement Parameters , 1984 .

[6]  G. Legge,et al.  The importance of eye movements in the analysis of simple patterns , 1986, Vision Research.

[7]  E. Krupinski,et al.  Computer-displayed eye position as a visual aid to pulmonary nodule interpretation. , 1990, Investigative radiology.

[8]  Eileen Kowler,et al.  The role of saccades in the perception of texture patterns , 1992, Vision Research.

[9]  B. Velichkovsky Communicating attention: Gaze position transfer in cooperative problem solving , 1995 .

[10]  E. Krupinski,et al.  Visual scanning patterns of radiologists searching mammograms. , 1996, Academic radiology.

[11]  D. S. Wooding,et al.  Fixation sequences made during visual examination of briefly presented 2D images. , 1997, Spatial vision.

[12]  E A Krupinski,et al.  Differences in time to interpretation for evaluation of bone radiographs with monitor and film viewing. , 1997, Academic radiology.

[13]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[14]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[15]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[16]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[17]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[18]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[19]  Casimir J. H. Ludwig,et al.  Stimulus-driven and goal-driven control over visual selection. , 2002, Journal of experimental psychology. Human perception and performance.

[20]  M. Masson Using confidence intervals for graphically based data interpretation. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[21]  Michael J. Spivey,et al.  Eye Movements and Problem Solving , 2003, Psychological science.

[22]  T. Busey,et al.  Behavioral and electrophysiological evidence for configural processing in fingerprint experts , 2005, Vision Research.

[23]  B. Scholl,et al.  The Automaticity of Visual Statistical Learning Statistical Learning , 2005 .

[24]  Barbara Anne Dosher,et al.  Perceptual learning in clear displays optimizes perceptual expertise: learning the limiting process. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Anand K. Gramopadhye,et al.  Evaluation of the effect of feedforward training displays of search strategy on visual search performance , 2006 .

[26]  Laura E. Thomas,et al.  Moving eyes and moving thought: On the spatial compatibility between eye movements and cognition , 2007, Psychonomic bulletin & review.

[27]  David F. Feldon,et al.  The Implications of Research on Expertise for Curriculum and Pedagogy , 2007 .

[28]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[29]  P. McLeod,et al.  Why good thoughts block better ones: The mechanism of the pernicious Einstellung (set) effect , 2008, Cognition.

[30]  B. Scholl,et al.  Multidimensional Visual Statistical Learning Visual Statistical Learning , 2005 .

[31]  B. Tatler,et al.  The prominence of behavioural biases in eye guidance , 2009 .

[32]  Bradley C. Love,et al.  Seeing the World through an Expert's Eyes: Context-Aware Display as a Training Companion , 2009, HCI.

[33]  Aaron R. Seitz,et al.  The phenomenon of task-irrelevant perceptual learning , 2009, Vision Research.

[34]  Katharina Scheiter,et al.  Attention guidance during example study via the model's eye movements , 2009, Comput. Hum. Behav..

[35]  Law. Policy Executive Summary of the National Academies of Science Reports, Strengthening Forensic Science in the United States: A Path Forward , 2009 .

[36]  I. Dror,et al.  The vision in “blind” justice: Expert perception, judgment, and visual cognition in forensic pattern recognition , 2010, Psychonomic bulletin & review.

[37]  Anil K. Jain,et al.  Fingerprint Matching , 2010, Computer.

[38]  Francisco J. Parada,et al.  The nature of expertise in fingerprint examiners , 2010, Psychonomic bulletin & review.

[39]  T. Crawford,et al.  Viewing another person's eye movements improves identification of pulmonary nodules in chest x-ray inspection. , 2010, Journal of experimental psychology. Applied.

[40]  Chen Yu,et al.  Consistency and Variability Among Latent Print Examiners as Revealed by Eye Tracking Methodologies , 2011 .

[41]  C. Champod,et al.  Cognitive issues in fingerprint analysis: inter- and intra-expert consistency and the effect of a 'target' comparison. , 2011, Forensic science international.

[42]  Duncan J. McCarthy,et al.  Identifying Fingerprint Expertise , 2011, Psychological science.

[43]  Itiel E. Dror,et al.  Special Abilities and Vulnerabilities in Forensic Expertise , 2011 .

[44]  E. Reingold,et al.  Eye movements and visual expertise in chess and medicine , 2011 .

[45]  J. Causer,et al.  Quiet eye training in a visuomotor control task. , 2011, Medicine and science in sports and exercise.

[46]  Matthew F. Peterson,et al.  Looking just below the eyes is optimal across face recognition tasks , 2012, Proceedings of the National Academy of Sciences.

[47]  T. Foulsham,et al.  Comparing scanpaths during scene encoding and recognition : A multi-dimensional approach , 2012 .

[48]  Tanuj Kanchan,et al.  The Fingerprint Sourcebook , 2012 .

[49]  Mark R. Wilson,et al.  Cheating experience: Guiding novices to adopt the gaze strategies of experts expedites the learning of technical laparoscopic skills. , 2012, Surgery.

[50]  M. Mozer Efficient Training Of Visual Search Via Attentional Highlighting , 2012 .

[51]  Stefanie I. Becker,et al.  Priming of fixations during recognition of natural scenes. , 2013, Journal of vision.

[52]  T. Sejnowski,et al.  Learning where to look for a hidden target , 2013, Proceedings of the National Academy of Sciences.

[53]  Duncan J. McCarthy,et al.  Expertise in Fingerprint Identification , 2013, Journal of forensic sciences.

[54]  Chen Yu,et al.  Temporal Sequences Quantify the Contributions of Individual Fixations in Complex Perceptual Matching Tasks , 2013, Cogn. Sci..

[55]  T. Foulsham,et al.  Fixation-dependent memory for natural scenes: an experimental test of scanpath theory. , 2013, Journal of experimental psychology. General.

[56]  Jan Theeuwes,et al.  The time it takes to turn a memory into a template. , 2013, Journal of vision.

[57]  Matthew F. Peterson,et al.  Learning optimal eye movements to unusual faces , 2014, Vision Research.

[58]  Dylan D. Schmorrow,et al.  Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 10th International Conference, AC 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, July 17-22, 2016, Proceedings, Part II , 2016, HCI.

[59]  Michael C. Mozer,et al.  Correction: Using Highlighting to Train Attentional Expertise , 2016, PloS one.

[60]  The National Academy of Sciences , 1928, Science.