Blob Analysis of the Head and Hands: A Method for Deception Detection

Behavioral indicators of deception and behavioral state are extremely difficult for humans to analyze. Blob analysis, a method for analyzing the movement of the head and hands based on the identification of skin color is presented. This method is validated with numerous skin tones. A proof-of-concept study is presented that uses blob analysis to explore behavioral state identification in the detection of deception.

[1]  Jay F. Nunamaker,et al.  Training Professionals to Detect Deception , 2003, ISI.

[2]  Yangsheng Xu,et al.  Human action learning via hidden Markov model , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[3]  R. Bull,et al.  Detecting Deceit via Analysis of Verbal and Nonverbal Behavior , 2000 .

[4]  Shan Lu,et al.  Color-based hands tracking system for sign language recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  James J. Lindsay,et al.  Cues to deception. , 2003, Psychological bulletin.

[6]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[7]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[8]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[9]  J. Burgoon.  A Communication Model of Personal Space Violations: Explication and an Initial Test. , 1978 .

[10]  P. Ekman.  Telling lies: clues to deceit in the marketplace , 1985 .

[11]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[12]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[13]  Jay F. Nunamaker,et al.  Detecting Deception through Linguistic Analysis , 2003, ISI.

[14]  M. Zuckerman.  Verbal and nonverbal communication of deception , 1981 .

[15]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[16]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[17]  A. Vrij.  Detecting Lies and Deceit: The Psychology of Lying and the Implications for Professional Practice , 2000 .

[18]  J. Burgoon,et al.  Nonverbal Communication: The Unspoken Dialogue , 1988 .

[19]  J. Burgoon,et al.  Interpersonal Deception Theory , 1996 .

[20]  Dimitris N. Metaxas,et al.  A framework for motion recognition with applications to American sign language and gait recognition , 2000, Proceedings Workshop on Human Motion.

[21]  Hiroaki Kotera,et al.  Fast color processor with programmable interpolation by small memory (PRISM) , 1993, J. Electronic Imaging.

[22]  Paul Ekman,et al.  Lying and nonverbal behavior: Theoretical issues and new findings , 1988 .

[23]  Shan Lu,et al.  Using multiple cues for hand tracking and model refinement , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[24]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[25]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[26]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[27]  Aaron F. Bobick,et al.  Realtime online adaptive gesture recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[28]  Aaron F. Bobick,et al.  Realtime online adaptive gesture recognition , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).