A survey of image-based Arabic sign language recognition

Sign language is the native language of deaf and hearing impaired people which they prefer to use on their daily life. Few interpreters are available to facilitate communication between deaf and vocal people. However, this is neither practical nor possible for all situations. Advances in information technology encouraged the development of systems that can facilitate the automatic translation between sign language and spoken language, and thus removing barriers facing the integration of deaf people in the society. A lot of research has been carried on the development of systems that translate sign languages into spoken words and the reverse. However, only recently systems translating between Arabic sign language and spoken language have been developed. Many signs of the Arabic sign language are reflection of the environment (White color in Arabic sign language is a finger pointing to the chest of the signer as the tradition for male is to wear white color dress). Several review papers have been published on the automatic recognition of other sign languages. This paper represents the first attempt to review systems and methods for the image based automatic recognition of the Arabic sign language. It reviews most published papers and discusses a variety of recognition methods. Additionally, the paper highlights the main challenges characterizing the Arabic sign language as well as potential future research directions in this area.

[1]  Aliaa A. A. Youssif,et al.  Arabic Sign Language (ArSL) Recognition System Using HMM , 2011 .

[2]  Omar M. Al-Jarrah,et al.  Recognition of gestures in Arabic sign language using neuro-fuzzy systems , 2001, Artif. Intell..

[3]  M. Younus Javed,et al.  A Survey on Sign Language Recognition , 2011, 2011 Frontiers of Information Technology.

[4]  Ahmed Samir,et al.  Arabic sign language recognition using neural network and graph matching techniques , 2006 .

[5]  Khaled Assaleh,et al.  Video-based feature extraction techniques for isolated arabic sign language recognition , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[6]  Khaled Assaleh,et al.  Recognition of Arabic Sign Language Alphabet Using Polynomial Classifiers , 2005, EURASIP J. Adv. Signal Process..

[7]  Samir I. Shaheen,et al.  Sign language recognition using a combination of new vision based features , 2011, Pattern Recognit. Lett..

[8]  Aboul Ella Hassanien,et al.  ArSLAT: Arabic Sign Language Alphabets Translator , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).

[9]  Mohammad A. Al-Rousan,et al.  Automatic Recognition of Arabic Sign Language Finger Spelling , 2001, Int. J. Comput. Their Appl..

[10]  Mohamed F. Tolba,et al.  A proposed PCNN features quality optimization technique for pose-invariant 3D Arabic sign language recognition , 2013, Appl. Soft Comput..

[11]  M. F. Tolba,et al.  A proposed graph matching technique for Arabic sign language continuous sentences recognition , 2012, 2012 8th International Conference on Informatics and Systems (INFOS).

[12]  Karl-Friedrich Kraiss,et al.  Recent developments in visual sign language recognition , 2008, Universal Access in the Information Society.

[13]  K. Margaritis,et al.  Hidden Markov Models for Greek Sign Language Recognition , 2002 .

[14]  Mohamed A. Deriche,et al.  Image based arabic sign language recognition , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..

[15]  Elsayed E. Hemayed,et al.  Edge-based recognizer for Arabic sign language alphabet (ArS2V-Arabic sign to voice) , 2010, 2010 International Computer Engineering Conference (ICENCO).

[16]  Mohamed F. Tolba,et al.  Arabic sign language continuous sentences recognition using PCNN and graph matching , 2012, Neural Computing and Applications.

[17]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[18]  M. Deriche,et al.  A signer-independent Arabic Sign Language recognition system using face detection, geometric features, and a Hidden Markov Model , 2012, Comput. Electr. Eng..

[19]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  A. Samir,et al.  Error detection and correction approach for Arabic sign language recognition , 2012, 2012 Seventh International Conference on Computer Engineering & Systems (ICCES).

[21]  Khaled Assaleh,et al.  Two Tier Feature Extractions for Recognition of Isolated Arabic Sign Language using Fisher's Linear Discriminants , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[22]  K. Assaleh,et al.  Arabic sign language recognition in user-independent mode , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[23]  M. Maraqa,et al.  Recognition of Arabic Sign Language (ArSL) using recurrent neural networks , 2008, 2008 First International Conference on the Applications of Digital Information and Web Technologies (ICADIWT).

[24]  A. B. M. Shawkat Ali,et al.  HMM based hand gesture recognition: A review on techniques and approaches , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[25]  N. Suhas,et al.  Recent Developments in Sign Language Recognition : A Review , 2012 .

[26]  Saudi Arabia,et al.  Real-Time Arabic Sign Language (ArSL) Recognition , 2012 .

[27]  A. M. Riad,et al.  SignsWorld; Deeping Into the Silence World and Hearing Its Signs (State of the Art) , 2012, ArXiv.

[28]  Hussein H. Owaied,et al.  Development of a New Arabic Sign Language Recognition Using K-Nearest Neighbor Algorithm , 2012 .

[29]  Khaled Assaleh,et al.  Vision-based system for continuous Arabic Sign Language recognition in user dependent mode , 2008, 2008 5th International Symposium on Mechatronics and Its Applications.

[30]  Alaa Hamdy,et al.  Arabic Sign Language Recognition , 2014 .