A New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera

Authors

  • Ahmed Ben Jmaa Multimedia, InfoRmation systems and Advanced Computing Laboratory, Sfax
  • Walid Mahdi Multimedia, Information systems and Advanced Computing Laboratory, Sfax
  • Yousra Ben Jemaa Signal and System Research Unit, Tunis
  • Abdelmajid Ben Hamadou Multimedia, Information systems and Advanced Computing Laboratory, Sfax

DOI:

https://doi.org/10.13053/cys-20-4-2390

Keywords:

Sign language (SL), Kinect camera, depth sensor, hand gesture recognition.

Abstract

We present in this paper a new approach for hand gestures recognition based on depth Map captured by a RGB-D camera like kinect. Although this camera provides two types of information "Depth Map" and "RGB Image", we use only the depth data information to analyze and recognize the hand gestures. Given the complexity of this task, we propose in the first step a new method based on edge detection to eliminate the noise and segment the hand. Then we have introduced new descriptors modeling the hand gesture. These features are invariant to scale, rotation and translation. Our approach has been applied on Alphabet French sign language to show its effectiveness and to evaluate the robustness of the proposed descriptors. The experimental results clearly show that the proposed system is very satisfactory and is able to recognize the French alphabet sign with an accuracy more than 93%. Our approach has been also applied on a public dataset in order to be compared to existing works. The results prove that our system can outperform previous methods using the same database.

Author Biographies

Ahmed Ben Jmaa, Multimedia, InfoRmation systems and Advanced Computing Laboratory, Sfax

received his M.Sc. degree in computer science from the National School of Engineers of Sfax, Sfax University, (Tunisia) in 2005. He is a Lecturer at the Department of computer sciences in Higher institute of business administration, Sfax University, (Tunisia). He is also a member of the Multimedia, InfoRmation systems and Advanced Computing Laboratory (MIRACL). His research interests include issues related to image processing of computer vision.

Walid Mahdi, Multimedia, Information systems and Advanced Computing Laboratory, Sfax

received the Ph.D degree in Computer Science in 2001, from Ecole Centrale de Lyon (France) and the M.Sc. degree in Computer Science from Paris-Sorbonne University. He spent one year at Ecole Centrale-Lyon (France) as a PostDoc position. In 2004, he joined the Sfax University, Tunisia, Higher Institute of Computer Science and Multimedia, when he finished his habilitation, the highest academic qualification, in 2010. He is also a member of the Multimedia, InfoRmation systems and Advanced Computing Laboratory (MIRACL). His research interests include Computer Vision and Image and video analysis.

Yousra Ben Jemaa, Signal and System Research Unit, Tunis

Received the engineering degree from Tunisia Polytechnic School (EPT) in 1997 and the M.Sc. degree in signal processing from Ecole Supérieure d’Electricité (SUPELEC), Paris, (France) in 1998. In 2003 She received the Ph.D. degree in Electrical Engineering and the HDR in Telecommunications in June 2012 from the National Engineers School of Tunis (ENIT), (Tunisia). She is a member of the research Lab. U2S at ENIT. Her teaching and research interests are in signal processing, image and video processing.

Abdelmajid Ben Hamadou, Multimedia, Information systems and Advanced Computing Laboratory, Sfax

received the Ph.D degree in computer science from the University of Orsay (France) in 1979 and a These d’Etat in Computer Science from the University of Tunis (Tunisia) in 1993. He is a Professor of Computer Science at the Higher Institute of Computer science and Multimedia, Sfax University, (Tunisia) and a member of the Multimedia, Information systems and Advanced Computing Laboratory (MIRACL). In 2002 he was decorated by the President of the Tunisian Republic (“Merit in Education and Science”) and in 2009, he received from the Vice President of Syria the “Al-Kindi” Award (“the best computer science researcher”). His research interests include Natural Language Processing, emantic web, information retrieval/filtering and document summarizing.

Downloads

Published

2016-12-18

Issue

Vol. 20 No. 4 (2016): Thematic Issue: Research Advances and Applications of Evolutionary Computation (Guest Editors: H.J. Escalante, M. Graff)

Section

Articles

License 

Hereby I transfer exclusively to the Journal "Computación y 
Sistemas", published by the Computing Research Center (CIC-IPN),
the Copyright of the aforementioned paper. I also accept that these 
rights will not be transferred to any other publication, in any other 
format, language or other existing means of developing.
I certify that the paper has not been previously disclosed or simultaneo
usly submitted to any other publication, and that it does not contain 
material whose publication would violate the Copyright or other 
proprietary rights of any person, company or institution. I certify that 
I have the permission from the institution or company where I work or 
study to publish this work.
The representative author accepts the responsibility for the publication
of this paper on behalf of each and every one of the authors. 
This transfer is subject to the following conditions:
  • The authors retain all ownership rights (such as patent rights) of this work, except for the publishing rights transferred to the CIC, through this document.
  • Authors retain the right to publish the work in whole or in part in any book they are the authors or publishers. They can also make use of this work in conferences, courses, personal web pages, and so on.
  • Authors may include working as part of his thesis, for non-profit distribution only.