A New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera

Autores/as

  • Ahmed Ben Jmaa Multimedia, Information systems and Advanced Computing Laboratory, Sfax
  • Walid Mahdi Multimedia, Information systems and Advanced Computing Laboratory, Sfax
  • Yousra Ben Jemaa Signal and System Research Unit, Tunis
  • Abdelmajid Ben Hamadou Multimedia, Information systems and Advanced Computing Laboratory, Sfax

DOI:

https://doi.org/10.13053/cys-20-4-2390

Palabras clave:

Sign language (SL), Kinect camera, depth sensor, hand gesture recognition.

Resumen

This paper introduces a new approach for hand gesture recognition based on depth Map capturedby an RGB-D Kinect camera. Although this camera provides two types of information ”Depth Map” and ”RGB Image”, only the depth data information is used to analyze and recognize the hand gestures. Given the complexity of this task, a new method based on edge detection is proposed to eliminate the noise and segment the hand. Moreover, new descriptors are introduce to model the hand gesture. These features are invariant to scale, rotation and translation. Our approach is applied on French sign language alphabet to show its effectiveness and evaluate the robustness of the proposed descriptors. The experimental results clearly show that the proposed system is very satisfactory as it to recognizes the French alphabet sign with an accuracy of more than 93%. Our approach is also applied to a public dataset in order to be compared in the existing studies. The results prove that our system can outperform previous methods using the same dataset.

Biografía del autor/a

Ahmed Ben Jmaa, Multimedia, Information systems and Advanced Computing Laboratory, Sfax

received his M.Sc. degreein computer science from the National School of Engineers of Sfax, Sfax University, (Tunisia) in 2005. He is a Lecturer at the Department of computer sciences in Higher institute of business administration, Sfax University, (Tunisia). He is also a member of the Multimedia, Information systems and Advanced Computing Laboratory (MIRACL). His research interests include issues related to image processing of computer vision.

Walid Mahdi, Multimedia, Information systems and Advanced Computing Laboratory, Sfax

received the Ph.D degree in Computer Science in 2001, from Ecole Centrale de Lyon (France) and the M.Sc. degree in Computer Science from Paris-Sorbonne University. He spent one year at Ecole Centrale-Lyon (France) as a PostDoc position. In 2004, he joined the Sfax University, Tunisia, Higher Institute of Computer Science and Multimedia, when he finished his habilitation, the highest academic qualification, in 2010. He is also a member of the Multimedia, Information systems and Advanced Computing Laboratory (MIRACL). His research interests include Computer Vision and Image and video analysis.

Yousra Ben Jemaa, Signal and System Research Unit, Tunis

Received the engineering degree from Tunisia Polytechnic School (EPT) in 1997 and the M.Sc. degree in signal processing from Ecole Supérieure d’Electricité (SUPELEC), Paris, (France) in 1998. In 2003 She received the Ph.D. degree in Electrical Engineering and the HDR in Telecommunications in June 2012 from the National Engineers School of Tunis (ENIT), (Tunisia). She is a member of the research Lab. U2S at ENIT. Her teaching and research interests are in signal processing, image and video processing.

Abdelmajid Ben Hamadou, Multimedia, Information systems and Advanced Computing Laboratory, Sfax

Received the Ph.D degree in computer science from the University of Orsay (France) in 1979 and aThese d’Etat in Computer Science from the University of Tunis (Tunisia) in 1993. He is a Professor of Computer Science at the Higher Institute of Computer science and Multimedia, Sfax University, (Tunisia) and a member of the Multimedia, Information systems and Advanced Computing Laboratory (MIRACL). In 2002 he was decorated by the President of the Tunisian Republic (“Merit in Education and Science”) and in 2009, he received from the Vice President of Syria the “Al-Kindi” Award (“the best computer science researcher”). His research interests include Natural Language Processing, emantic web, information retrieval/filtering and document summarizing.

Descargas

Publicado

2016-12-18

Número

Vol. 20 Núm. 4 (2016): Thematic Issue: Research Advances and Applications of Evolutionary Computation (Guest Editors: H.J. Escalante, M. Graff)

Sección

Artículos

Licencia

Transfiero exclusivamente a la revista “Computación y Sistemas”, editada por el Centro de Investigación en Computación (CIC), los Derechos de Autor del artículo antes mencionado, asimismo acepto que no serán transferidos a ninguna otra publicación, en cualquier formato, idioma, medio existente (incluyendo los electrónicos y multimedios) o por desarrollar.

Certifico que el artículo, no ha sido divulgado previamente o sometido simultáneamente a otra publicación y que no contiene materiales cuya publicación violaría los Derechos de Autor u otros derechos de propiedad de cualquier persona, empresa o institución. Certifico además que tengo autorización de la institución o empresa donde trabajo o estudio para publicar este Trabajo.

El autor, representante acepta la responsabilidad por la publicación del Trabajo en nombre de todos y cada uno de los autores.

Esta Transferencia está sujeta a las siguientes reservas:

  • Los autores conservan todos los derechos de propiedad (tales como derechos de patente) de este Trabajo, con excepción de los derechos de publicación transferidos al CIC, mediante este documento.
  • Los autores conservan el derecho de publicar el Trabajo total o parcialmente en cualquier libro del que ellos sean autores o editores y hacer uso personal de este trabajo en conferencias, cursos, páginas web personal, etc.