Gesture Recognition System For Isolated Word Sign Language Based On key-Point Trajectory Matrix

Autores/as

  • Sana Fakhfakh El Manar University, Signal and System Research Unit, ENIT
  • Yousra Ben Jemaa El Manar University, Signal and System Research Unit, ENIT

DOI:

https://doi.org/10.13053/cys-22-4-3046

Palabras clave:

Sign language recognition, isolated word, signer-independence, particular filter, key-point trajectory matrix

Resumen

This paper suggests a new system to help the deaf and the hearing-impaired community improve their connection with the hearing world and communicate freely. The most important thing in this system is how to help the users be free and finally have a more natural way of communication. For this reason, we present a new process based on two levels: a static-levelaiming to extract the most head/hands key points anda dynamic-level with the objective of accumulating the key-point trajectory matrix. Also our proposed approach takes into account the signer-independence constraint. A SIGNUM database is applied in the classification stage and our system performances have improved with a 94.3% recognition rate. Further more, a reductionin time processing is obtained when the removing of redundant frame step is applied. The obtained results prove the superiority of our system compared to thestate-of- the-art methods in terms of recognition rate and execution time.

Descargas

Publicado

2018-12-30