Sign language translation system based on micro-inertial measurement units and ZigBee network

Lianqing Liu, Hiroyasu Iwata, Guangyi Shi, Zhi li, Keke tu, Songtao Jia, Qinghu Cui, Yufeng Jin

Research output: Contribution to journalArticlepeer-review

Abstract

Chinese sign language has been proved as an effective communication tool for deaf people. In this paper, we present a novel translation system, which can capture human gestures through micro-inertial measurement units (IMUs) and translate the gestures into specific meanings accordingly. Each micro-IMU consists of a 3D accelerometer and gyroscope. A micro-controller and ZigBee network were used to acquire data simultaneously and wirelessly. Ten types of basic Chinese sign language movements including what, how, work, today, happy, please, book, body, clothes and and were collected and stored to form a motion-sensing database. A discrete cosine transform (DCT) was performed to extract the effective features from the original data, while a hidden Markov model (HMM) was used to train the database in order to form an HMM classifier. Testing samples were used to test the HMM classifier. Different sign languages were recognized through the HMM classifier and subsequent translation processes were performed. Experimental results showed that the correct recognition rate ranges from 95% to 100% for the 10 sign language movements, and the overall correction rate is 98%. With more micro-electro-mechanical system (MEMS) sensing motes adding to the interpretation system, the performance will be enhanced.

Original languageEnglish
Pages (from-to)901-909
Number of pages9
JournalTransactions of the Institute of Measurement and Control
Volume35
Issue number7
DOIs
Publication statusPublished - 2013 Oct
Externally publishedYes

Keywords

  • HMM
  • MEMS
  • ZigBee network
  • sign language translation

ASJC Scopus subject areas

  • Instrumentation

Fingerprint Dive into the research topics of 'Sign language translation system based on micro-inertial measurement units and ZigBee network'. Together they form a unique fingerprint.

Cite this