Sign language translation system based on micro-inertial measurement units and ZigBee network

Lianqing Liu, Hiroyasu Iwata, Guangyi Shi, Zhi li, Keke tu, Songtao Jia, Qinghu Cui, Yufeng Jin

研究成果: Article査読

抄録

Chinese sign language has been proved as an effective communication tool for deaf people. In this paper, we present a novel translation system, which can capture human gestures through micro-inertial measurement units (IMUs) and translate the gestures into specific meanings accordingly. Each micro-IMU consists of a 3D accelerometer and gyroscope. A micro-controller and ZigBee network were used to acquire data simultaneously and wirelessly. Ten types of basic Chinese sign language movements including what, how, work, today, happy, please, book, body, clothes and and were collected and stored to form a motion-sensing database. A discrete cosine transform (DCT) was performed to extract the effective features from the original data, while a hidden Markov model (HMM) was used to train the database in order to form an HMM classifier. Testing samples were used to test the HMM classifier. Different sign languages were recognized through the HMM classifier and subsequent translation processes were performed. Experimental results showed that the correct recognition rate ranges from 95% to 100% for the 10 sign language movements, and the overall correction rate is 98%. With more micro-electro-mechanical system (MEMS) sensing motes adding to the interpretation system, the performance will be enhanced.

本文言語English
ページ(範囲)901-909
ページ数9
ジャーナルTransactions of the Institute of Measurement and Control
35
7
DOI
出版ステータスPublished - 2013 10
外部発表はい

ASJC Scopus subject areas

  • 器械工学

フィンガープリント

「Sign language translation system based on micro-inertial measurement units and ZigBee network」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル