Hetero complementary networks with hard-wired condensing binarization for high frame rate and ultra-low delay dual-hand tracking

Peiqi Zhang, Dingli Luo, Songlin Du, Takeshi Ikenaga

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

High frame rate, ultra-low delay yet accurate hand tracking system provides a seamless and intuitive interface for Human Computer Interaction (HCI). Tracking multi-person's dual-hand from monocular RGB camera is challenging for hand's variant image feature. Although many CNN based trackers have been proposed on general hardware, they cannot address this challenge with ultra-high speed. This paper proposes: (A) Hetero complementary networks for ultra-high speed dual-hand tracking, where the quick primary result from an FPGA network is intermittently combined with delayed accurate result from a GPU network. (B) Hard-wired condensing binarization for ultrahigh speed network implementation on FPGA. The network is able to be directly mapped as hardware resource because complex computation is condensed into binary layers. The proposed method achieves 69.8% accuracy on test sequences, which is only 4.7% lower compared with the general method. Meanwhile, the estimated FPGA resource utilization is tremendously reduced to 54.7% on the target platform. This work shows the potential to track multi-person's dual-hand at millisecond-level speed.

本文言語English
ホスト出版物のタイトルProceedings - 2020 13th International Conference on Human System Interaction, HSI 2020
出版社IEEE Computer Society
ページ82-87
ページ数6
ISBN(電子版)9781728173924
DOI
出版ステータスPublished - 2020 6
イベント13th International Conference on Human System Interaction, HSI 2020 - Tokyo, Japan
継続期間: 2020 6 62020 6 8

出版物シリーズ

名前International Conference on Human System Interaction, HSI
2020-June
ISSN(印刷版)2158-2246
ISSN(電子版)2158-2254

Conference

Conference13th International Conference on Human System Interaction, HSI 2020
国/地域Japan
CityTokyo
Period20/6/620/6/8

ASJC Scopus subject areas

  • 人間とコンピュータの相互作用
  • ソフトウェア

フィンガープリント

「Hetero complementary networks with hard-wired condensing binarization for high frame rate and ultra-low delay dual-hand tracking」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル