Adaptive-partial template update with center-shifting recovery for high frame rate and ultra-low delay deformation matching

Songlin Du, Yuhao Xu, Tingting Hu, Takeshi Ikenaga

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

High frame rate and ultra-low delay matching system plays an important role in various human-machine interactive applications, which demands better performance in matching deformable and out-of-plane rotating objects. Although many algorithms have been proposed for deformation tracking and matching, few of them are suitable for hardware implementation due to complicated operations and large time consumption. This paper proposes a hardware-oriented template update and recovery method for high frame rate and ultra-low delay deformation matching system. In the proposed method, the new template is generated in real time by partially updating the template descriptor and adding new keypoints simultaneously with the matching process in pixels (proposal #1), which avoids the large inter-frame delay. The size and shape of region of interest (ROI) are made flexible and the Hamming threshold used for brute-force matching is adjusted according to pixel position and the flexible ROI (proposal #2), which solves the problem of template drift. The template is recovered by the previous one with a relative center-shifting vector when it is judged as lost via region-wise difference check (proposal #3). Evaluation results indicate that the proposed method successfully achieves the real-time processing of 784 fps at the resolution of 640×480 on field-programmable gate array (FPGA), with a delay of 0.808 ms/frame, as well as achieves satisfactory deformation matching results in comparison with other general methods.

Original languageEnglish
Pages (from-to)1872-1881
Number of pages10
JournalIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
VolumeE102A
Issue number12
DOIs
Publication statusPublished - 2019

Keywords

  • Adaptive-partial template update
  • Center-shifting recovery
  • Deformable object
  • High frame rate
  • Image matching
  • Ultra-low delay

ASJC Scopus subject areas

  • Signal Processing
  • Computer Graphics and Computer-Aided Design
  • Electrical and Electronic Engineering
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Adaptive-partial template update with center-shifting recovery for high frame rate and ultra-low delay deformation matching'. Together they form a unique fingerprint.

  • Cite this