Keypoint of interest based on spatio-temporal feature considering mutual dependency and camera motion

Takahiro Suzuki, Takeshi Ikenaga

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Recently, cloud systems start to be utilized for services to analyze user's data in the region of computer vision. In these services, keypoints are extracted from images or videos and the data is identified by machine learning with large database of cloud. Conventional keypoint extraction algorithms utilize only spatial information and many unnecessary keypoints for recognition are detected. Thus, the systems have to communicate large data and require processing time of descriptor calculations. This paper proposes a spatio-temporal keypoint extraction algorithm that detects only Keypoints of Interest (KOI) based on spatio-temporal feature considering mutual dependency and camera motion. The proposed method includes an approximated Kanade-Lucas-Tomasi (KLT) tracker to calculate the positions of keypoints and optical flow. This algorithm calculates the weight at each keypoint using two kinds of features: intensity gradient and optical flow. It reduces noise of extraction by comparing with states of surrounding keypoints. The camera motion estimation is added and it calculates camera-motion invariant optical flow. Evaluation results show that the proposed algorithm achieves 95% reduction of keypoint data and 53% reduction of computational complexity comparing a conventional keypoint extraction. KOI are extracted in the region whose motion and gradient are large.

Original languageEnglish
Title of host publication6th International Conferences on Advances in Multimedia, MMEDIA 2014
EditorsPascal Lorenz
PublisherInternational Academy, Research and Industry Association, IARIA
Pages20-25
Number of pages6
ISBN (Electronic)9781612083209
Publication statusPublished - 2014 Jan 1
Event6th International Conferences on Advances in Multimedia, MMEDIA 2014 - Nice, France
Duration: 2014 Feb 232014 Feb 27

Publication series

NameMMEDIA - International Conferences on Advances in Multimedia
ISSN (Print)2308-4448

Conference

Conference6th International Conferences on Advances in Multimedia, MMEDIA 2014
CountryFrance
CityNice
Period14/2/2314/2/27

Keywords

  • Keypoint extraction
  • SIFT
  • Temporal analysis

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Keypoint of interest based on spatio-temporal feature considering mutual dependency and camera motion'. Together they form a unique fingerprint.

Cite this