Study of recognizing human motion observed from an arbitrary viewpoint based on decomposition of a tensor containing multiple view motions

Takayuki Hori, Jun Ohya, Jun Kurumisawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a Tensor Decomposition based algorithm that recognizes the observed action performed by an unknown person and unknown viewpoint not included in the database. Our previous research aimed motion recognition from one single viewpoint. In this paper, we extend our approach for human motion recognition from an arbitrary viewpoint. To achieve this issue, we set tensor database which are multi-dimensional vectors with dimensions corresponding to human models, viewpoint angles, and action classes. The value of a tensor for a given combination of human silhouette model, viewpoint angle, and action class is the series of mesh feature vectors calculated each frame sequence. To recognize human motion, the actions of one of the persons in the tensor are replaced by the synthesized actions. Then, the core tensor for the replaced tensor is computed. This process is repeated for each combination of action, person, and viewpoint. For each iteration, the difference between the replaced and original core tensors is computed. The assumption that gives the minimal difference is the action recognition result. The recognition results show the validity of our proposed method, the method is experimentally compared with Nearest Neighbor rule. Our proposed method is very stable as each action was recognized with over 75% accuracy.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Computational Imaging IX
DOIs
Publication statusPublished - 2011 Mar 29
EventComputational Imaging IX - San Francisco, CA, United States
Duration: 2011 Jan 242011 Jan 25

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7873
ISSN (Print)0277-786X

Conference

ConferenceComputational Imaging IX
CountryUnited States
CitySan Francisco, CA
Period11/1/2411/1/25

Keywords

  • Computer vision
  • Core tensor
  • Human motion analysis
  • Human motion recognition
  • Motion signature
  • Multiple viewpoint
  • N-mode SVD
  • Tensor decomposition

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Study of recognizing human motion observed from an arbitrary viewpoint based on decomposition of a tensor containing multiple view motions'. Together they form a unique fingerprint.

  • Cite this

    Hori, T., Ohya, J., & Kurumisawa, J. (2011). Study of recognizing human motion observed from an arbitrary viewpoint based on decomposition of a tensor containing multiple view motions. In Proceedings of SPIE-IS and T Electronic Imaging - Computational Imaging IX [787310] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7873). https://doi.org/10.1117/12.872300