Identifying a walking human by a tensor decomposition based approach and tracking the human across discontinuous fields of views of multiple cameras

Takayuki Hori, Jun Ohya, Jun Kurumisawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a method that identifies and tracks a walking human across discontinuous fields of views of multiple cameras for the purpose of video surveillance. A typical video surveillance system has multiple cameras, but there are several spaces within the surveillance area that are not within any of the camera's field of view. Also, there are discontinuities between the fields of views of adjacent cameras. In such a system, humans need to be tracked across discontinuous fields of views of multiple cameras. Our proposed model addresses this issue using the concepts of gait pattern, gait model, and motion signature. Each human's gait pattern is constructed and stored in a database. This gait pattern spans a tensor space that consists of three dimensions: person, image feature, and spatio-temporal data. A human's gait model can be constructed from the gait pattern using the "tensor decomposition based approach" described in this paper. When human(s) appears in one of the camera's field of a view (which is often discontinuous from the other camera's field of views), the human's motion signature is calculated and compared to each person in the database's gait model. The person with the gait model that is most similar to the motion signature is identified as same person. After the person is identified, the person is tracked within the field of view of the camera using the mean-shift algorithm based on color parameters. We conducted two experiments; the first experiment was identifying and tracking humans in a single video sequence, and experiments, the percentage of subjects that were correctly identified and tracked was better than that of two currently widely-used methods, PCA and nearest-neighbor. In the second experiment was the same as the first experiment but consisted of multiple-cameras with discontinuous views. The second experiment (human tracking across discontinuous images), shows the potential validity of the proposed method in a typical surveillance system.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Computational Imaging VIII
DOIs
Publication statusPublished - 2010 May 14
EventComputational Imaging VIII - San Jose, CA, United States
Duration: 2010 Jan 182010 Jan 19

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7533
ISSN (Print)0277-786X

Conference

ConferenceComputational Imaging VIII
CountryUnited States
CitySan Jose, CA
Period10/1/1810/1/19

Keywords

  • Computer vision
  • Gait identification
  • Human motion recognition
  • Motion analysis
  • Motion signature
  • Multiple cameras
  • N-mode SVD
  • Tensor decomposition

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Identifying a walking human by a tensor decomposition based approach and tracking the human across discontinuous fields of views of multiple cameras'. Together they form a unique fingerprint.

  • Cite this

    Hori, T., Ohya, J., & Kurumisawa, J. (2010). Identifying a walking human by a tensor decomposition based approach and tracking the human across discontinuous fields of views of multiple cameras. In Proceedings of SPIE-IS and T Electronic Imaging - Computational Imaging VIII [75330X] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7533). https://doi.org/10.1117/12.838717