3D pose reconstruction with multi-perspective and spatial confidence point group for jump analysis in figure skating

L. Tian, X. Cheng, M. Honda, T. Ikenaga

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Driven by recent computer vision applications, recovering 3D pose in the field of figure skating has become increasingly important. However, conventional works have suffered because of getting 3D information based on the corresponding 2D information directly or leaving the specificity of sports out of consideration. Issues such as restriction from self-occlusion, abnormal pose, limitation of venue and so on will result in poor results. Motivated by these problems, this paper proposes a multitask architecture based on a calibrated multi-camera system to facilitate jointly 3D jump pose of figure skater in the presence of the 2D Part Confidence Map. The proposals consist of three key components: Temporal smoothness and likelihood distribution based discrete probability points selection; Multi-perspective and combinations unification based large-scale venue 3D reconstruction; Spatial confidence point group and multiple constraints based human skeleton estimation. This work can be applied to 3D animated display and video motion capture of figure skating competition. The accuracy rate on the test sequences is 82.32% in body level and 92.96% in joint level.

Original languageEnglish
Title of host publicationFifth International Workshop on Pattern Recognition
EditorsXudong Jiang, Chuan Zhang, Yinglei Song
PublisherSPIE
ISBN (Electronic)9781510638631
DOIs
Publication statusPublished - 2020
Event5th International Workshop on Pattern Recognition, IWPR 2020 - Chengdu, China
Duration: 2020 Jun 52020 Jun 7

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11526
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference5th International Workshop on Pattern Recognition, IWPR 2020
CountryChina
CityChengdu
Period20/6/520/6/7

Keywords

  • 3D human pose estimation
  • 3D reconstruction
  • jump analysis in figure skating
  • video motion understanding

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of '3D pose reconstruction with multi-perspective and spatial confidence point group for jump analysis in figure skating'. Together they form a unique fingerprint.

  • Cite this

    Tian, L., Cheng, X., Honda, M., & Ikenaga, T. (2020). 3D pose reconstruction with multi-perspective and spatial confidence point group for jump analysis in figure skating. In X. Jiang, C. Zhang, & Y. Song (Eds.), Fifth International Workshop on Pattern Recognition [115260G] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11526). SPIE. https://doi.org/10.1117/12.2574598