Study of Temporal Modified-RANSAC based method for the extraction and 3D shape reconstruction of moving objects from dynamic stereo images and for estimating the camera pose

Naotomo Tatematsu, Jun Ohya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

This paper proposes a Temporal Modified-RANSAC based method that can discriminate each moving object from the still background in the stereo video sequences acquired by moving stereo cameras, can compute the stereo cameras' egomotion, and can reconstruct the 3D structure of each moving object and the background. We compute 3D optical flows from the depth map and results of tracking feature points. We define "3D flow region" as a set of connected pixels whose 3D optical flows have a common rotation matrix and translation vector. Our Temporal Modified-RANSAC segments the detected 3D optical flows into 3D flow regions and computes the rotation matrix and translation vector for each 3D flow region. As opposed to the conventional Modified-RANSAC for only two frames, The Temporal Modified-RANSAC can handle temporal images with arbitrary length by performing the Modified-RANSAC to the set of a 3D flow region that classified in the latest frame and new 3D optical flows detected in the current frame iteratively. Finally, the 3D points computed from the depth map in all the frames are registered using each 3D flow region's matrix to the initial positions in the initial frame so that the 3D structures of the moving objects and still background are reconstructed. Experiments using multiple moving objects and real stereo sequences demonstrate promising results of our proposed method.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Intelligent Robots and Computer Vision XXVIII
Subtitle of host publicationAlgorithms and Techniques
DOIs
Publication statusPublished - 2011 Feb 28
EventIntelligent Robots and Computer Vision XXVIII: Algorithms and Techniques - San Francisco, CA, United States
Duration: 2011 Jan 242011 Jan 25

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7878
ISSN (Print)0277-786X

Conference

ConferenceIntelligent Robots and Computer Vision XXVIII: Algorithms and Techniques
CountryUnited States
CitySan Francisco, CA
Period11/1/2411/1/25

Keywords

  • 3d-reconstruction
  • Detect multiple moving objects
  • Egomotion
  • Temporal modified-RANSAC

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Study of Temporal Modified-RANSAC based method for the extraction and 3D shape reconstruction of moving objects from dynamic stereo images and for estimating the camera pose'. Together they form a unique fingerprint.

  • Cite this

    Tatematsu, N., & Ohya, J. (2011). Study of Temporal Modified-RANSAC based method for the extraction and 3D shape reconstruction of moving objects from dynamic stereo images and for estimating the camera pose. In Proceedings of SPIE-IS and T Electronic Imaging - Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques [78780E] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7878). https://doi.org/10.1117/12.872277