3D surface reconstruction based on image stitching from gastric endoscopic video sequence

Mengyao Duan, Rong Xu, Jun Ohya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper proposes a method for reconstructing 3D detailed structures of internal organs such as gastric wall from endoscopic video sequences. The proposed method consists of the four major steps: Feature-point-based 3D reconstruction, 3D point cloud stitching, dense point cloud creation and Poisson surface reconstruction. Before the first step, we partition one video sequence into groups, where each group consists of two successive frames (image pairs), and each pair in each group contains one overlapping part, which is used as a stitching region. Fist, the 3D point cloud of each group is reconstructed by utilizing structure from motion (SFM). Secondly, a scheme based on SIFT features registers and stitches the obtained 3D point clouds, by estimating the transformation matrix of the overlapping part between different groups with high accuracy and efficiency. Thirdly, we select the most robust SIFT feature points as the seed points, and then obtain the dense point cloud from sparse point cloud via a depth testing method presented by Furukawa. Finally, by utilizing Poisson surface reconstruction, polygonal patches for the internal organs are obtained. Experimental results demonstrate that the proposed method achieves a high accuracy and efficiency for 3D reconstruction of gastric surface from an endoscopic video sequence.

Original languageEnglish
Title of host publicationApplications of Digital Image Processing XXXVI
DOIs
Publication statusPublished - 2013 Nov 8
EventApplications of Digital Image Processing XXXVI - San Diego, CA, United States
Duration: 2013 Aug 262013 Aug 29

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8856
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceApplications of Digital Image Processing XXXVI
CountryUnited States
CitySan Diego, CA
Period13/8/2613/8/29

Keywords

  • 3D point cloud stitching
  • Poisson surface reconstruction
  • SIFT
  • Structure-from-motion (SFM)
  • depth testing

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of '3D surface reconstruction based on image stitching from gastric endoscopic video sequence'. Together they form a unique fingerprint.

  • Cite this

    Duan, M., Xu, R., & Ohya, J. (2013). 3D surface reconstruction based on image stitching from gastric endoscopic video sequence. In Applications of Digital Image Processing XXXVI [88561I] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8856). https://doi.org/10.1117/12.2022531