Automatic real-time tracking of fetal mouth in fetoscopic video sequence for supporting fetal surgeries

Rong Xu, Tianliang Xie, Jun Ohya, Bo Zhang, Yoshinobu Sato, Masakatsu G. Fujie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Recently, a minimally invasive surgery (MIS) called fetoscopic tracheal occlusion (FETO) was developed to treat severe congenital diaphragmatic hernia (CDH) via fetoscopy, by which a detachable balloon is placed into the fetal trachea for preventing pulmonary hypoplasia through increasing the pressure of the chest cavity. This surgery is so dangerous that a supporting system for navigating surgeries is deemed necessary. In this paper, to guide a surgical tool to be inserted into the fetal trachea, an automatic approach is proposed to detect and track the fetal face and mouth via fetoscopic video sequencing. More specifically, the AdaBoost algorithm is utilized as a classifier to detect the fetal face based on Haar-like features, which calculate the difference between the sums of the pixel intensities in each adjacent region at a specific location in a detection window. Then, the CamShift algorithm based on an iterative search in a color histogram is applied to track the fetal face, and the fetal mouth is fitted by an ellipse detected via an improved iterative randomized Hough transform approach. The experimental results demonstrate that the proposed automatic approach can accurately detect and track the fetal face and mouth in real-time in a fetoscopic video sequence, as well as provide an effective and timely feedback to the robot control system of the surgical tool for FETO surgeries.

Original languageEnglish
Title of host publicationMedical Imaging 2013
Subtitle of host publicationImage-Guided Procedures, Robotic Interventions, and Modeling
DOIs
Publication statusPublished - 2013
EventMedical Imaging 2013: Image-Guided Procedures, Robotic Interventions, and Modeling - Lake Buena Vista, FL, United States
Duration: 2013 Feb 122013 Feb 14

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8671
ISSN (Print)0277-786X

Conference

ConferenceMedical Imaging 2013: Image-Guided Procedures, Robotic Interventions, and Modeling
CountryUnited States
CityLake Buena Vista, FL
Period13/2/1213/2/14

Keywords

  • AdaBoost classifier
  • CamShift algorithm
  • Fetal face tracking
  • Fetal mouth detection
  • Fetoscopic video sequence
  • Haar-like features
  • Iterative randomized hough transform (IRHT)

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Automatic real-time tracking of fetal mouth in fetoscopic video sequence for supporting fetal surgeries'. Together they form a unique fingerprint.

  • Cite this

    Xu, R., Xie, T., Ohya, J., Zhang, B., Sato, Y., & Fujie, M. G. (2013). Automatic real-time tracking of fetal mouth in fetoscopic video sequence for supporting fetal surgeries. In Medical Imaging 2013: Image-Guided Procedures, Robotic Interventions, and Modeling [86710Z] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8671). https://doi.org/10.1117/12.2002803