Augmented reality visualization system for intravascular neurosurgery

Yoshitaka Masutani, Takeyoshi Dohi, Fumitaka Yamane, Hiroshi Iseki, Kintomo Takakura

Research output: Contribution to journalArticle

40 Citations (Scopus)

Abstract

We aimed to construct an augmented reality-based visualization system to support intravascular neurosurgery and evaluate it in clinical environments. Three-dimensional (3D) vascular models are overlaid on motion pictures from X-ray fluoroscopy by 2D/3D registration using fiducial markers. The models are reconstructed from 3D data obtained from X-ray computed tomographic angiography or from magnetic resonance angiography using the marching-cube algorithm. Intraoperative X-ray images are mapped as texture patterns on a screen object which is displayed with the vascular models. Distortion of X- ray fluoroscopy is eliminated by a new technique of screen mesh deformation. A quantity called reprojection distance was introduced to evaluate the reliability of the displayed images. It predicts the maximum registration error around the registered objects. Analyses of reprojection distances were performed using synthetic data consisting of marker coordinates with 2D or 3D errors. The tolerance of reprojection distance for the clinical environment was determined to be 3.0 mm. The system was tested in two clinical cases in which reprojection distances of 2.6 and 2.09 mm were obtained. Construction and evaluation of our prototype system were successfully carried out. Further development is planned employing a range sensor to permit markerless registration.

Original languageEnglish
Pages (from-to)239-247
Number of pages9
JournalComputer Aided Surgery
Volume3
Issue number5
DOIs
Publication statusPublished - 1998
Externally publishedYes

Fingerprint

Neurosurgery
Augmented reality
Visualization
X-Rays
X rays
Angiography
Fluoroscopy
Blood Vessels
Fiducial Markers
Motion pictures
Magnetic Resonance Angiography
Magnetic resonance
Motion Pictures
Textures
Sensors

Keywords

  • 2D/3D registration
  • Augmented reality
  • Distortion correction
  • Fiducial markers
  • Intravascular surgery

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Surgery
  • Medicine (miscellaneous)

Cite this

Augmented reality visualization system for intravascular neurosurgery. / Masutani, Yoshitaka; Dohi, Takeyoshi; Yamane, Fumitaka; Iseki, Hiroshi; Takakura, Kintomo.

In: Computer Aided Surgery, Vol. 3, No. 5, 1998, p. 239-247.

Research output: Contribution to journalArticle

Masutani, Yoshitaka ; Dohi, Takeyoshi ; Yamane, Fumitaka ; Iseki, Hiroshi ; Takakura, Kintomo. / Augmented reality visualization system for intravascular neurosurgery. In: Computer Aided Surgery. 1998 ; Vol. 3, No. 5. pp. 239-247.
@article{5f5c45ac84694d949551bb6156aa2ee5,
title = "Augmented reality visualization system for intravascular neurosurgery",
abstract = "We aimed to construct an augmented reality-based visualization system to support intravascular neurosurgery and evaluate it in clinical environments. Three-dimensional (3D) vascular models are overlaid on motion pictures from X-ray fluoroscopy by 2D/3D registration using fiducial markers. The models are reconstructed from 3D data obtained from X-ray computed tomographic angiography or from magnetic resonance angiography using the marching-cube algorithm. Intraoperative X-ray images are mapped as texture patterns on a screen object which is displayed with the vascular models. Distortion of X- ray fluoroscopy is eliminated by a new technique of screen mesh deformation. A quantity called reprojection distance was introduced to evaluate the reliability of the displayed images. It predicts the maximum registration error around the registered objects. Analyses of reprojection distances were performed using synthetic data consisting of marker coordinates with 2D or 3D errors. The tolerance of reprojection distance for the clinical environment was determined to be 3.0 mm. The system was tested in two clinical cases in which reprojection distances of 2.6 and 2.09 mm were obtained. Construction and evaluation of our prototype system were successfully carried out. Further development is planned employing a range sensor to permit markerless registration.",
keywords = "2D/3D registration, Augmented reality, Distortion correction, Fiducial markers, Intravascular surgery",
author = "Yoshitaka Masutani and Takeyoshi Dohi and Fumitaka Yamane and Hiroshi Iseki and Kintomo Takakura",
year = "1998",
doi = "10.1002/(SICI)1097-0150(1998)3:5<239::AID-IGS3>3.0.CO;2-B",
language = "English",
volume = "3",
pages = "239--247",
journal = "Computer Assisted Surgery",
issn = "1092-9088",
publisher = "Taylor and Francis Ltd.",
number = "5",

}

TY - JOUR

T1 - Augmented reality visualization system for intravascular neurosurgery

AU - Masutani, Yoshitaka

AU - Dohi, Takeyoshi

AU - Yamane, Fumitaka

AU - Iseki, Hiroshi

AU - Takakura, Kintomo

PY - 1998

Y1 - 1998

N2 - We aimed to construct an augmented reality-based visualization system to support intravascular neurosurgery and evaluate it in clinical environments. Three-dimensional (3D) vascular models are overlaid on motion pictures from X-ray fluoroscopy by 2D/3D registration using fiducial markers. The models are reconstructed from 3D data obtained from X-ray computed tomographic angiography or from magnetic resonance angiography using the marching-cube algorithm. Intraoperative X-ray images are mapped as texture patterns on a screen object which is displayed with the vascular models. Distortion of X- ray fluoroscopy is eliminated by a new technique of screen mesh deformation. A quantity called reprojection distance was introduced to evaluate the reliability of the displayed images. It predicts the maximum registration error around the registered objects. Analyses of reprojection distances were performed using synthetic data consisting of marker coordinates with 2D or 3D errors. The tolerance of reprojection distance for the clinical environment was determined to be 3.0 mm. The system was tested in two clinical cases in which reprojection distances of 2.6 and 2.09 mm were obtained. Construction and evaluation of our prototype system were successfully carried out. Further development is planned employing a range sensor to permit markerless registration.

AB - We aimed to construct an augmented reality-based visualization system to support intravascular neurosurgery and evaluate it in clinical environments. Three-dimensional (3D) vascular models are overlaid on motion pictures from X-ray fluoroscopy by 2D/3D registration using fiducial markers. The models are reconstructed from 3D data obtained from X-ray computed tomographic angiography or from magnetic resonance angiography using the marching-cube algorithm. Intraoperative X-ray images are mapped as texture patterns on a screen object which is displayed with the vascular models. Distortion of X- ray fluoroscopy is eliminated by a new technique of screen mesh deformation. A quantity called reprojection distance was introduced to evaluate the reliability of the displayed images. It predicts the maximum registration error around the registered objects. Analyses of reprojection distances were performed using synthetic data consisting of marker coordinates with 2D or 3D errors. The tolerance of reprojection distance for the clinical environment was determined to be 3.0 mm. The system was tested in two clinical cases in which reprojection distances of 2.6 and 2.09 mm were obtained. Construction and evaluation of our prototype system were successfully carried out. Further development is planned employing a range sensor to permit markerless registration.

KW - 2D/3D registration

KW - Augmented reality

KW - Distortion correction

KW - Fiducial markers

KW - Intravascular surgery

UR - http://www.scopus.com/inward/record.url?scp=0032433498&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032433498&partnerID=8YFLogxK

U2 - 10.1002/(SICI)1097-0150(1998)3:5<239::AID-IGS3>3.0.CO;2-B

DO - 10.1002/(SICI)1097-0150(1998)3:5<239::AID-IGS3>3.0.CO;2-B

M3 - Article

C2 - 10207648

AN - SCOPUS:0032433498

VL - 3

SP - 239

EP - 247

JO - Computer Assisted Surgery

JF - Computer Assisted Surgery

SN - 1092-9088

IS - 5

ER -