Automatic video tagging method for cortical mapping in awake craniotomy records

Toshihiko Nishimura, Tomoharu Nagao, Hiroshi Iseki, Yoshihiro Muragaki, Manabu Tamura, Shinji Minami

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Operation video recording is one of efficient methods for analyzing surgical workflow and intraoperative incident detection. In "Intelligent Operating Room" at Tokyo Women's Medical University Hospital, the special neurological surgery called awake craniotomy is recorded by video recording system IEMAS (Intraoperative Examination Monitor for Awake Surgery). There are a number of useful video records of surgical procedure such as patient reactions and surgical operations. However, these surgical event tags which are used for surgcial workflow analysis are not contained in IEMAS records. IEMAS is composed multi-view video cameras, so manual tagging for video records is a lot of labor because of the large length of surgical operation videos. In awake craniotomy, electrical stimulation is one of significant surgical operations for detecting eloquent brain areas. In this paper, we propose the automatic detection method for the stimulation points onto patient's brain areas from raw IEMAS video records by using image processing approach. In the previous work, we proposed stimulation timing detection method from surgery sound records of IEMAS. Hence, we propose a detection method of surgical instrument for electrical stimulation in order to tag the stimulated positions on surgical view. However, detected positions on the video frame coordinates depend on camera view changes. Therefore, we map video frame positions to representative video frame positions by using homography transformation in order to enable to analyze stimulated points relation. We applied automatic video tagging method for several raw IEMAS video records and show its performance.

Original languageEnglish
Title of host publicationConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2637-2642
Number of pages6
Volume2014-January
EditionJanuary
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event2014 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2014 - San Diego, United States
Duration: 2014 Oct 52014 Oct 8

Other

Other2014 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2014
CountryUnited States
CitySan Diego
Period14/10/514/10/8

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Automatic video tagging method for cortical mapping in awake craniotomy records'. Together they form a unique fingerprint.

  • Cite this

    Nishimura, T., Nagao, T., Iseki, H., Muragaki, Y., Tamura, M., & Minami, S. (2014). Automatic video tagging method for cortical mapping in awake craniotomy records. In Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics (January ed., Vol. 2014-January, pp. 2637-2642). [6974325] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/smc.2014.6974325