Detecting and tracking surgical tools for recognizing phases of the awake brain tumor removal surgery

Hiroki Fujie, Keiju Hirata, Takahiro Horigome, Hiroshi Nagahashi, Jun Ohya, Manabu Tamura, Ken Masamune, Yoshihiro Muragaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In order to realize automatic recognition of surgical processes in surgical brain tumor removal using microscopic camera, we propose a method of detecting and tracking surgical tools by video analysis. The proposed method consists of a detection part and tracking part. In the detection part, object detection is performed for each frame of surgery video, and the category and bounding box are acquired frame by frame. The convolution layer strengthens the robustness using data augmentation (central cropping and random erasing). The tracking part uses SORT, which predicts and updates the acquired bounding box corrected by using Kalman Filter; next, the object ID is assigned to each corrected bounding box using the Hungarian algorithm. The accuracy of our proposed method is very high as follows. As a result of experiments on spatial detection. the mean average precision is 90.58%. the mean accuracy of frame label detection is 96.58%. These results are very promising for surgical phase recognition.

Original languageEnglish
Title of host publicationICPRAM 2019 - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods
EditorsMaria De Marsico, Gabriella Sanniti di Baja, Ana Fred
PublisherSciTePress
Pages190-199
Number of pages10
ISBN (Electronic)9789897583513
DOIs
Publication statusPublished - 2019
Event8th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2019 - Prague, Czech Republic
Duration: 2019 Feb 192019 Feb 21

Publication series

NameICPRAM 2019 - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods

Conference

Conference8th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2019
CountryCzech Republic
CityPrague
Period19/2/1919/2/21

Keywords

  • Awake Brain Tumor Removal Surgery
  • Computer Vision
  • Convolutional Neural Network
  • Data Association
  • Data Augmentation
  • Detection
  • Multiple Object Tracking

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Detecting and tracking surgical tools for recognizing phases of the awake brain tumor removal surgery'. Together they form a unique fingerprint.

  • Cite this

    Fujie, H., Hirata, K., Horigome, T., Nagahashi, H., Ohya, J., Tamura, M., Masamune, K., & Muragaki, Y. (2019). Detecting and tracking surgical tools for recognizing phases of the awake brain tumor removal surgery. In M. De Marsico, G. S. di Baja, & A. Fred (Eds.), ICPRAM 2019 - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods (pp. 190-199). (ICPRAM 2019 - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods). SciTePress. https://doi.org/10.5220/0007385701900199