Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information

Keishi Nishikawa, Jun Ohya, Takashi Matsuzawa, Atsuo Takanishi, Hiroyuki Ogata, Kenji Hashimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.

Original languageEnglish
Title of host publication2018 International Conference on Digital Image Computing
Subtitle of host publicationTechniques and Applications, DICTA 2018
EditorsMark Pickering, Lihong Zheng, Shaodi You, Ashfaqur Rahman, Manzur Murshed, Md Asikuzzaman, Ambarish Natu, Antonio Robles-Kelly, Manoranjan Paul
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538666029
DOIs
Publication statusPublished - 2019 Jan 16
Event2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 - Canberra, Australia
Duration: 2018 Dec 102018 Dec 13

Publication series

Name2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018

Conference

Conference2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018
CountryAustralia
CityCanberra
Period18/12/1018/12/13

Fingerprint

Disasters
Cameras
Robots
Nuclear Power Plants
Accidents
Nuclear power plants
Simulators
Experiments

Keywords

  • 3D point cloud data
  • disaster response robot
  • object detection

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Health Informatics
  • Radiology Nuclear Medicine and imaging

Cite this

Nishikawa, K., Ohya, J., Matsuzawa, T., Takanishi, A., Ogata, H., & Hashimoto, K. (2019). Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. In M. Pickering, L. Zheng, S. You, A. Rahman, M. Murshed, M. Asikuzzaman, A. Natu, A. Robles-Kelly, ... M. Paul (Eds.), 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 [8615796] (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DICTA.2018.8615796

Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. / Nishikawa, Keishi; Ohya, Jun; Matsuzawa, Takashi; Takanishi, Atsuo; Ogata, Hiroyuki; Hashimoto, Kenji.

2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. ed. / Mark Pickering; Lihong Zheng; Shaodi You; Ashfaqur Rahman; Manzur Murshed; Md Asikuzzaman; Ambarish Natu; Antonio Robles-Kelly; Manoranjan Paul. Institute of Electrical and Electronics Engineers Inc., 2019. 8615796 (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nishikawa, K, Ohya, J, Matsuzawa, T, Takanishi, A, Ogata, H & Hashimoto, K 2019, Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. in M Pickering, L Zheng, S You, A Rahman, M Murshed, M Asikuzzaman, A Natu, A Robles-Kelly & M Paul (eds), 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018., 8615796, 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018, Institute of Electrical and Electronics Engineers Inc., 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018, Canberra, Australia, 18/12/10. https://doi.org/10.1109/DICTA.2018.8615796
Nishikawa K, Ohya J, Matsuzawa T, Takanishi A, Ogata H, Hashimoto K. Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. In Pickering M, Zheng L, You S, Rahman A, Murshed M, Asikuzzaman M, Natu A, Robles-Kelly A, Paul M, editors, 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. Institute of Electrical and Electronics Engineers Inc. 2019. 8615796. (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018). https://doi.org/10.1109/DICTA.2018.8615796
Nishikawa, Keishi ; Ohya, Jun ; Matsuzawa, Takashi ; Takanishi, Atsuo ; Ogata, Hiroyuki ; Hashimoto, Kenji. / Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. editor / Mark Pickering ; Lihong Zheng ; Shaodi You ; Ashfaqur Rahman ; Manzur Murshed ; Md Asikuzzaman ; Ambarish Natu ; Antonio Robles-Kelly ; Manoranjan Paul. Institute of Electrical and Electronics Engineers Inc., 2019. (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018).
@inproceedings{3d89074469e849b8aefbbd1952c11653,
title = "Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information",
abstract = "In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 {\%} in radius, and 0.00222 degree in orientation.",
keywords = "3D point cloud data, disaster response robot, object detection",
author = "Keishi Nishikawa and Jun Ohya and Takashi Matsuzawa and Atsuo Takanishi and Hiroyuki Ogata and Kenji Hashimoto",
year = "2019",
month = "1",
day = "16",
doi = "10.1109/DICTA.2018.8615796",
language = "English",
series = "2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
editor = "Mark Pickering and Lihong Zheng and Shaodi You and Ashfaqur Rahman and Manzur Murshed and Md Asikuzzaman and Ambarish Natu and Antonio Robles-Kelly and Manoranjan Paul",
booktitle = "2018 International Conference on Digital Image Computing",

}

TY - GEN

T1 - Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information

AU - Nishikawa, Keishi

AU - Ohya, Jun

AU - Matsuzawa, Takashi

AU - Takanishi, Atsuo

AU - Ogata, Hiroyuki

AU - Hashimoto, Kenji

PY - 2019/1/16

Y1 - 2019/1/16

N2 - In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.

AB - In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.

KW - 3D point cloud data

KW - disaster response robot

KW - object detection

UR - http://www.scopus.com/inward/record.url?scp=85062241149&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062241149&partnerID=8YFLogxK

U2 - 10.1109/DICTA.2018.8615796

DO - 10.1109/DICTA.2018.8615796

M3 - Conference contribution

AN - SCOPUS:85062241149

T3 - 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018

BT - 2018 International Conference on Digital Image Computing

A2 - Pickering, Mark

A2 - Zheng, Lihong

A2 - You, Shaodi

A2 - Rahman, Ashfaqur

A2 - Murshed, Manzur

A2 - Asikuzzaman, Md

A2 - Natu, Ambarish

A2 - Robles-Kelly, Antonio

A2 - Paul, Manoranjan

PB - Institute of Electrical and Electronics Engineers Inc.

ER -