Abstract
In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.
| Original language | English |
|---|---|
| Title of host publication | 2018 International Conference on Digital Image Computing |
| Subtitle of host publication | Techniques and Applications, DICTA 2018 |
| Editors | Mark Pickering, Lihong Zheng, Shaodi You, Ashfaqur Rahman, Manzur Murshed, Md Asikuzzaman, Ambarish Natu, Antonio Robles-Kelly, Manoranjan Paul |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| ISBN (Electronic) | 9781538666029 |
| DOIs | |
| Publication status | Published - 2019 Jan 16 |
| Event | 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 - Canberra, Australia Duration: 2018 Dec 10 → 2018 Dec 13 |
Publication series
| Name | 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 |
|---|
Conference
| Conference | 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 |
|---|---|
| Country | Australia |
| City | Canberra |
| Period | 18/12/10 → 18/12/13 |
Fingerprint
Keywords
- 3D point cloud data
- disaster response robot
- object detection
ASJC Scopus subject areas
- Computer Networks and Communications
- Computer Science Applications
- Computer Vision and Pattern Recognition
- Signal Processing
- Health Informatics
- Radiology Nuclear Medicine and imaging
Cite this
Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. / Nishikawa, Keishi; Ohya, Jun; Matsuzawa, Takashi; Takanishi, Atsuo; Ogata, Hiroyuki; Hashimoto, Kenji.
2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. ed. / Mark Pickering; Lihong Zheng; Shaodi You; Ashfaqur Rahman; Manzur Murshed; Md Asikuzzaman; Ambarish Natu; Antonio Robles-Kelly; Manoranjan Paul. Institute of Electrical and Electronics Engineers Inc., 2019. 8615796 (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information
AU - Nishikawa, Keishi
AU - Ohya, Jun
AU - Matsuzawa, Takashi
AU - Takanishi, Atsuo
AU - Ogata, Hiroyuki
AU - Hashimoto, Kenji
PY - 2019/1/16
Y1 - 2019/1/16
N2 - In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.
AB - In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.
KW - 3D point cloud data
KW - disaster response robot
KW - object detection
UR - http://www.scopus.com/inward/record.url?scp=85062241149&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85062241149&partnerID=8YFLogxK
U2 - 10.1109/DICTA.2018.8615796
DO - 10.1109/DICTA.2018.8615796
M3 - Conference contribution
AN - SCOPUS:85062241149
T3 - 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018
BT - 2018 International Conference on Digital Image Computing
A2 - Pickering, Mark
A2 - Zheng, Lihong
A2 - You, Shaodi
A2 - Rahman, Ashfaqur
A2 - Murshed, Manzur
A2 - Asikuzzaman, Md
A2 - Natu, Ambarish
A2 - Robles-Kelly, Antonio
A2 - Paul, Manoranjan
PB - Institute of Electrical and Electronics Engineers Inc.
ER -