Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information

Keishi Nishikawa, Jun Ohya, Takashi Matsuzawa, Atsuo Takanishi, Hiroyuki Ogata, Kenji Hashimoto

研究成果: Conference contribution

抄録

In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.

元の言語English
ホスト出版物のタイトル2018 International Conference on Digital Image Computing
ホスト出版物のサブタイトルTechniques and Applications, DICTA 2018
編集者Mark Pickering, Lihong Zheng, Shaodi You, Ashfaqur Rahman, Manzur Murshed, Md Asikuzzaman, Ambarish Natu, Antonio Robles-Kelly, Manoranjan Paul
出版者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子版)9781538666029
DOI
出版物ステータスPublished - 2019 1 16
イベント2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 - Canberra, Australia
継続期間: 2018 12 102018 12 13

出版物シリーズ

名前2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018

Conference

Conference2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018
Australia
Canberra
期間18/12/1018/12/13

Fingerprint

Disasters
Cameras
Robots
Nuclear Power Plants
Accidents
Nuclear power plants
Simulators
Experiments

Keywords

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Computer Science Applications
    • Computer Vision and Pattern Recognition
    • Signal Processing
    • Health Informatics
    • Radiology Nuclear Medicine and imaging

    これを引用

    Nishikawa, K., Ohya, J., Matsuzawa, T., Takanishi, A., Ogata, H., & Hashimoto, K. (2019). Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. : M. Pickering, L. Zheng, S. You, A. Rahman, M. Murshed, M. Asikuzzaman, A. Natu, A. Robles-Kelly, ... M. Paul (版), 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018 [8615796] (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DICTA.2018.8615796

    Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. / Nishikawa, Keishi; Ohya, Jun; Matsuzawa, Takashi; Takanishi, Atsuo; Ogata, Hiroyuki; Hashimoto, Kenji.

    2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. 版 / Mark Pickering; Lihong Zheng; Shaodi You; Ashfaqur Rahman; Manzur Murshed; Md Asikuzzaman; Ambarish Natu; Antonio Robles-Kelly; Manoranjan Paul. Institute of Electrical and Electronics Engineers Inc., 2019. 8615796 (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018).

    研究成果: Conference contribution

    Nishikawa, K, Ohya, J, Matsuzawa, T, Takanishi, A, Ogata, H & Hashimoto, K 2019, Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. : M Pickering, L Zheng, S You, A Rahman, M Murshed, M Asikuzzaman, A Natu, A Robles-Kelly & M Paul (版), 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018., 8615796, 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018, Institute of Electrical and Electronics Engineers Inc., 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018, Canberra, Australia, 18/12/10. https://doi.org/10.1109/DICTA.2018.8615796
    Nishikawa K, Ohya J, Matsuzawa T, Takanishi A, Ogata H, Hashimoto K. Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. : Pickering M, Zheng L, You S, Rahman A, Murshed M, Asikuzzaman M, Natu A, Robles-Kelly A, Paul M, 編集者, 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. Institute of Electrical and Electronics Engineers Inc. 2019. 8615796. (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018). https://doi.org/10.1109/DICTA.2018.8615796
    Nishikawa, Keishi ; Ohya, Jun ; Matsuzawa, Takashi ; Takanishi, Atsuo ; Ogata, Hiroyuki ; Hashimoto, Kenji. / Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information. 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. 編集者 / Mark Pickering ; Lihong Zheng ; Shaodi You ; Ashfaqur Rahman ; Manzur Murshed ; Md Asikuzzaman ; Ambarish Natu ; Antonio Robles-Kelly ; Manoranjan Paul. Institute of Electrical and Electronics Engineers Inc., 2019. (2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018).
    @inproceedings{3d89074469e849b8aefbbd1952c11653,
    title = "Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information",
    abstract = "In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 {\%} in radius, and 0.00222 degree in orientation.",
    keywords = "3D point cloud data, disaster response robot, object detection",
    author = "Keishi Nishikawa and Jun Ohya and Takashi Matsuzawa and Atsuo Takanishi and Hiroyuki Ogata and Kenji Hashimoto",
    year = "2019",
    month = "1",
    day = "16",
    doi = "10.1109/DICTA.2018.8615796",
    language = "English",
    series = "2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    editor = "Mark Pickering and Lihong Zheng and Shaodi You and Ashfaqur Rahman and Manzur Murshed and Md Asikuzzaman and Ambarish Natu and Antonio Robles-Kelly and Manoranjan Paul",
    booktitle = "2018 International Conference on Digital Image Computing",

    }

    TY - GEN

    T1 - Automatic Detection of Valves with Disaster Response Robot on Basis of Depth Camera Information

    AU - Nishikawa, Keishi

    AU - Ohya, Jun

    AU - Matsuzawa, Takashi

    AU - Takanishi, Atsuo

    AU - Ogata, Hiroyuki

    AU - Hashimoto, Kenji

    PY - 2019/1/16

    Y1 - 2019/1/16

    N2 - In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.

    AB - In recent years, there has been an increasing demand for disaster response robots designed for working in disaster sites such as nuclear power plants where accidents have occurred. One of the tasks the robots need to complete at these kinds of sites is turning a valve. In order to employ robots to perform this task at real sites, it is desirable that the robots have autonomy for detecting the valves to be manipulated. In this paper, we propose a method that allows a disaster response robot to detect a valve, whose parameters such as position, orientation and size are unknown, based on information captured by a depth camera mounted on the robot. In our proposed algorithm, first the target valve is detected on the basis of an RGB image captured by the depth camera, and 3D point cloud data including the target is reconstructed by combining the detection result and the depth image. Second, the reconstructed point cloud data is processed to estimate parameters describing the target. Experiments were conducted on a simulator, and the results showed that our method could accurately estimate the parameters with a minimum error of 0.0230 m in position, 0.196 % in radius, and 0.00222 degree in orientation.

    KW - 3D point cloud data

    KW - disaster response robot

    KW - object detection

    UR - http://www.scopus.com/inward/record.url?scp=85062241149&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85062241149&partnerID=8YFLogxK

    U2 - 10.1109/DICTA.2018.8615796

    DO - 10.1109/DICTA.2018.8615796

    M3 - Conference contribution

    T3 - 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018

    BT - 2018 International Conference on Digital Image Computing

    A2 - Pickering, Mark

    A2 - Zheng, Lihong

    A2 - You, Shaodi

    A2 - Rahman, Ashfaqur

    A2 - Murshed, Manzur

    A2 - Asikuzzaman, Md

    A2 - Natu, Ambarish

    A2 - Robles-Kelly, Antonio

    A2 - Paul, Manoranjan

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -