Development of microphone-array-embedded UAV for search and rescue task

Kazuhiro Nakadai, Makoto Kumon, Hiroshi G. Okuno, Kotaro Hoshiba, Mizuho Wakabayashi, Kai Washizaki, Takahiro Ishiki, Daniel Gabriel, Yoshiaki Bando, Takayuki Morito, Ryosuke Kojima, Osamu Sugiyama

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    8 Citations (Scopus)

    Abstract

    This paper addresses online outdoor sound source localization using a microphone array embedded in an unmanned aerial vehicle (UAV). In addition to sound source localization, sound source enhancement and robust communication method are also described. This system is one instance of deployment of our continuously developing open source software for robot audition called HARK (Honda Research Institute Japan Audition for Robots with Kyoto University). To improve the robustness against outdoor acoustic noise, we propose to combine two sound source localization methods based on MUSIC (multiple signal classification) to cope with trade-off between latency and noise robustness. The standard Eigenvalue decomposition based MUSIC (SEVD-MUSIC) has smaller latency but less noise robustness, whereas the incremental generalized singular value decomposition based MUSIC (iGSVD-MUSIC) has higher noise robustness but larger latency. A UAV operator can use an appropriate method according to the situation. A sound enhancement method called online robust principal component analysis (ORPCA) enables the operator to detect a target sound source more easily. To improve the stability of wireless communication, and robustness of the UAV system against weather changes, we developed data compression based on free lossless audio codec (FLAC) extended to support a 16 ch audio data stream via UDP, and developed a water-resistant microphone array. The resulting system successfully worked in an outdoor search and rescue task in ImPACT Tough Robotics Challenge in November 2016.

    Original languageEnglish
    Title of host publicationIROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages5985-5990
    Number of pages6
    Volume2017-September
    ISBN (Electronic)9781538626825
    DOIs
    Publication statusPublished - 2017 Dec 13
    Event2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017 - Vancouver, Canada
    Duration: 2017 Sep 242017 Sep 28

    Other

    Other2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017
    CountryCanada
    CityVancouver
    Period17/9/2417/9/28

    Fingerprint

    Microphones
    Unmanned aerial vehicles (UAV)
    Acoustic waves
    Audition
    Robots
    Communication
    Data compression
    Singular value decomposition
    Acoustic noise
    Principal component analysis
    Mathematical operators
    Robotics
    Water

    ASJC Scopus subject areas

    • Control and Systems Engineering
    • Software
    • Computer Vision and Pattern Recognition
    • Computer Science Applications

    Cite this

    Nakadai, K., Kumon, M., Okuno, H. G., Hoshiba, K., Wakabayashi, M., Washizaki, K., ... Sugiyama, O. (2017). Development of microphone-array-embedded UAV for search and rescue task. In IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 2017-September, pp. 5985-5990). [8206494] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2017.8206494

    Development of microphone-array-embedded UAV for search and rescue task. / Nakadai, Kazuhiro; Kumon, Makoto; Okuno, Hiroshi G.; Hoshiba, Kotaro; Wakabayashi, Mizuho; Washizaki, Kai; Ishiki, Takahiro; Gabriel, Daniel; Bando, Yoshiaki; Morito, Takayuki; Kojima, Ryosuke; Sugiyama, Osamu.

    IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems. Vol. 2017-September Institute of Electrical and Electronics Engineers Inc., 2017. p. 5985-5990 8206494.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Nakadai, K, Kumon, M, Okuno, HG, Hoshiba, K, Wakabayashi, M, Washizaki, K, Ishiki, T, Gabriel, D, Bando, Y, Morito, T, Kojima, R & Sugiyama, O 2017, Development of microphone-array-embedded UAV for search and rescue task. in IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems. vol. 2017-September, 8206494, Institute of Electrical and Electronics Engineers Inc., pp. 5985-5990, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017, Vancouver, Canada, 17/9/24. https://doi.org/10.1109/IROS.2017.8206494
    Nakadai K, Kumon M, Okuno HG, Hoshiba K, Wakabayashi M, Washizaki K et al. Development of microphone-array-embedded UAV for search and rescue task. In IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems. Vol. 2017-September. Institute of Electrical and Electronics Engineers Inc. 2017. p. 5985-5990. 8206494 https://doi.org/10.1109/IROS.2017.8206494
    Nakadai, Kazuhiro ; Kumon, Makoto ; Okuno, Hiroshi G. ; Hoshiba, Kotaro ; Wakabayashi, Mizuho ; Washizaki, Kai ; Ishiki, Takahiro ; Gabriel, Daniel ; Bando, Yoshiaki ; Morito, Takayuki ; Kojima, Ryosuke ; Sugiyama, Osamu. / Development of microphone-array-embedded UAV for search and rescue task. IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems. Vol. 2017-September Institute of Electrical and Electronics Engineers Inc., 2017. pp. 5985-5990
    @inproceedings{5c1593002ff74693ba7d57246ace5d1e,
    title = "Development of microphone-array-embedded UAV for search and rescue task",
    abstract = "This paper addresses online outdoor sound source localization using a microphone array embedded in an unmanned aerial vehicle (UAV). In addition to sound source localization, sound source enhancement and robust communication method are also described. This system is one instance of deployment of our continuously developing open source software for robot audition called HARK (Honda Research Institute Japan Audition for Robots with Kyoto University). To improve the robustness against outdoor acoustic noise, we propose to combine two sound source localization methods based on MUSIC (multiple signal classification) to cope with trade-off between latency and noise robustness. The standard Eigenvalue decomposition based MUSIC (SEVD-MUSIC) has smaller latency but less noise robustness, whereas the incremental generalized singular value decomposition based MUSIC (iGSVD-MUSIC) has higher noise robustness but larger latency. A UAV operator can use an appropriate method according to the situation. A sound enhancement method called online robust principal component analysis (ORPCA) enables the operator to detect a target sound source more easily. To improve the stability of wireless communication, and robustness of the UAV system against weather changes, we developed data compression based on free lossless audio codec (FLAC) extended to support a 16 ch audio data stream via UDP, and developed a water-resistant microphone array. The resulting system successfully worked in an outdoor search and rescue task in ImPACT Tough Robotics Challenge in November 2016.",
    author = "Kazuhiro Nakadai and Makoto Kumon and Okuno, {Hiroshi G.} and Kotaro Hoshiba and Mizuho Wakabayashi and Kai Washizaki and Takahiro Ishiki and Daniel Gabriel and Yoshiaki Bando and Takayuki Morito and Ryosuke Kojima and Osamu Sugiyama",
    year = "2017",
    month = "12",
    day = "13",
    doi = "10.1109/IROS.2017.8206494",
    language = "English",
    volume = "2017-September",
    pages = "5985--5990",
    booktitle = "IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",

    }

    TY - GEN

    T1 - Development of microphone-array-embedded UAV for search and rescue task

    AU - Nakadai, Kazuhiro

    AU - Kumon, Makoto

    AU - Okuno, Hiroshi G.

    AU - Hoshiba, Kotaro

    AU - Wakabayashi, Mizuho

    AU - Washizaki, Kai

    AU - Ishiki, Takahiro

    AU - Gabriel, Daniel

    AU - Bando, Yoshiaki

    AU - Morito, Takayuki

    AU - Kojima, Ryosuke

    AU - Sugiyama, Osamu

    PY - 2017/12/13

    Y1 - 2017/12/13

    N2 - This paper addresses online outdoor sound source localization using a microphone array embedded in an unmanned aerial vehicle (UAV). In addition to sound source localization, sound source enhancement and robust communication method are also described. This system is one instance of deployment of our continuously developing open source software for robot audition called HARK (Honda Research Institute Japan Audition for Robots with Kyoto University). To improve the robustness against outdoor acoustic noise, we propose to combine two sound source localization methods based on MUSIC (multiple signal classification) to cope with trade-off between latency and noise robustness. The standard Eigenvalue decomposition based MUSIC (SEVD-MUSIC) has smaller latency but less noise robustness, whereas the incremental generalized singular value decomposition based MUSIC (iGSVD-MUSIC) has higher noise robustness but larger latency. A UAV operator can use an appropriate method according to the situation. A sound enhancement method called online robust principal component analysis (ORPCA) enables the operator to detect a target sound source more easily. To improve the stability of wireless communication, and robustness of the UAV system against weather changes, we developed data compression based on free lossless audio codec (FLAC) extended to support a 16 ch audio data stream via UDP, and developed a water-resistant microphone array. The resulting system successfully worked in an outdoor search and rescue task in ImPACT Tough Robotics Challenge in November 2016.

    AB - This paper addresses online outdoor sound source localization using a microphone array embedded in an unmanned aerial vehicle (UAV). In addition to sound source localization, sound source enhancement and robust communication method are also described. This system is one instance of deployment of our continuously developing open source software for robot audition called HARK (Honda Research Institute Japan Audition for Robots with Kyoto University). To improve the robustness against outdoor acoustic noise, we propose to combine two sound source localization methods based on MUSIC (multiple signal classification) to cope with trade-off between latency and noise robustness. The standard Eigenvalue decomposition based MUSIC (SEVD-MUSIC) has smaller latency but less noise robustness, whereas the incremental generalized singular value decomposition based MUSIC (iGSVD-MUSIC) has higher noise robustness but larger latency. A UAV operator can use an appropriate method according to the situation. A sound enhancement method called online robust principal component analysis (ORPCA) enables the operator to detect a target sound source more easily. To improve the stability of wireless communication, and robustness of the UAV system against weather changes, we developed data compression based on free lossless audio codec (FLAC) extended to support a 16 ch audio data stream via UDP, and developed a water-resistant microphone array. The resulting system successfully worked in an outdoor search and rescue task in ImPACT Tough Robotics Challenge in November 2016.

    UR - http://www.scopus.com/inward/record.url?scp=85041952717&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85041952717&partnerID=8YFLogxK

    U2 - 10.1109/IROS.2017.8206494

    DO - 10.1109/IROS.2017.8206494

    M3 - Conference contribution

    AN - SCOPUS:85041952717

    VL - 2017-September

    SP - 5985

    EP - 5990

    BT - IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -