Harkbird

Exploring acoustic interactions in bird communities using a microphone array

Reiji Suzuki, Shiho Matsubayashi, Richard W. Hedley, Kazuhiro Nakadai, Hiroshi G. Okuno

    Research output: Contribution to journalArticle

    5 Citations (Scopus)

    Abstract

    Understanding auditory scenes is important when deploying intelligent robots and systems in real-world environments. We believe that robot audition can better recognize acoustic events in the field as compared to conventional methods such as human observation or recording using single-channel microphone array. We are particularly interested in acoustic interactions among songbirds. Birds do not always vocalize at random, for example, but may instead divide a soundscape so that they avoid overlapping their songs with those of other birds. To understand such complex interaction processes, we must collect much spatiotemporal data in which multiple individuals and species are singing simultaneously. However, it is costly and difficult to annotate many or long recorded tracks manually to detect their interactions. In order to solve this problem, we are developing HARKBird, an easily-available and portable system consisting of a laptop PC with open-source software for robot audition HARK (Honda Research Institute Japan Audition for Robots with Kyoto University) together with a lowcost and commercially available microphone array. HARKBird enables us to extract the songs of multiple individuals from recordings automatically. In this paper, we introduce the current status of our project and report preliminary results of recording experiments in two different types of forests – one in the USA and the other in Japan-using this system to automatically estimate the direction of arrival of the songs of multiple birds, and separate them from the recordings. We also discuss asymmetries among species in terms of their tendency to partition temporal resources.

    Original languageEnglish
    Pages (from-to)213-223
    Number of pages11
    JournalJournal of Robotics and Mechatronics
    Volume29
    Issue number1
    DOIs
    Publication statusPublished - 2017 Feb 1

    Fingerprint

    Birds
    Audition
    Microphones
    Acoustics
    Robots
    Intelligent robots
    Direction of arrival
    Intelligent systems
    Experiments

    Keywords

    • Bird songs
    • HARK
    • Localization
    • Microphone array
    • Temporal soundscape partitioning

    ASJC Scopus subject areas

    • Computer Science(all)
    • Electrical and Electronic Engineering

    Cite this

    Harkbird : Exploring acoustic interactions in bird communities using a microphone array. / Suzuki, Reiji; Matsubayashi, Shiho; Hedley, Richard W.; Nakadai, Kazuhiro; Okuno, Hiroshi G.

    In: Journal of Robotics and Mechatronics, Vol. 29, No. 1, 01.02.2017, p. 213-223.

    Research output: Contribution to journalArticle

    Suzuki, Reiji ; Matsubayashi, Shiho ; Hedley, Richard W. ; Nakadai, Kazuhiro ; Okuno, Hiroshi G. / Harkbird : Exploring acoustic interactions in bird communities using a microphone array. In: Journal of Robotics and Mechatronics. 2017 ; Vol. 29, No. 1. pp. 213-223.
    @article{bdfa7153de5f4b99b0da2c986b478970,
    title = "Harkbird: Exploring acoustic interactions in bird communities using a microphone array",
    abstract = "Understanding auditory scenes is important when deploying intelligent robots and systems in real-world environments. We believe that robot audition can better recognize acoustic events in the field as compared to conventional methods such as human observation or recording using single-channel microphone array. We are particularly interested in acoustic interactions among songbirds. Birds do not always vocalize at random, for example, but may instead divide a soundscape so that they avoid overlapping their songs with those of other birds. To understand such complex interaction processes, we must collect much spatiotemporal data in which multiple individuals and species are singing simultaneously. However, it is costly and difficult to annotate many or long recorded tracks manually to detect their interactions. In order to solve this problem, we are developing HARKBird, an easily-available and portable system consisting of a laptop PC with open-source software for robot audition HARK (Honda Research Institute Japan Audition for Robots with Kyoto University) together with a lowcost and commercially available microphone array. HARKBird enables us to extract the songs of multiple individuals from recordings automatically. In this paper, we introduce the current status of our project and report preliminary results of recording experiments in two different types of forests – one in the USA and the other in Japan-using this system to automatically estimate the direction of arrival of the songs of multiple birds, and separate them from the recordings. We also discuss asymmetries among species in terms of their tendency to partition temporal resources.",
    keywords = "Bird songs, HARK, Localization, Microphone array, Temporal soundscape partitioning",
    author = "Reiji Suzuki and Shiho Matsubayashi and Hedley, {Richard W.} and Kazuhiro Nakadai and Okuno, {Hiroshi G.}",
    year = "2017",
    month = "2",
    day = "1",
    doi = "10.20965/jrm.2017.p0213",
    language = "English",
    volume = "29",
    pages = "213--223",
    journal = "Journal of Robotics and Mechatronics",
    issn = "0915-3942",
    publisher = "Fuji Technology Press",
    number = "1",

    }

    TY - JOUR

    T1 - Harkbird

    T2 - Exploring acoustic interactions in bird communities using a microphone array

    AU - Suzuki, Reiji

    AU - Matsubayashi, Shiho

    AU - Hedley, Richard W.

    AU - Nakadai, Kazuhiro

    AU - Okuno, Hiroshi G.

    PY - 2017/2/1

    Y1 - 2017/2/1

    N2 - Understanding auditory scenes is important when deploying intelligent robots and systems in real-world environments. We believe that robot audition can better recognize acoustic events in the field as compared to conventional methods such as human observation or recording using single-channel microphone array. We are particularly interested in acoustic interactions among songbirds. Birds do not always vocalize at random, for example, but may instead divide a soundscape so that they avoid overlapping their songs with those of other birds. To understand such complex interaction processes, we must collect much spatiotemporal data in which multiple individuals and species are singing simultaneously. However, it is costly and difficult to annotate many or long recorded tracks manually to detect their interactions. In order to solve this problem, we are developing HARKBird, an easily-available and portable system consisting of a laptop PC with open-source software for robot audition HARK (Honda Research Institute Japan Audition for Robots with Kyoto University) together with a lowcost and commercially available microphone array. HARKBird enables us to extract the songs of multiple individuals from recordings automatically. In this paper, we introduce the current status of our project and report preliminary results of recording experiments in two different types of forests – one in the USA and the other in Japan-using this system to automatically estimate the direction of arrival of the songs of multiple birds, and separate them from the recordings. We also discuss asymmetries among species in terms of their tendency to partition temporal resources.

    AB - Understanding auditory scenes is important when deploying intelligent robots and systems in real-world environments. We believe that robot audition can better recognize acoustic events in the field as compared to conventional methods such as human observation or recording using single-channel microphone array. We are particularly interested in acoustic interactions among songbirds. Birds do not always vocalize at random, for example, but may instead divide a soundscape so that they avoid overlapping their songs with those of other birds. To understand such complex interaction processes, we must collect much spatiotemporal data in which multiple individuals and species are singing simultaneously. However, it is costly and difficult to annotate many or long recorded tracks manually to detect their interactions. In order to solve this problem, we are developing HARKBird, an easily-available and portable system consisting of a laptop PC with open-source software for robot audition HARK (Honda Research Institute Japan Audition for Robots with Kyoto University) together with a lowcost and commercially available microphone array. HARKBird enables us to extract the songs of multiple individuals from recordings automatically. In this paper, we introduce the current status of our project and report preliminary results of recording experiments in two different types of forests – one in the USA and the other in Japan-using this system to automatically estimate the direction of arrival of the songs of multiple birds, and separate them from the recordings. We also discuss asymmetries among species in terms of their tendency to partition temporal resources.

    KW - Bird songs

    KW - HARK

    KW - Localization

    KW - Microphone array

    KW - Temporal soundscape partitioning

    UR - http://www.scopus.com/inward/record.url?scp=85013881789&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85013881789&partnerID=8YFLogxK

    U2 - 10.20965/jrm.2017.p0213

    DO - 10.20965/jrm.2017.p0213

    M3 - Article

    VL - 29

    SP - 213

    EP - 223

    JO - Journal of Robotics and Mechatronics

    JF - Journal of Robotics and Mechatronics

    SN - 0915-3942

    IS - 1

    ER -