Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games

Izaya Nishimuta, Katsutoshi Itoyama, Kazuyoshi Yoshii, Hiroshi G. Okuno

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.

    Original languageEnglish
    Title of host publicationProceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017
    EditorsFernando G. Tinetti, Quoc-Nam Tran, Leonidas Deligiannidis, Mary Qu Yang, Mary Qu Yang, Hamid R. Arabnia
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages1787-1792
    Number of pages6
    ISBN (Electronic)9781538626528
    DOIs
    Publication statusPublished - 2018 Dec 4
    Event2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 - Las Vegas, United States
    Duration: 2017 Dec 142017 Dec 16

    Other

    Other2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017
    CountryUnited States
    CityLas Vegas
    Period17/12/1417/12/16

    Fingerprint

    Robots
    Audition
    Acoustic waves

    Keywords

    • auction interaction
    • multi-party interaction
    • quizemaster robot
    • Robot audition
    • school-class interaction

    ASJC Scopus subject areas

    • Computer Science (miscellaneous)
    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Science Applications
    • Safety, Risk, Reliability and Quality

    Cite this

    Nishimuta, I., Itoyama, K., Yoshii, K., & Okuno, H. G. (2018). Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. In F. G. Tinetti, Q-N. Tran, L. Deligiannidis, M. Q. Yang, M. Q. Yang, & H. R. Arabnia (Eds.), Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 (pp. 1787-1792). [8561078] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CSCI.2017.313

    Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. / Nishimuta, Izaya; Itoyama, Katsutoshi; Yoshii, Kazuyoshi; Okuno, Hiroshi G.

    Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. ed. / Fernando G. Tinetti; Quoc-Nam Tran; Leonidas Deligiannidis; Mary Qu Yang; Mary Qu Yang; Hamid R. Arabnia. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1787-1792 8561078.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Nishimuta, I, Itoyama, K, Yoshii, K & Okuno, HG 2018, Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. in FG Tinetti, Q-N Tran, L Deligiannidis, MQ Yang, MQ Yang & HR Arabnia (eds), Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017., 8561078, Institute of Electrical and Electronics Engineers Inc., pp. 1787-1792, 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017, Las Vegas, United States, 17/12/14. https://doi.org/10.1109/CSCI.2017.313
    Nishimuta I, Itoyama K, Yoshii K, Okuno HG. Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. In Tinetti FG, Tran Q-N, Deligiannidis L, Yang MQ, Yang MQ, Arabnia HR, editors, Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1787-1792. 8561078 https://doi.org/10.1109/CSCI.2017.313
    Nishimuta, Izaya ; Itoyama, Katsutoshi ; Yoshii, Kazuyoshi ; Okuno, Hiroshi G. / Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. editor / Fernando G. Tinetti ; Quoc-Nam Tran ; Leonidas Deligiannidis ; Mary Qu Yang ; Mary Qu Yang ; Hamid R. Arabnia. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1787-1792
    @inproceedings{9052918ff7e94c22a8959534838575fb,
    title = "Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games",
    abstract = "Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.",
    keywords = "auction interaction, multi-party interaction, quizemaster robot, Robot audition, school-class interaction",
    author = "Izaya Nishimuta and Katsutoshi Itoyama and Kazuyoshi Yoshii and Okuno, {Hiroshi G.}",
    year = "2018",
    month = "12",
    day = "4",
    doi = "10.1109/CSCI.2017.313",
    language = "English",
    pages = "1787--1792",
    editor = "Tinetti, {Fernando G.} and Quoc-Nam Tran and Leonidas Deligiannidis and Yang, {Mary Qu} and Yang, {Mary Qu} and Arabnia, {Hamid R.}",
    booktitle = "Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",

    }

    TY - GEN

    T1 - Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games

    AU - Nishimuta, Izaya

    AU - Itoyama, Katsutoshi

    AU - Yoshii, Kazuyoshi

    AU - Okuno, Hiroshi G.

    PY - 2018/12/4

    Y1 - 2018/12/4

    N2 - Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.

    AB - Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.

    KW - auction interaction

    KW - multi-party interaction

    KW - quizemaster robot

    KW - Robot audition

    KW - school-class interaction

    UR - http://www.scopus.com/inward/record.url?scp=85060575221&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85060575221&partnerID=8YFLogxK

    U2 - 10.1109/CSCI.2017.313

    DO - 10.1109/CSCI.2017.313

    M3 - Conference contribution

    AN - SCOPUS:85060575221

    SP - 1787

    EP - 1792

    BT - Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

    A2 - Tinetti, Fernando G.

    A2 - Tran, Quoc-Nam

    A2 - Deligiannidis, Leonidas

    A2 - Yang, Mary Qu

    A2 - Yang, Mary Qu

    A2 - Arabnia, Hamid R.

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -