Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games

Izaya Nishimuta; Katsutoshi Itoyama; Kazuyoshi Yoshii; Hiroshi G. Okuno

doi:10.1109/CSCI.2017.313

Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games

Izaya Nishimuta, Katsutoshi Itoyama, Kazuyoshi Yoshii, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.

Original language	English
Title of host publication	Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017
Editors	Fernando G. Tinetti, Quoc-Nam Tran, Leonidas Deligiannidis, Mary Qu Yang, Mary Qu Yang, Hamid R. Arabnia
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1787-1792
Number of pages	6
ISBN (Electronic)	9781538626528
DOIs	https://doi.org/10.1109/CSCI.2017.313
Publication status	Published - 2018 Dec 4
Event	2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 - Las Vegas, United States Duration: 2017 Dec 14 → 2017 Dec 16

Other

Other	2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017
Country	United States
City	Las Vegas
Period	17/12/14 → 17/12/16

Keywords

auction interaction
multi-party interaction
quizemaster robot
Robot audition
school-class interaction

ASJC Scopus subject areas

Computer Science (miscellaneous)
Artificial Intelligence
Computer Networks and Communications
Computer Science Applications
Safety, Risk, Reliability and Quality

Access to Document

10.1109/CSCI.2017.313

Fingerprint Dive into the research topics of 'Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games'. Together they form a unique fingerprint.

Cite this

Nishimuta, I., Itoyama, K., Yoshii, K., & Okuno, H. G. (2018). Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. In F. G. Tinetti, Q-N. Tran, L. Deligiannidis, M. Q. Yang, M. Q. Yang, & H. R. Arabnia (Eds.), Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 (pp. 1787-1792). [8561078] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CSCI.2017.313

Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. / Nishimuta, Izaya; Itoyama, Katsutoshi; Yoshii, Kazuyoshi; Okuno, Hiroshi G.

Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. ed. / Fernando G. Tinetti; Quoc-Nam Tran; Leonidas Deligiannidis; Mary Qu Yang; Mary Qu Yang; Hamid R. Arabnia. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1787-1792 8561078.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Nishimuta, I, Itoyama, K, Yoshii, K & Okuno, HG 2018, Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. in FG Tinetti, Q-N Tran, L Deligiannidis, MQ Yang, MQ Yang & HR Arabnia (eds), Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017., 8561078, Institute of Electrical and Electronics Engineers Inc., pp. 1787-1792, 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017, Las Vegas, United States, 17/12/14. https://doi.org/10.1109/CSCI.2017.313

Nishimuta I, Itoyama K, Yoshii K, Okuno HG. Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. In Tinetti FG, Tran Q-N, Deligiannidis L, Yang MQ, Yang MQ, Arabnia HR, editors, Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1787-1792. 8561078 https://doi.org/10.1109/CSCI.2017.313

Nishimuta, Izaya ; Itoyama, Katsutoshi ; Yoshii, Kazuyoshi ; Okuno, Hiroshi G. / Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games. Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. editor / Fernando G. Tinetti ; Quoc-Nam Tran ; Leonidas Deligiannidis ; Mary Qu Yang ; Mary Qu Yang ; Hamid R. Arabnia. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1787-1792

@inproceedings{9052918ff7e94c22a8959534838575fb,

title = "Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games",

abstract = "Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.",

keywords = "auction interaction, multi-party interaction, quizemaster robot, Robot audition, school-class interaction",

author = "Izaya Nishimuta and Katsutoshi Itoyama and Kazuyoshi Yoshii and Okuno, {Hiroshi G.}",

year = "2018",

month = dec,

day = "4",

doi = "10.1109/CSCI.2017.313",

language = "English",

pages = "1787--1792",

editor = "Tinetti, {Fernando G.} and Quoc-Nam Tran and Leonidas Deligiannidis and Yang, {Mary Qu} and Yang, {Mary Qu} and Arabnia, {Hamid R.}",

booktitle = "Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 ; Conference date: 14-12-2017 Through 16-12-2017",

}

TY - GEN

T1 - Multi-party Interactions by Quizmaster Robot in Speech-Based Jeopardy! Like Games

AU - Nishimuta, Izaya

AU - Itoyama, Katsutoshi

AU - Yoshii, Kazuyoshi

AU - Okuno, Hiroshi G.

PY - 2018/12/4

Y1 - 2018/12/4

N2 - Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.

AB - Robot Audition enables a robot to listen to simultaneous utterances via its own ears by localizing and separating sound sources and recognizing separated sounds. Although several applications are developed as a proof of concept, such capabilities of robot audition have not been well shaped in the context of applications, particularly, in multi-parson interactions. This paper focuses on the question ''what is the next step when a robot and/or system can listen to several utterances at once?'' As an example of multi-party interactions, the paper describes a quizmaster robot for speech-based Jeopardy! like games with two interaction models, school-class-type and auction-type. The player of the quiz answers a question by getting the right to answer in the former, while he/she can say an answer directly. Empirical evaluation of the system and lessons are discussed.

KW - auction interaction

KW - multi-party interaction

KW - quizemaster robot

KW - Robot audition

KW - school-class interaction

UR - http://www.scopus.com/inward/record.url?scp=85060575221&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060575221&partnerID=8YFLogxK

U2 - 10.1109/CSCI.2017.313

DO - 10.1109/CSCI.2017.313

M3 - Conference contribution

AN - SCOPUS:85060575221

SP - 1787

EP - 1792

BT - Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

A2 - Tinetti, Fernando G.

A2 - Tran, Quoc-Nam

A2 - Deligiannidis, Leonidas

A2 - Yang, Mary Qu

A2 - Arabnia, Hamid R.

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

Y2 - 14 December 2017 through 16 December 2017

ER -