How human can interact with android? Multi-modal analysis of "three sisters, android version: A play"

Hiromichi Hosoma, Mayumi Bono, Hiroshi Ishiguro, Oriza Hirata

Research output: Contribution to journalArticle

Abstract

When the presence and the action of an android reach to those of human, andoroid can derive multi-modal action from human. How can human parties act with the android to organize the interaction and find the android as the social actor? We observed the development process of the play "Three Sisters, Android Version", and analyzed the multi-modal interaction between the android and human players in the process. As the result, the actors express the assessment of human likeness of the android with their utterances and body movements, and the border between human and machine was expressed with each modality in different way. Moreover, these expressions are not one-way product by the writer and director, but the product of repeated interactions between the actors and the android through the practice and rehearsals. Finally we discuss the possibility of "media equation" study using the direct observations of man-machine interaction.

Original languageEnglish
Pages (from-to)60-68
Number of pages9
JournalTransactions of the Japanese Society for Artificial Intelligence
Volume29
Issue number1
DOIs
Publication statusPublished - 2014 Jan 1
Externally publishedYes

Fingerprint

Modal analysis
Human computer interaction

Keywords

  • Android
  • Conversation analysis
  • Gesture
  • Media equation
  • Multi-modality

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

How human can interact with android? Multi-modal analysis of "three sisters, android version : A play". / Hosoma, Hiromichi; Bono, Mayumi; Ishiguro, Hiroshi; Hirata, Oriza.

In: Transactions of the Japanese Society for Artificial Intelligence, Vol. 29, No. 1, 01.01.2014, p. 60-68.

Research output: Contribution to journalArticle

@article{b682b52d2c224c2aacf002a399eaf3c1,
title = "How human can interact with android? Multi-modal analysis of {"}three sisters, android version: A play{"}",
abstract = "When the presence and the action of an android reach to those of human, andoroid can derive multi-modal action from human. How can human parties act with the android to organize the interaction and find the android as the social actor? We observed the development process of the play {"}Three Sisters, Android Version{"}, and analyzed the multi-modal interaction between the android and human players in the process. As the result, the actors express the assessment of human likeness of the android with their utterances and body movements, and the border between human and machine was expressed with each modality in different way. Moreover, these expressions are not one-way product by the writer and director, but the product of repeated interactions between the actors and the android through the practice and rehearsals. Finally we discuss the possibility of {"}media equation{"} study using the direct observations of man-machine interaction.",
keywords = "Android, Conversation analysis, Gesture, Media equation, Multi-modality",
author = "Hiromichi Hosoma and Mayumi Bono and Hiroshi Ishiguro and Oriza Hirata",
year = "2014",
month = "1",
day = "1",
doi = "10.1527/tjsai.29.60",
language = "English",
volume = "29",
pages = "60--68",
journal = "Transactions of the Japanese Society for Artificial Intelligence",
issn = "1346-0714",
publisher = "Japanese Society for Artificial Intelligence",
number = "1",

}

TY - JOUR

T1 - How human can interact with android? Multi-modal analysis of "three sisters, android version

T2 - A play"

AU - Hosoma, Hiromichi

AU - Bono, Mayumi

AU - Ishiguro, Hiroshi

AU - Hirata, Oriza

PY - 2014/1/1

Y1 - 2014/1/1

N2 - When the presence and the action of an android reach to those of human, andoroid can derive multi-modal action from human. How can human parties act with the android to organize the interaction and find the android as the social actor? We observed the development process of the play "Three Sisters, Android Version", and analyzed the multi-modal interaction between the android and human players in the process. As the result, the actors express the assessment of human likeness of the android with their utterances and body movements, and the border between human and machine was expressed with each modality in different way. Moreover, these expressions are not one-way product by the writer and director, but the product of repeated interactions between the actors and the android through the practice and rehearsals. Finally we discuss the possibility of "media equation" study using the direct observations of man-machine interaction.

AB - When the presence and the action of an android reach to those of human, andoroid can derive multi-modal action from human. How can human parties act with the android to organize the interaction and find the android as the social actor? We observed the development process of the play "Three Sisters, Android Version", and analyzed the multi-modal interaction between the android and human players in the process. As the result, the actors express the assessment of human likeness of the android with their utterances and body movements, and the border between human and machine was expressed with each modality in different way. Moreover, these expressions are not one-way product by the writer and director, but the product of repeated interactions between the actors and the android through the practice and rehearsals. Finally we discuss the possibility of "media equation" study using the direct observations of man-machine interaction.

KW - Android

KW - Conversation analysis

KW - Gesture

KW - Media equation

KW - Multi-modality

UR - http://www.scopus.com/inward/record.url?scp=84940350661&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940350661&partnerID=8YFLogxK

U2 - 10.1527/tjsai.29.60

DO - 10.1527/tjsai.29.60

M3 - Article

AN - SCOPUS:84940350661

VL - 29

SP - 60

EP - 68

JO - Transactions of the Japanese Society for Artificial Intelligence

JF - Transactions of the Japanese Society for Artificial Intelligence

SN - 1346-0714

IS - 1

ER -