How human can interact with android? Multi-modal analysis of "three sisters, android version: A play"

Hiromichi Hosoma, Mayumi Bono, Hiroshi Ishiguro, Oriza Hirata

Research output: Contribution to journalArticle


When the presence and the action of an android reach to those of human, andoroid can derive multi-modal action from human. How can human parties act with the android to organize the interaction and find the android as the social actor? We observed the development process of the play "Three Sisters, Android Version", and analyzed the multi-modal interaction between the android and human players in the process. As the result, the actors express the assessment of human likeness of the android with their utterances and body movements, and the border between human and machine was expressed with each modality in different way. Moreover, these expressions are not one-way product by the writer and director, but the product of repeated interactions between the actors and the android through the practice and rehearsals. Finally we discuss the possibility of "media equation" study using the direct observations of man-machine interaction.

Original languageEnglish
Pages (from-to)60-68
Number of pages9
JournalTransactions of the Japanese Society for Artificial Intelligence
Issue number1
Publication statusPublished - 2014 Jan 1
Externally publishedYes



  • Android
  • Conversation analysis
  • Gesture
  • Media equation
  • Multi-modality

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this