Utility of gestural cues in indexing semantic miscommunication

Masashi Inoue, Mitsunori Ogihara, Ryoko Hanada, Nobuhiro Furuyama

研究成果: Conference contribution

3 引用 (Scopus)

抜粋

In multimedia data analysis, automated indexing of conversational video is an emerging topic. One challenging problem in this topic is the recognition of higher-level concepts, such as miscommunications in conversations. While detecting miscommunications is generally easy for speakers as well as observers, it is not currently understood which cues contribute to their detection and to what extent. To make use of the knowledge on gestural cues in multimedia systems, the applicability of machine learning is investigated as a means of detecting miscommunication from gestural patterns observed in psychotherapeutic face-to-face conversations. Various features are taken from gesture data, and both simple and complex classifiers are constructed using these features. Both short-term and long-term effects are tested using different time window sizes. Also, two types of gestures, communicative and non-communicative, are considered. The experimental results suggest that there is no single gestural feature that can explain the occurrence of semantic miscommunication. Another interesting finding is that gestural cues correlate more with long-term gestural patterns than with short-term ones.

元の言語English
ホスト出版物のタイトル2010 5th International Conference on Future Information Technology, FutureTech 2010 - Proceedings
DOI
出版物ステータスPublished - 2010 7 14
外部発表Yes
イベント5th International Conference on Future Information Technology, FutureTech 2010 - Busan, Korea, Republic of
継続期間: 2010 5 202010 5 24

出版物シリーズ

名前2010 5th International Conference on Future Information Technology, FutureTech 2010 - Proceedings

Conference

Conference5th International Conference on Future Information Technology, FutureTech 2010
Korea, Republic of
Busan
期間10/5/2010/5/24

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

フィンガープリント Utility of gestural cues in indexing semantic miscommunication' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Inoue, M., Ogihara, M., Hanada, R., & Furuyama, N. (2010). Utility of gestural cues in indexing semantic miscommunication. : 2010 5th International Conference on Future Information Technology, FutureTech 2010 - Proceedings [5482653] (2010 5th International Conference on Future Information Technology, FutureTech 2010 - Proceedings). https://doi.org/10.1109/FUTURETECH.2010.5482653