Development of multimodal discourse comprehension: cohesive use of space by gestures

Kazuki Sekine, Sotaro Kita

研究成果: Article査読

8 被引用数 (Scopus)

抄録

This study examined how well 5-, 6-, 10-year-olds and adults integrated information from spoken discourse with cohesive use of space in gesture, in comprehension. In Experiment 1, participants were presented with a combination of spoken discourse and a sequence of cohesive gestures, which consistently located each of the two protagonists in two distinct locations in gesture space. Participants were asked to select an interpretation of the final sentence that best matched the preceding spoken and gestural contexts. Adults and 10-year-olds performed better than 5-year-olds, who were at chance level. In Experiment 2, another group of 5-year-olds was presented with the same stimuli as in Experiment 1, except that the actor showed hand-held pictures, instead of producing cohesive gestures. Unlike cohesive gestures, one set of pictures was self-explanatory and did not require integration with the concurrent speech to derive the referent. With these pictures, 5-year-olds performed nearly perfectly and their performance in the identifiable pictures was significantly better than those in the unidentifiable pictures. These results suggest that young children failed to integrate spoken discourse and cohesive use of space in gestures, because they cannot derive a referent of cohesive gestures from the local speech context.

本文言語English
ページ(範囲)1245-1258
ページ数14
ジャーナルLanguage, Cognition and Neuroscience
30
10
DOI
出版ステータスPublished - 2015 11 26
外部発表はい

ASJC Scopus subject areas

  • 言語および言語学
  • 実験心理学および認知心理学
  • 言語学および言語
  • 認知神経科学

フィンガープリント

「Development of multimodal discourse comprehension: cohesive use of space by gestures」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル