Lending a hand to storytelling: Gesture’s effects on narrative comprehension moderated by task difficulty and cognitive ability

Nicola McKern*, Nicole Dargue, Naomi Sweller, Kazuki Sekine, Elizabeth Austin

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Compelling evidence suggests observing iconic gestures benefits learning. While emerging evidence suggests typical iconic gestures benefit comprehension to a greater extent than atypical iconic gestures, it is unclear precisely when and for whom these gestures will be most helpful. The current study investigated factors that may moderate when and for whom gesture benefits narrative comprehension most, including the type of gesture, task difficulty, and individual differences in cognitive ability. Participants were shown a video narrative in which they observed either typical gestures (commonly produced gestures, highly semantically related to accompanying speech), atypical gestures (gestures that are seldom produced), or no gestures. The video narrative was either viewed with interference (background noise to increase task difficulty) or no interference (no background noise). To determine whether the effects of gesture observation and externally imposed task difficulty on narrative comprehension further depend on an individual’s cognitive abilities, participants completed four measures of cognitive abilities (immediate and delayed non-verbal memory, attention, and intellectual ability). Observing typical gestures significantly benefitted narrative comprehension compared with atypical and no gestures combined, which did not differ significantly. Participants with below average and average levels of delayed non-verbal memory benefitted more from typical gestures than atypical or no gestures compared with those with an above average level of delayed non-verbal memory. However, this interaction was only significant when the task was difficult (i.e., with interference) but not when the task was simple (i.e., no interference). This finding suggests that the type of iconic gesture observed may affect gesture’s beneficial effect on narrative comprehension, and that such gestures may be more beneficial in difficult tasks, but only for certain individuals.

Original languageEnglish
Pages (from-to)1791-1805
Number of pages15
JournalQuarterly Journal of Experimental Psychology
Volume74
Issue number10
DOIs
Publication statusPublished - 2021 Oct

Keywords

  • cognitive ability
  • iconic gesture
  • individual differences
  • Narrative comprehension
  • task difficulty

ASJC Scopus subject areas

  • Physiology
  • Neuropsychology and Physiological Psychology
  • Experimental and Cognitive Psychology
  • Psychology(all)
  • Physiology (medical)

Fingerprint

Dive into the research topics of 'Lending a hand to storytelling: Gesture’s effects on narrative comprehension moderated by task difficulty and cognitive ability'. Together they form a unique fingerprint.

Cite this