Catchments, prosody and discourse

David Mc Neill, Francis Quek, Karl Erik Mc Cullough, Susan Duncan, Nobuhiro Furuyama, Robert Bryll, Xin Feng Ma, Rashid Ansari

Research output: Contribution to journalArticle

57 Citations (Scopus)

Abstract

We present our work on the temporal integration of hierarchies of communicative actions: kinesic, prosodic and discursive.We use the device of the ‘catchment’ as the locus around which this integration proceeds.We present a detailed case study of a gesture and speech elicitation experiment in which a subject describes her living space to an interlocutor. First, we process the video data to obtain the motion traces of both of the subject’s hands using the vector coherence mapping algorithm.We code the gestures to identify the catchments.We recover discourse purposes utilizing a system of guided questions. Finally, we define prosody in terms of the ToBI system. The results of these analyses are compared against the computed motion traces to identify the cues accessible in the gestural and audio data that correlate well with the psycholinguistic analyses. The results show that motion, prosody and discourse structure are integrated at each moment of speaking.

Original languageEnglish
Pages (from-to)9-33
Number of pages25
JournalGesture
Volume1
Issue number1
DOIs
Publication statusPublished - 2001
Externally publishedYes

Keywords

  • Catchments
  • Discourse
  • Discourse purposes
  • Gesture groups
  • Temporal integration
  • Tobi

ASJC Scopus subject areas

  • Cultural Studies
  • Experimental and Cognitive Psychology
  • Communication
  • Linguistics and Language

Fingerprint Dive into the research topics of 'Catchments, prosody and discourse'. Together they form a unique fingerprint.

  • Cite this

    Mc Neill, D., Quek, F., Mc Cullough, K. E., Duncan, S., Furuyama, N., Bryll, R., Ma, X. F., & Ansari, R. (2001). Catchments, prosody and discourse. Gesture, 1(1), 9-33. https://doi.org/10.1075/gest.1.1.03mcn