Interpreting text messages with graphic facial expression by deaf and hearing people

Chihiro Saegusa, Miki Namatame, Katsumi Watanabe

Research output: Contribution to journalArticle

Abstract

In interpreting verbal messages, humans use not only verbal information but also non-verbal signals such as facial expression. For example, when a person says "yes" with a troubled face, what he or she really means appears ambiguous. In the present study, we examined how deaf and hearing people differ in perceiving real meanings in texts accompanied by representations of facial expression. Deaf and hearing participants were asked to imagine that the face presented on the computer monitor was asked a question from another person (e.g., do you like her?). They observed either a realistic or a schematic face with a different magnitude of positive or negative expression on a computer monitor. A balloon that contained either a positive or negative text response to the question appeared at the same time as the face. Then, participants rated how much the individual on the monitor really meant it (i.e., perceived earnestness), using a 7-point scale. Results showed that the facial expression significantly modulated the perceived earnestness. The influence of positive expression on negative text responses was relatively weaker than that of negative expression on positive responses (i.e., "no" tended to mean "no" irrespective of facial expression) for both participant groups. However, this asymmetrical effect was stronger in the hearing group. These results suggest that the contribution of facial expression in perceiving real meanings from text messages is qualitatively similar but quantitatively different between deaf and hearing people.

Original languageEnglish
Article number383
JournalFrontiers in Psychology
Volume6
Issue numberAPR
DOIs
Publication statusPublished - 2015
Externally publishedYes

Fingerprint

Text Messaging
Facial Expression
Hearing

Keywords

  • Chat
  • Deaf
  • Earnestness
  • Hearing
  • Smileys
  • Social signals
  • Text interpretation

ASJC Scopus subject areas

  • Psychology(all)

Cite this

Interpreting text messages with graphic facial expression by deaf and hearing people. / Saegusa, Chihiro; Namatame, Miki; Watanabe, Katsumi.

In: Frontiers in Psychology, Vol. 6, No. APR, 383, 2015.

Research output: Contribution to journalArticle

@article{3fc92d3f1ad548568ba2b26221ec5384,
title = "Interpreting text messages with graphic facial expression by deaf and hearing people",
abstract = "In interpreting verbal messages, humans use not only verbal information but also non-verbal signals such as facial expression. For example, when a person says {"}yes{"} with a troubled face, what he or she really means appears ambiguous. In the present study, we examined how deaf and hearing people differ in perceiving real meanings in texts accompanied by representations of facial expression. Deaf and hearing participants were asked to imagine that the face presented on the computer monitor was asked a question from another person (e.g., do you like her?). They observed either a realistic or a schematic face with a different magnitude of positive or negative expression on a computer monitor. A balloon that contained either a positive or negative text response to the question appeared at the same time as the face. Then, participants rated how much the individual on the monitor really meant it (i.e., perceived earnestness), using a 7-point scale. Results showed that the facial expression significantly modulated the perceived earnestness. The influence of positive expression on negative text responses was relatively weaker than that of negative expression on positive responses (i.e., {"}no{"} tended to mean {"}no{"} irrespective of facial expression) for both participant groups. However, this asymmetrical effect was stronger in the hearing group. These results suggest that the contribution of facial expression in perceiving real meanings from text messages is qualitatively similar but quantitatively different between deaf and hearing people.",
keywords = "Chat, Deaf, Earnestness, Hearing, Smileys, Social signals, Text interpretation",
author = "Chihiro Saegusa and Miki Namatame and Katsumi Watanabe",
year = "2015",
doi = "10.3389/fpsyg.2015.00383",
language = "English",
volume = "6",
journal = "Frontiers in Psychology",
issn = "1664-1078",
publisher = "Frontiers Research Foundation",
number = "APR",

}

TY - JOUR

T1 - Interpreting text messages with graphic facial expression by deaf and hearing people

AU - Saegusa, Chihiro

AU - Namatame, Miki

AU - Watanabe, Katsumi

PY - 2015

Y1 - 2015

N2 - In interpreting verbal messages, humans use not only verbal information but also non-verbal signals such as facial expression. For example, when a person says "yes" with a troubled face, what he or she really means appears ambiguous. In the present study, we examined how deaf and hearing people differ in perceiving real meanings in texts accompanied by representations of facial expression. Deaf and hearing participants were asked to imagine that the face presented on the computer monitor was asked a question from another person (e.g., do you like her?). They observed either a realistic or a schematic face with a different magnitude of positive or negative expression on a computer monitor. A balloon that contained either a positive or negative text response to the question appeared at the same time as the face. Then, participants rated how much the individual on the monitor really meant it (i.e., perceived earnestness), using a 7-point scale. Results showed that the facial expression significantly modulated the perceived earnestness. The influence of positive expression on negative text responses was relatively weaker than that of negative expression on positive responses (i.e., "no" tended to mean "no" irrespective of facial expression) for both participant groups. However, this asymmetrical effect was stronger in the hearing group. These results suggest that the contribution of facial expression in perceiving real meanings from text messages is qualitatively similar but quantitatively different between deaf and hearing people.

AB - In interpreting verbal messages, humans use not only verbal information but also non-verbal signals such as facial expression. For example, when a person says "yes" with a troubled face, what he or she really means appears ambiguous. In the present study, we examined how deaf and hearing people differ in perceiving real meanings in texts accompanied by representations of facial expression. Deaf and hearing participants were asked to imagine that the face presented on the computer monitor was asked a question from another person (e.g., do you like her?). They observed either a realistic or a schematic face with a different magnitude of positive or negative expression on a computer monitor. A balloon that contained either a positive or negative text response to the question appeared at the same time as the face. Then, participants rated how much the individual on the monitor really meant it (i.e., perceived earnestness), using a 7-point scale. Results showed that the facial expression significantly modulated the perceived earnestness. The influence of positive expression on negative text responses was relatively weaker than that of negative expression on positive responses (i.e., "no" tended to mean "no" irrespective of facial expression) for both participant groups. However, this asymmetrical effect was stronger in the hearing group. These results suggest that the contribution of facial expression in perceiving real meanings from text messages is qualitatively similar but quantitatively different between deaf and hearing people.

KW - Chat

KW - Deaf

KW - Earnestness

KW - Hearing

KW - Smileys

KW - Social signals

KW - Text interpretation

UR - http://www.scopus.com/inward/record.url?scp=84930616885&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930616885&partnerID=8YFLogxK

U2 - 10.3389/fpsyg.2015.00383

DO - 10.3389/fpsyg.2015.00383

M3 - Article

AN - SCOPUS:84930616885

VL - 6

JO - Frontiers in Psychology

JF - Frontiers in Psychology

SN - 1664-1078

IS - APR

M1 - 383

ER -