Effects of visual speech information on native listener judgments of L2 consonant intelligibility

Saya Kawase, Yue Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The present study examines how visual information in nonnative phonemes affects perceptual accuracy of second language (L2) speech production. Native Canadian English listeners perceived three English phonemic contrasts produced by native speakers of Japanese as well as native speakers of Canadian English as controls, under audiovisual (AV), audioonly (AO), and visual-only (VO) conditions. The phonemes include/v, ?, l, ?/, which are not existent in Japanese (L2 phonemes) as well as/b, s/that are shared in both Japanese and English consonant inventories. The results showed that the English listeners perceived the Japanese productions of the phonemes/b, v, s, ?/as significantly more intelligible when presented with the AV condition compared to the AO condition, indicating facilitative effects of visual speech information on their perceptual accuracy of nonnative production. However, the Japanese production of/?/was perceived as less intelligible in the AV condition compared to the AO condition, indicating that nonnative speakers' incorrect articulatory configurations may decrease the degree of intelligibility. These results suggest that listener judgments of L2 productions may be either positively or negatively affected by additional visual speech information.

Original languageEnglish
Title of host publication13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012
Pages1710-1713
Number of pages4
Volume2
Publication statusPublished - 2012
Externally publishedYes
Event13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012 - Portland, OR
Duration: 2012 Sep 92012 Sep 13

Other

Other13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012
CityPortland, OR
Period12/9/912/9/13

Fingerprint

listener
language

Keywords

  • Audiovisual speech
  • Japanese learners of English
  • Perception of L2 consonants

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Communication

Cite this

Kawase, S., & Wang, Y. (2012). Effects of visual speech information on native listener judgments of L2 consonant intelligibility. In 13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012 (Vol. 2, pp. 1710-1713)

Effects of visual speech information on native listener judgments of L2 consonant intelligibility. / Kawase, Saya; Wang, Yue.

13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012. Vol. 2 2012. p. 1710-1713.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kawase, S & Wang, Y 2012, Effects of visual speech information on native listener judgments of L2 consonant intelligibility. in 13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012. vol. 2, pp. 1710-1713, 13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012, Portland, OR, 12/9/9.
Kawase S, Wang Y. Effects of visual speech information on native listener judgments of L2 consonant intelligibility. In 13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012. Vol. 2. 2012. p. 1710-1713
Kawase, Saya ; Wang, Yue. / Effects of visual speech information on native listener judgments of L2 consonant intelligibility. 13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012. Vol. 2 2012. pp. 1710-1713
@inproceedings{49a7a08289e24421aa15f59414c85973,
title = "Effects of visual speech information on native listener judgments of L2 consonant intelligibility",
abstract = "The present study examines how visual information in nonnative phonemes affects perceptual accuracy of second language (L2) speech production. Native Canadian English listeners perceived three English phonemic contrasts produced by native speakers of Japanese as well as native speakers of Canadian English as controls, under audiovisual (AV), audioonly (AO), and visual-only (VO) conditions. The phonemes include/v, ?, l, ?/, which are not existent in Japanese (L2 phonemes) as well as/b, s/that are shared in both Japanese and English consonant inventories. The results showed that the English listeners perceived the Japanese productions of the phonemes/b, v, s, ?/as significantly more intelligible when presented with the AV condition compared to the AO condition, indicating facilitative effects of visual speech information on their perceptual accuracy of nonnative production. However, the Japanese production of/?/was perceived as less intelligible in the AV condition compared to the AO condition, indicating that nonnative speakers' incorrect articulatory configurations may decrease the degree of intelligibility. These results suggest that listener judgments of L2 productions may be either positively or negatively affected by additional visual speech information.",
keywords = "Audiovisual speech, Japanese learners of English, Perception of L2 consonants",
author = "Saya Kawase and Yue Wang",
year = "2012",
language = "English",
isbn = "9781622767595",
volume = "2",
pages = "1710--1713",
booktitle = "13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012",

}

TY - GEN

T1 - Effects of visual speech information on native listener judgments of L2 consonant intelligibility

AU - Kawase, Saya

AU - Wang, Yue

PY - 2012

Y1 - 2012

N2 - The present study examines how visual information in nonnative phonemes affects perceptual accuracy of second language (L2) speech production. Native Canadian English listeners perceived three English phonemic contrasts produced by native speakers of Japanese as well as native speakers of Canadian English as controls, under audiovisual (AV), audioonly (AO), and visual-only (VO) conditions. The phonemes include/v, ?, l, ?/, which are not existent in Japanese (L2 phonemes) as well as/b, s/that are shared in both Japanese and English consonant inventories. The results showed that the English listeners perceived the Japanese productions of the phonemes/b, v, s, ?/as significantly more intelligible when presented with the AV condition compared to the AO condition, indicating facilitative effects of visual speech information on their perceptual accuracy of nonnative production. However, the Japanese production of/?/was perceived as less intelligible in the AV condition compared to the AO condition, indicating that nonnative speakers' incorrect articulatory configurations may decrease the degree of intelligibility. These results suggest that listener judgments of L2 productions may be either positively or negatively affected by additional visual speech information.

AB - The present study examines how visual information in nonnative phonemes affects perceptual accuracy of second language (L2) speech production. Native Canadian English listeners perceived three English phonemic contrasts produced by native speakers of Japanese as well as native speakers of Canadian English as controls, under audiovisual (AV), audioonly (AO), and visual-only (VO) conditions. The phonemes include/v, ?, l, ?/, which are not existent in Japanese (L2 phonemes) as well as/b, s/that are shared in both Japanese and English consonant inventories. The results showed that the English listeners perceived the Japanese productions of the phonemes/b, v, s, ?/as significantly more intelligible when presented with the AV condition compared to the AO condition, indicating facilitative effects of visual speech information on their perceptual accuracy of nonnative production. However, the Japanese production of/?/was perceived as less intelligible in the AV condition compared to the AO condition, indicating that nonnative speakers' incorrect articulatory configurations may decrease the degree of intelligibility. These results suggest that listener judgments of L2 productions may be either positively or negatively affected by additional visual speech information.

KW - Audiovisual speech

KW - Japanese learners of English

KW - Perception of L2 consonants

UR - http://www.scopus.com/inward/record.url?scp=84878385358&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878385358&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84878385358

SN - 9781622767595

VL - 2

SP - 1710

EP - 1713

BT - 13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012

ER -