Application of three cognitive diagnosis models to ESL reading and listening assessments

Yong Won Lee, Yasuyo Sawaki

Research output: Contribution to journalArticle

40 Citations (Scopus)

Abstract

The present study investigated the functioning of three psychometric models for cognitive diagnosis - the general diagnostic model, the fusion model, and latent class analysis - when applied to large-scale English as a second language listening and reading comprehension assessments. Data used in this study were scored item responses and incidence matrices, or Q-matrices (Tatsuoka, 1983, 1990), for the Listening and Reading sections of two field test forms of the TOEFL® iBT (Test of English as a Foreign Language™). Results of empirical data analyses based on the three cognitive diagnosis models above revealed that (a) all three models adequately separated examinees into two mastery levels on most of the reading and listening skills, (b) a moderate level of across-form consistency of examinee skill mastery classification was achieved for most of the reading and listening skills as defined in this study, but (c) a large proportion of examinees were classified into "flat" profiles (i.e., "nonmasters of all skills" and "masters of all skills"). Overall, the three models produced similar results in terms of examinee classification, but some subtle differences across them were identified as well.

Original languageEnglish
Pages (from-to)239-263
Number of pages25
JournalLanguage Assessment Quarterly
Volume6
Issue number3
DOIs
Publication statusPublished - 2009 Jul 1

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language

Fingerprint Dive into the research topics of 'Application of three cognitive diagnosis models to ESL reading and listening assessments'. Together they form a unique fingerprint.

  • Cite this