A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research

Vahid Aryadoust, Li Ying Ng, Hiroki Sayama

研究成果: Article査読

5 被引用数 (Scopus)

抄録

Over the past decades, the application of Rasch measurement in language assessment has gradually increased. In the present study, we coded 215 papers using Rasch measurement published in 21 applied linguistics journals for multiple features. We found that seven Rasch models and 23 software packages were adopted in these papers, with many-facet Rasch measurement (n = 100) and Facets (n = 113) being the most frequently used Rasch model and software, respectively. Significant differences were detected between the number of papers that applied Rasch measurement to different language skills and components, with writing (n = 63) and grammar (n = 12) being the most and least frequently investigated, respectively. In addition, significant differences were found between the number of papers reporting person separation (n = 73, not reported: n = 142) and item separation (n = 59, not reported: n = 156) and those that did not. An alarming finding was how few papers reported unidimensionality check (n = 57 vs 158) and local independence (n = 19 vs 196). Finally, a multilayer network analysis revealed that research involving Rasch measurement has created two major discrete communities of practice (clusters), which can be characterized by features such as language skills, the Rasch models used, and the reporting of item reliability/separation vs person reliability/separation. Cluster 1 was accordingly labelled the production and performance cluster, whereas cluster 2 was labelled the perception and language elements cluster. Guidelines and recommendations for analyzing unidimensionality, local independence, data-to-model fit, and reliability in Rasch model analysis are proposed.

本文言語English
ページ(範囲)6-40
ページ数35
ジャーナルLanguage Testing
38
1
DOI
出版ステータスPublished - 2021 1

ASJC Scopus subject areas

  • 言語および言語学
  • 社会科学(その他)
  • 言語学および言語

フィンガープリント

「A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル