SSPA: an effective semi-supervised peer assessment method for large scale MOOCs

Yufeng Wang, Hui Fang, Qun Jin, Jianhua Ma

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Peer assessment has become a primary solution to the challenge of evaluating a large number of students in Massive Open Online Courses (MOOCs). In peer assessment, all students need to evaluate a subset of other students’ assignments, and then these peer grades are aggregated to predict a final score for each student. Unfortunately, due to the lack of grading experience or the heterogeneous grading abilities, students may introduce unintentional deviations in the evaluation. This paper proposes and implements a semi-supervised peer assessment method (SSPA) that incorporates a small number of teacher’s gradings as ground truth, and uses them to externally calibrate the procedure of aggregating peer grades. Specifically, each student’s grading ability is directly (if students have common peer assessments with teacher) or indirectly (if students have no common peer assessments with teacher) measured with the grading similarity between the student and teacher. Then, SSPA utilizes the weighted aggregation of peer grades to infer the final score of each student. Based on both real dataset and synthetic datasets, the experimental results illustrate that SSPA performs better than the existing methods.

Original languageEnglish
JournalInteractive Learning Environments
DOIs
Publication statusAccepted/In press - 2019
Externally publishedYes

Keywords

  • Massive open online courses (MOOCs)
  • accuracy
  • grading ability
  • peer grading
  • semi-supervised learning

ASJC Scopus subject areas

  • Education
  • Computer Science Applications

Fingerprint Dive into the research topics of 'SSPA: an effective semi-supervised peer assessment method for large scale MOOCs'. Together they form a unique fingerprint.

  • Cite this