RankwithTA: A robust and accurate peer grading mechanism for MOOCs

Hui Fang, Yufeng Wang, Qun Jin, Jianhua Ma

研究成果: Conference contribution

3 被引用数 (Scopus)

抄録

Massive Online Open Courses (MOOCs) have the potential to revolutionize higher education with their wide outreach and accessibility. One of key challenges in MOOCs is the student evaluation: The large number of students makes it infeasible for instructors or teaching assistants (TAs) to grade all assignments. Peer grading-having students assess each other-is a promising approach to tackling the problem of evaluation at scale. The user evaluations are then used directly, or aggregated into a consensus value. However, lacking an incentive scheme, users have no motive in making effort in completing the evaluations, providing inaccurate answers instead. To address the above issues, we propose and implement a peer grading scheme, RankwithTA. Specifically, considering that the quality of a student determines both her performance in the assignment and her grading ability, RankwithTA makes the grade each student received depend on both the quality of the solution they submitted, and on the quality of their review and grading work to incentivize students' correct grading, Furthermore, the ground truth is incorporated, which utilizes external calibration by having some students graded by instructors or TAs to provide a basis for accuracy. The simulation results illustrate that RankwithTA performs better than the existing schemes.

本文言語English
ホスト出版物のタイトルProceedings of 2017 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2017
出版社Institute of Electrical and Electronics Engineers Inc.
ページ497-502
ページ数6
ISBN(電子版)9781538609002
DOI
出版ステータスPublished - 2017 7 1
イベント2017 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2017 - Tai Po, Hong Kong
継続期間: 2017 12 122017 12 14

出版物シリーズ

名前Proceedings of 2017 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2017
2018-January

Other

Other2017 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2017
国/地域Hong Kong
CityTai Po
Period17/12/1217/12/14

ASJC Scopus subject areas

  • 工学(その他)
  • 教育

フィンガープリント

「RankwithTA: A robust and accurate peer grading mechanism for MOOCs」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル