Fair assessment of group work by mutual evaluation with irresponsible and collusive students using trust networks

Yumeno Shiba, Haruna Umegaki, Toshiharu Sugawara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We propose a fair peer assessment method for group work using a multi-agent trust network. Although group work is an effective educational method, accurately assessing individual students is not easy. Mutual evaluation is often used for such assessment, but often presents some potential problems such as irresponsible evaluations and collusion. Our method identifies and excludes such cheating and unfair ratings on the basis of trust networks that are often used to evaluate sellers in e-market places by using customers’ ratings. We assume a group-work course in a semester in which students mutually evaluate other group members a few (three to five) times. We introduce the iterative method for alternately generating trust networks using cluster-trust values, which represent similarity of evaluations in a cluster network. We experimentally show that our method can find the irresponsible students and collusive groups and considerably improve accuracy of final marks with only a few chances for mutual evaluations, and thereby, can provide useful information for assessments to instructors.

Original languageEnglish
Title of host publicationPRIMA 2015
Subtitle of host publicationPrinciples and Practice of Multi-Agent Systems - 18th International Conference, Proceedings
EditorsPaolo Torroni, Andrea Omicini, Jane Hsu, Qingliang Chen, Paolo Torroni, Andrea Omicini, Jane Hsu, Qingliang Chen, Serena Villata, Serena Villata
PublisherSpringer Verlag
Pages528-537
Number of pages10
ISBN (Print)9783319255231, 9783319255231
DOIs
Publication statusPublished - 2015
Event18th International Conference on Principles and Practice of Multi-Agent Systems, PRIMA 2015 - Bertinoro, Italy
Duration: 2015 Oct 262015 Oct 30

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9387
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other18th International Conference on Principles and Practice of Multi-Agent Systems, PRIMA 2015
CountryItaly
CityBertinoro
Period15/10/2615/10/30

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Fair assessment of group work by mutual evaluation with irresponsible and collusive students using trust networks'. Together they form a unique fingerprint.

Cite this