Fair assessment of group work by mutual evaluation based on trust network

Yumeno Shiba, Toshiharu Sugawara

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    4 Citations (Scopus)

    Abstract

    We propose a method for fair and accurate assessment of group work based on trust networks generated by mutual evaluations. Group work is often used for educational activities in universities since it is an effective way to acquire useful knowledge in a number of practical subjects. One drawback is the difficulty of deciding on final marks. Some students may work quite hard whereas others may rarely participate in the group work, but it is almost impossible for professors/instructors to identify contributions of individual students in detail. In contrast, students in the same group are obvious choices for appropriate evaluators of other members since they have first-hand knowledge of the collaborative work. However, some students may be irresponsible for their ratings and submit disputable evaluations, resulting in inaccurate marks. We introduce a simple mutual evaluation method and generate trust networks expressing the distances between evaluations in this paper. After that, disputable evaluations are excluded and students are marked again. We also examine a grouping strategy to detect irresponsible students more accurately. We demonstrate the effectiveness and limitations of our method using multi-agent simulation. Results show that our method can help with the marking of individual students in a group work.

    Original languageEnglish
    Title of host publicationProceedings - Frontiers in Education Conference, FIE
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Volume2015-February
    EditionFebruary
    DOIs
    Publication statusPublished - 2015 Feb 17
    Event44th Annual Frontiers in Education Conference, FIE 2014 - Madrid, Spain
    Duration: 2014 Oct 222014 Oct 25

    Other

    Other44th Annual Frontiers in Education Conference, FIE 2014
    CountrySpain
    CityMadrid
    Period14/10/2214/10/25

    Keywords

    • Cooperative learning
    • Fair assessment
    • Mutual evaluation
    • Trust network

    ASJC Scopus subject areas

    • Computer Science Applications
    • Software
    • Education

    Fingerprint Dive into the research topics of 'Fair assessment of group work by mutual evaluation based on trust network'. Together they form a unique fingerprint.

  • Cite this

    Shiba, Y., & Sugawara, T. (2015). Fair assessment of group work by mutual evaluation based on trust network. In Proceedings - Frontiers in Education Conference, FIE (February ed., Vol. 2015-February). [7044121] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE.2014.7044121