Abstract
This paper proposes an Item Response Theory for peer assessment. The proposed model is a modified Graded Item Response model which incorporates the assessor's assessment criterion parameters. Its advantages are as follows: 1. The learners' abilities are evaluated on the same scale even if the assessors have different assessment criteria. 2. The learners' abilities are evaluated by taking into consideration each assessor's reliability, which produces reliable evaluation results. 3. Parameters from missing data can be easily estimated. 4. From 1-3, the parameter estimation accuracy is improved. 5. Characteristics of the tasks and assessors can be analyzed from the estimated parameters. Moreover, the two indices, "strictness of the assessment criterion" and "consistency of the assessor," are proposed based on the model. The proposed model was applied to actual data, which demonstrated its effectiveness.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 7th IASTED International Conference on Web-Based Education, WBE 2008 |
| Pages | 229-234 |
| Number of pages | 6 |
| Publication status | Published - 2008 |
| Event | 7th IASTED International Conference on Web-Based Education, WBE 2008 - Innsbruck Duration: 2008 Mar 17 → 2008 Mar 19 |
Other
| Other | 7th IASTED International Conference on Web-Based Education, WBE 2008 |
|---|---|
| City | Innsbruck |
| Period | 08/3/17 → 08/3/19 |
Keywords
- Collaborative learning
- Cscl
- E-learning
- Peer assessment
- Portfolio
ASJC Scopus subject areas
- Computer Networks and Communications
- Human-Computer Interaction
- Education