Abstract
This paper proposes an Item Response Theory for peer assessment. The proposed model is a modified Graded Item Response model which incorporates the assessor's assessment criterion parameters. Its advantages are as follows: 1. The learners' abilities are evaluated on the same scale even if the assessors have different assessment criteria. 2. The learners' abilities are evaluated by taking into consideration each assessor's reliability, which produces reliable evaluation results. 3. Parameters from missing data can be easily estimated. 4. From 1-3, the parameter estimation accuracy is improved. 5. Characteristics of the tasks and assessors can be analyzed from the estimated parameters. Moreover, the two indices, "strictness of the assessment criterion" and "consistency of the assessor," are proposed based on the model. The proposed model was applied to actual data, which demonstrated its effectiveness.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 7th IASTED International Conference on Web-Based Education, WBE 2008 |
| Pages | 229-234 |
| Number of pages | 6 |
| Publication status | Published - 2008 |
| Event | 7th IASTED International Conference on Web-Based Education, WBE 2008 - Innsbruck Duration: 2008 Mar 17 → 2008 Mar 19 |
Other
| Other | 7th IASTED International Conference on Web-Based Education, WBE 2008 |
|---|---|
| City | Innsbruck |
| Period | 08/3/17 → 08/3/19 |
Fingerprint
Keywords
- Collaborative learning
- Cscl
- E-learning
- Peer assessment
- Portfolio
ASJC Scopus subject areas
- Computer Networks and Communications
- Human-Computer Interaction
- Education
Cite this
An Item Response Theory for peer assessment. / Ueno, Maomi; Nagaoka, Keizo.
Proceedings of the 7th IASTED International Conference on Web-Based Education, WBE 2008. 2008. p. 229-234.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - An Item Response Theory for peer assessment
AU - Ueno, Maomi
AU - Nagaoka, Keizo
PY - 2008
Y1 - 2008
N2 - This paper proposes an Item Response Theory for peer assessment. The proposed model is a modified Graded Item Response model which incorporates the assessor's assessment criterion parameters. Its advantages are as follows: 1. The learners' abilities are evaluated on the same scale even if the assessors have different assessment criteria. 2. The learners' abilities are evaluated by taking into consideration each assessor's reliability, which produces reliable evaluation results. 3. Parameters from missing data can be easily estimated. 4. From 1-3, the parameter estimation accuracy is improved. 5. Characteristics of the tasks and assessors can be analyzed from the estimated parameters. Moreover, the two indices, "strictness of the assessment criterion" and "consistency of the assessor," are proposed based on the model. The proposed model was applied to actual data, which demonstrated its effectiveness.
AB - This paper proposes an Item Response Theory for peer assessment. The proposed model is a modified Graded Item Response model which incorporates the assessor's assessment criterion parameters. Its advantages are as follows: 1. The learners' abilities are evaluated on the same scale even if the assessors have different assessment criteria. 2. The learners' abilities are evaluated by taking into consideration each assessor's reliability, which produces reliable evaluation results. 3. Parameters from missing data can be easily estimated. 4. From 1-3, the parameter estimation accuracy is improved. 5. Characteristics of the tasks and assessors can be analyzed from the estimated parameters. Moreover, the two indices, "strictness of the assessment criterion" and "consistency of the assessor," are proposed based on the model. The proposed model was applied to actual data, which demonstrated its effectiveness.
KW - Collaborative learning
KW - Cscl
KW - E-learning
KW - Peer assessment
KW - Portfolio
UR - http://www.scopus.com/inward/record.url?scp=62949159415&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=62949159415&partnerID=8YFLogxK
M3 - Conference contribution
SN - 9780889867239
SP - 229
EP - 234
BT - Proceedings of the 7th IASTED International Conference on Web-Based Education, WBE 2008
ER -