Finding an optimal balance between agreement and performance in an online reciprocal peer evaluation system

Kwangsu Cho, Christian D. Schunn

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)

Abstract

Consistent with movements integrating performance evaluation and improvement, the current study examines an assumption that more peer raters will produce better results or the so-called maxima strategy. This study examines the maxima strategy from both the agreement and performance perspectives with the intent of examining the role of feedback information in reliability and performance through an optimal number of peer raters per student ratee. It was found that the maxima strategy works consistently from agreement perspectives, whereas the relationship between the maxima strategy and student performance improvement follows an inverted U-shaped function. Accordingly, we recommend that the number of peer raters needs to be decided according to the optimal balance between reliability and performance, which maximizes ratees’ performances without sacrificing evaluation reliability.

Original languageEnglish
Pages (from-to)94-101
Number of pages8
JournalStudies in Educational Evaluation
Volume56
DOIs
Publication statusPublished - 2018 Mar

All Science Journal Classification (ASJC) codes

  • Education

Fingerprint Dive into the research topics of 'Finding an optimal balance between agreement and performance in an online reciprocal peer evaluation system'. Together they form a unique fingerprint.

Cite this