Peer-based computer-supported knowledge refinement: An empirical investigation

Kwangsu Cho, Tingting Rachel Chung, William R. King, Christian Schunn

Research output: Contribution to journalArticle

36 Citations (Scopus)

Abstract

Nonexpert peer-based knowledge refinement is as much helpful as expert-centric knowledge refinement for improving the quality of results. A computer-support system is helpful for facilitating peer-based knowledge refinement, since more peers than experts are required for peer-based refinement to be effective. An experimental study was conducted, which allowed to observe the relative impact of experts versus peers on the quality of codified knowledge intended for use by nonexperts. Quality improvement in technical reports refined by feedback from a subject-matter expert, a nonexpert peer, or multiple nonexpert peers was compared. Individual participants wrote and revised drafts that fulfilled the requirements of the course. The expert and nonexpert reviewers assessed the drafts on the three evaluation dimensions, including flow, logic and insight. The result revealed that flow in multiple peers was significantly better than in single peer, but the logic was same in all conditions.

Original languageEnglish
Pages (from-to)83-88
Number of pages6
JournalCommunications of the ACM
Volume51
Issue number3
DOIs
Publication statusPublished - 2008 Mar 1

Fingerprint

Feedback

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

Cho, Kwangsu ; Chung, Tingting Rachel ; King, William R. ; Schunn, Christian. / Peer-based computer-supported knowledge refinement : An empirical investigation. In: Communications of the ACM. 2008 ; Vol. 51, No. 3. pp. 83-88.
@article{2a4e53e80bfc416f9e0c8a7c569be3ab,
title = "Peer-based computer-supported knowledge refinement: An empirical investigation",
abstract = "Nonexpert peer-based knowledge refinement is as much helpful as expert-centric knowledge refinement for improving the quality of results. A computer-support system is helpful for facilitating peer-based knowledge refinement, since more peers than experts are required for peer-based refinement to be effective. An experimental study was conducted, which allowed to observe the relative impact of experts versus peers on the quality of codified knowledge intended for use by nonexperts. Quality improvement in technical reports refined by feedback from a subject-matter expert, a nonexpert peer, or multiple nonexpert peers was compared. Individual participants wrote and revised drafts that fulfilled the requirements of the course. The expert and nonexpert reviewers assessed the drafts on the three evaluation dimensions, including flow, logic and insight. The result revealed that flow in multiple peers was significantly better than in single peer, but the logic was same in all conditions.",
author = "Kwangsu Cho and Chung, {Tingting Rachel} and King, {William R.} and Christian Schunn",
year = "2008",
month = "3",
day = "1",
doi = "10.1145/1325555.1325571",
language = "English",
volume = "51",
pages = "83--88",
journal = "Communications of the ACM",
issn = "0001-0782",
publisher = "Association for Computing Machinery (ACM)",
number = "3",

}

Peer-based computer-supported knowledge refinement : An empirical investigation. / Cho, Kwangsu; Chung, Tingting Rachel; King, William R.; Schunn, Christian.

In: Communications of the ACM, Vol. 51, No. 3, 01.03.2008, p. 83-88.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Peer-based computer-supported knowledge refinement

T2 - An empirical investigation

AU - Cho, Kwangsu

AU - Chung, Tingting Rachel

AU - King, William R.

AU - Schunn, Christian

PY - 2008/3/1

Y1 - 2008/3/1

N2 - Nonexpert peer-based knowledge refinement is as much helpful as expert-centric knowledge refinement for improving the quality of results. A computer-support system is helpful for facilitating peer-based knowledge refinement, since more peers than experts are required for peer-based refinement to be effective. An experimental study was conducted, which allowed to observe the relative impact of experts versus peers on the quality of codified knowledge intended for use by nonexperts. Quality improvement in technical reports refined by feedback from a subject-matter expert, a nonexpert peer, or multiple nonexpert peers was compared. Individual participants wrote and revised drafts that fulfilled the requirements of the course. The expert and nonexpert reviewers assessed the drafts on the three evaluation dimensions, including flow, logic and insight. The result revealed that flow in multiple peers was significantly better than in single peer, but the logic was same in all conditions.

AB - Nonexpert peer-based knowledge refinement is as much helpful as expert-centric knowledge refinement for improving the quality of results. A computer-support system is helpful for facilitating peer-based knowledge refinement, since more peers than experts are required for peer-based refinement to be effective. An experimental study was conducted, which allowed to observe the relative impact of experts versus peers on the quality of codified knowledge intended for use by nonexperts. Quality improvement in technical reports refined by feedback from a subject-matter expert, a nonexpert peer, or multiple nonexpert peers was compared. Individual participants wrote and revised drafts that fulfilled the requirements of the course. The expert and nonexpert reviewers assessed the drafts on the three evaluation dimensions, including flow, logic and insight. The result revealed that flow in multiple peers was significantly better than in single peer, but the logic was same in all conditions.

UR - http://www.scopus.com/inward/record.url?scp=40549100333&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=40549100333&partnerID=8YFLogxK

U2 - 10.1145/1325555.1325571

DO - 10.1145/1325555.1325571

M3 - Article

AN - SCOPUS:40549100333

VL - 51

SP - 83

EP - 88

JO - Communications of the ACM

JF - Communications of the ACM

SN - 0001-0782

IS - 3

ER -