Toward the Integration of Peer Reviewing and Computational Linguistics Approaches

Juhwa Park, Kwangsu Cho

Research output: Contribution to journalReview article

1 Citation (Scopus)

Abstract

Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally evaluates the linguistic properties of writings. Participants also evaluated the quality of their peer writings using the SWoRD system. Both measurements, particularly the computational measurement, confirmed the effectiveness of peer reviewing. In addition, the computational measures found that awareness of cohesion, including the clarity, explicitness, and concreteness of writing, improved over the course of peer reviewing. The results are discussed, along with their possible implications for the complementary roles of peer reviewing and computational writing measurements.

Original languageEnglish
Pages (from-to)123-144
Number of pages22
JournalJournal of Educational Computing Research
Volume55
Issue number1
DOIs
Publication statusPublished - 2017 Mar 1

Fingerprint

Computational linguistics
computational linguistics
Linguistics
group cohesion
Students
linguistics
student

All Science Journal Classification (ASJC) codes

  • Education
  • Computer Science Applications

Cite this

@article{cf1323a7e22f4e0db91019e4200b0f7c,
title = "Toward the Integration of Peer Reviewing and Computational Linguistics Approaches",
abstract = "Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally evaluates the linguistic properties of writings. Participants also evaluated the quality of their peer writings using the SWoRD system. Both measurements, particularly the computational measurement, confirmed the effectiveness of peer reviewing. In addition, the computational measures found that awareness of cohesion, including the clarity, explicitness, and concreteness of writing, improved over the course of peer reviewing. The results are discussed, along with their possible implications for the complementary roles of peer reviewing and computational writing measurements.",
author = "Juhwa Park and Kwangsu Cho",
year = "2017",
month = "3",
day = "1",
doi = "10.1177/0735633116656454",
language = "English",
volume = "55",
pages = "123--144",
journal = "Journal of Educational Computing Research",
issn = "0735-6331",
publisher = "Baywood Publishing Co. Inc.",
number = "1",

}

Toward the Integration of Peer Reviewing and Computational Linguistics Approaches. / Park, Juhwa; Cho, Kwangsu.

In: Journal of Educational Computing Research, Vol. 55, No. 1, 01.03.2017, p. 123-144.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Toward the Integration of Peer Reviewing and Computational Linguistics Approaches

AU - Park, Juhwa

AU - Cho, Kwangsu

PY - 2017/3/1

Y1 - 2017/3/1

N2 - Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally evaluates the linguistic properties of writings. Participants also evaluated the quality of their peer writings using the SWoRD system. Both measurements, particularly the computational measurement, confirmed the effectiveness of peer reviewing. In addition, the computational measures found that awareness of cohesion, including the clarity, explicitness, and concreteness of writing, improved over the course of peer reviewing. The results are discussed, along with their possible implications for the complementary roles of peer reviewing and computational writing measurements.

AB - Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally evaluates the linguistic properties of writings. Participants also evaluated the quality of their peer writings using the SWoRD system. Both measurements, particularly the computational measurement, confirmed the effectiveness of peer reviewing. In addition, the computational measures found that awareness of cohesion, including the clarity, explicitness, and concreteness of writing, improved over the course of peer reviewing. The results are discussed, along with their possible implications for the complementary roles of peer reviewing and computational writing measurements.

UR - http://www.scopus.com/inward/record.url?scp=85012065319&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85012065319&partnerID=8YFLogxK

U2 - 10.1177/0735633116656454

DO - 10.1177/0735633116656454

M3 - Review article

VL - 55

SP - 123

EP - 144

JO - Journal of Educational Computing Research

JF - Journal of Educational Computing Research

SN - 0735-6331

IS - 1

ER -