Quality management of student-student evaluations

Tom Henderson, Roy Rada, Chaomei Chen

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Classes delivered via the World Wide Web (WWW) have the ability to access large amounts of hypermedia. They can also be designed to present course work in small, orderly steps. Many learning theorists hypothesize that it is important to provide timely feedback which acts as a reinforcer if answers are good and as a corrective measure if answers are inadequate. However, it may not be practical for an instructor to give timely feedback on each submission done by all students in the class. One possible solution is to combine peer-peer evaluations with timely computer generated reports to help the instructor manage such a course. The peer evaluations may replace some or all of the traditional "grading" done by the professor. This process can contribute to higher developmental levels of understanding and students collaborative work skills may be honed by the requirements of the course. We hypothesize that instructors can adopt graphical methods of data presentation and quality improvement to help monitor the peer evaluation process in a timely and adequate fashion. Three such methods were applied to a class at Washington State University. Pseudo R-charts were used to track when comment scores by peers varied widely on an exercise submission. Pseudo X-bar charts helped identify exercise answers with unusually low average comment scores. Finally, relative frequency histograms were used to compare the frequency of questions asked to the frequency of questions answered when categorized using Bloom's taxonomy. Such tools were used during the class and were valuable input to the instructor.

Original languageEnglish
Pages (from-to)199-215
Number of pages17
JournalJournal of Educational Computing Research
Volume17
Issue number3
DOIs
Publication statusPublished - 1997 Jan 1

Fingerprint

quality management
Quality management
instructor
Students
Feedback
Taxonomies
evaluation
World Wide Web
student
hypermedia
grading
taxonomy
university teacher
Internet
present
ability
learning

All Science Journal Classification (ASJC) codes

  • Education
  • Computer Science Applications

Cite this

Henderson, Tom ; Rada, Roy ; Chen, Chaomei. / Quality management of student-student evaluations. In: Journal of Educational Computing Research. 1997 ; Vol. 17, No. 3. pp. 199-215.
@article{4984c0306ba0456f8a54f4bb5dfe7a19,
title = "Quality management of student-student evaluations",
abstract = "Classes delivered via the World Wide Web (WWW) have the ability to access large amounts of hypermedia. They can also be designed to present course work in small, orderly steps. Many learning theorists hypothesize that it is important to provide timely feedback which acts as a reinforcer if answers are good and as a corrective measure if answers are inadequate. However, it may not be practical for an instructor to give timely feedback on each submission done by all students in the class. One possible solution is to combine peer-peer evaluations with timely computer generated reports to help the instructor manage such a course. The peer evaluations may replace some or all of the traditional {"}grading{"} done by the professor. This process can contribute to higher developmental levels of understanding and students collaborative work skills may be honed by the requirements of the course. We hypothesize that instructors can adopt graphical methods of data presentation and quality improvement to help monitor the peer evaluation process in a timely and adequate fashion. Three such methods were applied to a class at Washington State University. Pseudo R-charts were used to track when comment scores by peers varied widely on an exercise submission. Pseudo X-bar charts helped identify exercise answers with unusually low average comment scores. Finally, relative frequency histograms were used to compare the frequency of questions asked to the frequency of questions answered when categorized using Bloom's taxonomy. Such tools were used during the class and were valuable input to the instructor.",
author = "Tom Henderson and Roy Rada and Chaomei Chen",
year = "1997",
month = "1",
day = "1",
doi = "10.2190/0GCN-38HR-Q0AU-9GQ4",
language = "English",
volume = "17",
pages = "199--215",
journal = "Journal of Educational Computing Research",
issn = "0735-6331",
publisher = "Baywood Publishing Co. Inc.",
number = "3",

}

Quality management of student-student evaluations. / Henderson, Tom; Rada, Roy; Chen, Chaomei.

In: Journal of Educational Computing Research, Vol. 17, No. 3, 01.01.1997, p. 199-215.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Quality management of student-student evaluations

AU - Henderson, Tom

AU - Rada, Roy

AU - Chen, Chaomei

PY - 1997/1/1

Y1 - 1997/1/1

N2 - Classes delivered via the World Wide Web (WWW) have the ability to access large amounts of hypermedia. They can also be designed to present course work in small, orderly steps. Many learning theorists hypothesize that it is important to provide timely feedback which acts as a reinforcer if answers are good and as a corrective measure if answers are inadequate. However, it may not be practical for an instructor to give timely feedback on each submission done by all students in the class. One possible solution is to combine peer-peer evaluations with timely computer generated reports to help the instructor manage such a course. The peer evaluations may replace some or all of the traditional "grading" done by the professor. This process can contribute to higher developmental levels of understanding and students collaborative work skills may be honed by the requirements of the course. We hypothesize that instructors can adopt graphical methods of data presentation and quality improvement to help monitor the peer evaluation process in a timely and adequate fashion. Three such methods were applied to a class at Washington State University. Pseudo R-charts were used to track when comment scores by peers varied widely on an exercise submission. Pseudo X-bar charts helped identify exercise answers with unusually low average comment scores. Finally, relative frequency histograms were used to compare the frequency of questions asked to the frequency of questions answered when categorized using Bloom's taxonomy. Such tools were used during the class and were valuable input to the instructor.

AB - Classes delivered via the World Wide Web (WWW) have the ability to access large amounts of hypermedia. They can also be designed to present course work in small, orderly steps. Many learning theorists hypothesize that it is important to provide timely feedback which acts as a reinforcer if answers are good and as a corrective measure if answers are inadequate. However, it may not be practical for an instructor to give timely feedback on each submission done by all students in the class. One possible solution is to combine peer-peer evaluations with timely computer generated reports to help the instructor manage such a course. The peer evaluations may replace some or all of the traditional "grading" done by the professor. This process can contribute to higher developmental levels of understanding and students collaborative work skills may be honed by the requirements of the course. We hypothesize that instructors can adopt graphical methods of data presentation and quality improvement to help monitor the peer evaluation process in a timely and adequate fashion. Three such methods were applied to a class at Washington State University. Pseudo R-charts were used to track when comment scores by peers varied widely on an exercise submission. Pseudo X-bar charts helped identify exercise answers with unusually low average comment scores. Finally, relative frequency histograms were used to compare the frequency of questions asked to the frequency of questions answered when categorized using Bloom's taxonomy. Such tools were used during the class and were valuable input to the instructor.

UR - http://www.scopus.com/inward/record.url?scp=0031284174&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031284174&partnerID=8YFLogxK

U2 - 10.2190/0GCN-38HR-Q0AU-9GQ4

DO - 10.2190/0GCN-38HR-Q0AU-9GQ4

M3 - Article

AN - SCOPUS:0031284174

VL - 17

SP - 199

EP - 215

JO - Journal of Educational Computing Research

JF - Journal of Educational Computing Research

SN - 0735-6331

IS - 3

ER -