|
More Writing But Less Grading: Calibrated Peer Review
John C. Wise
Pennsylvania State University
PowerPoint Presentation
Summary
The White Paper
Abstract
The belief that the best way to really learn a new concept is to research and write about it is well accepted. The higher-level thinking involved in sifting through information ("analysis" in Bloom's taxonomy) and combining new data with existing knowledge ("synthesis" in Bloom) in a well-written essay or research paper requires cognitive effort that pays off in improved understanding. We may all agree that more writing in our courses is a good thing, but how can it be incorporated without increasing an already heavy investment of time in grading, especially if we want to include valuable feedback for each student? Calibrated Peer Review" (CPR) is an on-line tool designed to take advantage of the positive effects of writing, while mitigating the negative.
- Review of CPR CPR is based on the scientific model of writing in which a researcher submits his or her work for blind review by peers and also participates as a reviewer for other researchers. In a typical CPR assignment, each student will generate a piece of writing and submit it to the CPR site. After all students have completed the writing phase, they enter a calibration phase. In calibration, each student reviews three samples of work related to the just-completed assignment. The scores they provide are compared to scores previously assigned by the professor. Later, grades assigned by students who are more similar to the professor in these calibrations will be more heavily weighted than others. After completing the calibration, students are presented with three anonymous writings to evaluate, followed by a final look at their own. Final grades for each CPR assignment are computed by the system with weightings set by the professor.
- Practical Uses Anecdotal reports indicate that most student writing that is currently submitted for grading, particularly in the early undergraduate years, is usually of first-draft rather than final draft quality. CPR can be utilized to keep students on schedule with several drafts during the semester and almost guarantee an improved product by the end of the semester, with little increase in faculty workload. Difficult concepts can be addressed through short writing assignments as a method for learning, and writing ability should increase with use. The scoring and feedback pages keep the professor informed regarding each student's performance, and these data may be used in ABET-style assessments.
Learning Objectives
Workshop participants will
- Be able to describe the advantages of learning through writing
- Be able to describe the peer-review process used by the on-line tool, CPR
- Become aware of the possibility of participating in a network of colleges sharing on-line engineering writing assignments through CPR
|
