Well written criteria are the key to a successful peer review assignment.
Criteria should be...
- Criteria should be objective rather than subjective. They should be used to test the presence or correctness of a feature in a student's submission. They should not be used to ask students to make a judgement of quality. Evaluations made by students (even Masters students) are not consistent when students are asked to make subjective judgements.
- Students should be able to evaluate the work of another student, even if they themselves have not reached that standard. This means you should provide instructions on how to test the criteria.
- Remember, these criteria are for students, not teachers. If at first thought a scale is desired, ask yourself how you would define the levels of that scale; ask "what differentiates the levels?" Then ask: "what level is desirable?" Setting a binary criterion at the desired level drives students to accomplish that level. If you want to offer reward for a partially correct response, or a superior response, divide that criterion into finer grained criteria that are more specific. Binary criteria are makes objective evaluation possible for students. Using a binary rubric also sets a definitive standard, which can inturn encourage greater retention and better student outcomes. Students appreciate removing the "guess-work"; binary criteria make assignment work "achievable".
The criteria are shown to students with the assignment description, even before they submit.
An optional additional alternate text can be provided for each criterion. This second text appears during and after reviewing. This allows you to create criteria with specific answers or tests that are not shown to the students before they submit.
More Complex Criteria TextCriteria can be simple short pieces of text, or more complex. If you know how to write in HTML, this can help you to create criteria with structure and formatting. For example, tags such as
<strong>...</strong>can be placed around text to make it strong,
<em>...</em>tags for emphasis, a singleton
<br />tag can be used to include a line break, and so on.
The values for all criteria, plus the reward students receive for completing reviews, should sum to the Grade value for the assignment. The system attempts to enforce this addition. Guidance is provided at the bottom of the Criteria page.