Assignment Advanced Marking

This is a proposal for additional marking features in the Assignment module.

References: https://docs.moodle.org/dev/Lightwork#User_Interface_-_Marker_allocation_and_management

Goals and rationale

The main goals of this change are to:

• Enable dividing the marking of large classes among multiple markers
• Enable markers to review each others marking before releasing marks to students
• Enable markers to review their own marking before releasing marks to students
• Not add any additional complexity for people who do not need these features

Overview

Settings added to the mod_assign settings page

Release grades immediately (Checkbox, default to on - this is the current behaviour)

[Help text] When enabled, grades will be visible to students as soon as they have been entered by a grader (If the grade column is visible in the gradebook). When disabled, any grades that are entered will be only visible to graders until they are approved for release.

Allocate markers to students (Select list of options, "None - all markers can mark all students", "Manually allocated - markers are manually allocated students to mark", "Groups - Markers can mark students in their own group")

When the grouping method is chosen above, an additional setting should be enabled to allow a grouping to be specified for the marker allocations.

Grouping for marker allocations (Select from the available groupings - or None for all groups)

Changes to grading/grading interface

Marking release

If "Release grades immediately" is not enabled, an additional status should be added to the grading status column "Draft/Ready for release/Released". Use background colors as well to visually distinguish the statuses (Blue - draft, Yellow - Ready for Release, Green - Released).

Anyone with mod/assign:grade capability would be able to move the status from "Draft" to "Ready for release" via the drop down menu on each submission, or via the batch operations form.

Anyone with mod/assign:releasegrade (new) capability would be able to move the grade from either "Draft" or "Ready for release" to "Released". At this point the grade is pushed to the gradebook and made visible to the student.

Marker allocations

If "Allocate markers to students" is set to "Manually allocated", and the current user has "mod/assign:allocatemarkers" capability, the list of markers allocated to each student needs to be shown in a new column in the grading interface.

Multiple markers should be able to be allocated to a single student. If the current user has mod/assign:allocategraders permission, a red X next to each markers will allow immediately removing this marker (Ajax if possible - don't refresh the full page) An option should be added to the menu for each submission and the batch operations menu which takes you to a separate page where you can choose from the users with mod/assign:grade permission to allocate to a student (or multiple students).

Any student with no markers allocated should have "No markers" in this column and the column background should be shown in a different colour (Red?) to indicate that no-one has been assigned to mark this submission. If the current user has "mod/assign:allocatemarkers" and "mod/assign:grade" capability, there should be an entry in the menu for this submissions for "Assign to me" (preferably AJAX - do not refresh entire page).

If the current user does not have "mod/assign:allocatemarkers" capability, the list of submissions will be limited to only show the submissions where the current user has been allocated as a marker.

Use Cases

Teacher is creating an assignment with a small number of students and they do not wish to use advanced marking

• Create an assignment and leave the new settings at their defaults
  • Release grades immediately: "checked"
  • Allocate markers to students: "None"

Teacher is creating an assignment with a small number of students and they wish to mark all submissions, then re-mark several submissions to check for "grading drift" before release

(I am defining this as the perception of quality changing over time as the marker marks each assignment in turn - can't find a good reference right now)

• Teacher has "mod/assign:create", "mod/assign:grade" and "mod/assign:releasegrades" capabilities
• Create an assignment and de-select Release grades immediately
  • Release grades immediately: "not checked"
  • Allocate markers to students: "None"
• Teacher marks each submission individually. Grades are "Draft" and not released to gradebook or students
• Teacher re-marks a random sample of submissions
• Teacher releases all the grades via the batch operations form