Note:

If you want to create a new page for developers, you should create it on the Moodle Developer Resource site.

Assignment/Draft Features/Marking Conflict Prevention: Difference between revisions

From MoodleDocs
No edit summary
Line 1: Line 1:
== Marking Checkin/Checkout ==
== Marker Allocation ==


This is a proposal for an additional feature to only allow 1 marker at a time to mark a student submission.
This is a proposal for an additional feature to only allow 1 marker at a time to mark a student submission.
Line 13: Line 13:
Currently in the assignment module, when dealing with large class sizes it is desirable to share the workload of marking among multiple markers. The current methods for doing this rely on process outside of Moodle (e.g. spreadsheet) to allocate students to markers to ensure that multiple markers do not mark the same piece of work.
Currently in the assignment module, when dealing with large class sizes it is desirable to share the workload of marking among multiple markers. The current methods for doing this rely on process outside of Moodle (e.g. spreadsheet) to allocate students to markers to ensure that multiple markers do not mark the same piece of work.


The feature would add an option in the grading interface so that markers can "Check-out for marking" a submission for marking. Once a submission is checked out, only the person who has checked out the submission can provide grades/feedback. When they have finished marking, they can "Check-in marking" the submission which will allow other markers to check the submission out.
The feature would add an option in the grading interface so that markers can "Take" a submission for marking. Once a submission is "Taken", only the person who is allocated the submission can provide grades/feedback. When they have finished marking, they can choose "Finish marking" the submission which will allow other markers to "Take" the submission.


=== Status ===
=== Status ===
Line 21: Line 21:
=== Changes to assignment settings ===
=== Changes to assignment settings ===


No changes to the assignment settings page (this feature would always be available - but there is no requirement to use it)
An additional setting would be added to the module settings page:
"Enable marking allocation" [Yes/No] (Default No)
"If enabled this setting requires that graders either manually or automatically "Take" submissions before they will be able to provide grades and feedback. This feature will prevent multiple markers from marking the same student submission concurrently and overwriting each others grades and feedback. When a grader has completed their marking process they can choose "Finish marking" in which will allow other graders to "Take" the submission and give more feedback/grades. An editing teacher by default has the permission to assign a submission to any grader or to automatically assign submissions to graders"


=== Changes to the grading table ===
=== Changes to the grading table ===


An additional action would be available from the submission menu and the batch operations menu "Check-out" for all submissions that are not currently checked out.
An additional action would be available from the submission menu and the batch operations menu "Take" for all submissions that are not currently checked out.


An additional column would be added to the grading table to show which assignments are checked out and to whom. This column would show either "Not checked out" or "Checked out by XXX".
An additional column would be added to the grading table to show which assignments are "Taken" and who has taken them. This column would show either "Not allocated" or "Taken by XXX".


If the current submission is checked out by someone who is not the current user, the grade action would not be displayed and this row would be read only for quick-grading/offline marking.
If the current submission is taken by someone who is not the current user, the grade action would not be displayed and this row would be read only for quick-grading/offline marking.


If the current submission is checked out by the current user, or the current user has a special "assign:managecheckin" capability, an additional action would be available in the submission menu and the batch operations menu to "Check-in" a submission.
If the current submission is taken by the current user, or the current user has a special "assign:allocatemarkers" capability, an additional action would be available in the submission menu and the batch operations menu to "Finish marking" a submission.


If the current user has "assign:managecheckin" capability they would have to ability to allocate a submission to any grader. This would "Check-out" the submission as that grader.  
If the current user has "assign:allocatemarkers" capability they would have to ability to allocate a submission to any grader.


Submissions that are not checked out can be graded by anyone with grade permission - which replicates the existing workflow.
Submissions that are not allocated can be taken by anyone with grade permission.
 
Optional: Support algorithms for allocating submissions to markers


=== Capabilities ===
=== Capabilities ===
An additional capability would be added to allow a manager/editing teacher to checkin a submission belonging to a different user.  
An additional capability "assign:allocatemarkers" would be added to allow a manager/editing teacher to allocate submissions to graders.  


=== User Interface mockups ===
=== User Interface mockups ===
Line 52: Line 52:
* Grader can ignore this feature and mark as they did before
* Grader can ignore this feature and mark as they did before
'''Medium class size, multiple markers'''
'''Medium class size, multiple markers'''
* Markers can "Check-out" submissions before they mark them to prevent conflicts
* Markers can enable "Enable marking allocations". Graders must then take submissions before they mark them to prevent conflicts
'''Large class size, one teacher, multiple marking assistants'''
'''Large class size, one teacher, multiple marking assistants'''
* Teacher can assign submissions to the marking assistants which will ensure only one marking assistant is assigned to each submission
* Teacher can enable "Enable marking allocations". The teacker can then automatically or manually allocate marking assistants to submissions which will ensure only one marking assistant is assigned to each submission
* If a marker has a submission checked out but the marker is sick/non contactable the teacher can "Check-in" that submission or assign it to a different marker
* If a marker has a submission allocated to them but the marker is sick/non contactable the teacher can assign it to a different marker
'''Large class, many students, many markers'''
* Teacher wants to use an algorithm to assign submissions to markers

Revision as of 03:07, 7 September 2012

Marker Allocation

This is a proposal for an additional feature to only allow 1 marker at a time to mark a student submission.

Goals and rationale

The main goals of this feature are to :

  • Prevent multiple markers from marking the same student submission at the same time and overwriting each others grades and feedback.

Overview

Currently in the assignment module, when dealing with large class sizes it is desirable to share the workload of marking among multiple markers. The current methods for doing this rely on process outside of Moodle (e.g. spreadsheet) to allocate students to markers to ensure that multiple markers do not mark the same piece of work.

The feature would add an option in the grading interface so that markers can "Take" a submission for marking. Once a submission is "Taken", only the person who is allocated the submission can provide grades/feedback. When they have finished marking, they can choose "Finish marking" the submission which will allow other markers to "Take" the submission.

Status

The feature is currently only a proposal

Design

Changes to assignment settings

An additional setting would be added to the module settings page: "Enable marking allocation" [Yes/No] (Default No) "If enabled this setting requires that graders either manually or automatically "Take" submissions before they will be able to provide grades and feedback. This feature will prevent multiple markers from marking the same student submission concurrently and overwriting each others grades and feedback. When a grader has completed their marking process they can choose "Finish marking" in which will allow other graders to "Take" the submission and give more feedback/grades. An editing teacher by default has the permission to assign a submission to any grader or to automatically assign submissions to graders"

Changes to the grading table

An additional action would be available from the submission menu and the batch operations menu "Take" for all submissions that are not currently checked out.

An additional column would be added to the grading table to show which assignments are "Taken" and who has taken them. This column would show either "Not allocated" or "Taken by XXX".

If the current submission is taken by someone who is not the current user, the grade action would not be displayed and this row would be read only for quick-grading/offline marking.

If the current submission is taken by the current user, or the current user has a special "assign:allocatemarkers" capability, an additional action would be available in the submission menu and the batch operations menu to "Finish marking" a submission.

If the current user has "assign:allocatemarkers" capability they would have to ability to allocate a submission to any grader.

Submissions that are not allocated can be taken by anyone with grade permission.

Capabilities

An additional capability "assign:allocatemarkers" would be added to allow a manager/editing teacher to allocate submissions to graders.

User Interface mockups

To be written

Database changes

To be written

Use cases

Small class size, one grader

  • Grader can ignore this feature and mark as they did before

Medium class size, multiple markers

  • Markers can enable "Enable marking allocations". Graders must then take submissions before they mark them to prevent conflicts

Large class size, one teacher, multiple marking assistants

  • Teacher can enable "Enable marking allocations". The teacker can then automatically or manually allocate marking assistants to submissions which will ensure only one marking assistant is assigned to each submission
  • If a marker has a submission allocated to them but the marker is sick/non contactable the teacher can assign it to a different marker