Advanced grading methods

Advanced grading methods is a new subsystem introduced in Moodle 2.2. It allows to use various assessment forms like rubrics to calculate the grade for students' work. At the moment, only the Assignment module supports them. More activity modules (like Glossary and Database) are supposed to be supported in future Moodle versions. Also, more grading methods can be implemented as independent plugins (including custom ones fitting your particular need).

Basic concepts

By default, numerical grades in Moodle are selected by the teacher from a range like 0-100. When advanced grading methods are enabled, the grade selection element is replaced with a more complex assessment form provided by the plugin. The plugin contains the logic how to calculate the grade. Such a calculated grade is then passed back to the activity module as if the teacher used the standard grade value selector.

Example: The teacher creates new Assignment in the course with the grade up to 30. She defines a rubric to be used for grading. The rubric itself produces raw score up to 12 (eg it has four criteria with levels 0, 1, 2, 3). So the rubric's score 12 leads to the assignment grade 30, the score 6 leads to the grade 15 etc.

For each activity, a new copy of the assessment form is created. Note that this is different from how scales work. While scales are defined at the site level or course level and then can be used in all activities, advanced grading forms create a new copy of the form definition for every single activity that uses it. So a change in the form definition in one assignment does not affect other places where the same rubric is used.

Example: The teacher defines a rubric for an assignment in the course. Then she re-uses the rubric in another assignment (see below on how to do this). When the teacher modifies the rubric in the second assignment, the first assignment still uses the original rubric.

The grading form definition is part of the activity data. It is included in the activity's backup and it is copied when the activity is duplicated via the "x2" icon or imported from another course.

Configuring an activity module to use advanced grading methods

Choosing the grading method in the activity settings form.

Modules that support advanced grading methods have the grading method selector included in their settings form (for example in the Assignment settings form). The teacher can choose either 'Simple direct grading' or one of the installed grading methods plugins. Selecting 'Simple direct grading' means that the advanced grading is not used and the standard grade selector is displayed.

Alternative way is to follow the link 'Advanced grading' in the activity Settings block. The link leads to a page where the current active grading method can be changed, too.

The form definition and the associated assessment data are stashed when the grading method is changed from one type to another. That means it is save to change the current active grading method from 'Rubric' to 'Simple direct grading' and back to 'Rubric'. The rubric definition is kept in the database, although it may not be available while the current grading method is set to some other method.

Assessment form definition

Grading method management screen (no assessment form of the selected type is not defined yet).

The link 'Advance grading' in the activity settings form leads to a management screen where the assessment form can be defined, edited, deleted and eventually shared as a public template (if the user has such permission). If there is no form of the selected method defined yet, there are two options:

• Define new grading form from scratch - creates a blank grading form and lets you define it. Each grading plugin provides its own grading form editor.
• Create new grading form from a template - lets you re-use a previously defined form. You can copy any of your own grading forms (that is those you have created elsewhere) or a grading form that was shared as a public template at your site.

Every grading form has a name and a description. These are not displayed to students. The description should summarize the form, explain its usage etc.

The grading form definition can be saved as a draft or as a final version. If the grading form is saved as a draft, it can't be used for assessing. To release the form and make it available to assessment, save it using the button 'Save and make it ready'. The current status of the form definition is indicated via a tag displayed next to the form name.

Modifying the form after it has been used

It may happen that you define a grading form, make it ready for usage and start assessing students with it. After some time you realize there is a typo in the form or that it should be actually improved significantly (like by adding another criterion into the rubric). In such case, you are about to edit a form that has already been used for assessment.

If the grading plugin considers your change as significant, it may force you to mark all current assessment with a special flag 'Needs review'. It is your duty to go through all existing assessments made by the previous version of the form and re-assess them to make the calculated grades valid a comparable. If the change seems to be a trivial change (eg fixing a typo in the text), the form editor may ask you to decide whether the existing assessment should be marked with the 'Needs review' flag or not.

Please note, when there are other people using the form for assessment (eg there are several non-editing teachers in the course who participate on the submissions assessment), even a trivial rewording can be understood as significant change in the criterion meaning. Make sure you communicate the changes well with your colleagues.

Re-using assessment forms

Searching for a grading form to re-use

Instead of defining the new grading form from scratch, you can use some existing form as the initial template to create it from. When clicking the 'Create new grading form from a template' icon, a new page opens and you can search for a grading form there. Simply type words that should appear somewhere in the form name, its description or the form body itself. To search for a phrase, wrap the whole query in double quotes.

Shared templates

Users who were given a special permission can save their grading forms as shared templates on the site. Such forms can be then picked and re-used by all teachers in their courses. Users who published the form as a template can also delete it from the list of shared templates. There is also another permission to manage the whole "bank" of shared template. Users with this permission can delete any shared template, even if they are not the authors of it (see below for more details on these permissions).

Grading forms can be shared at the site level only. There is no way how to share forms at lower context levels (eg at the course category level as the question bank does).

Re-using own forms without sharing them

Re-using a form that was previously used in another activity

By default, only the grading forms that have been saved as shared templates are included in the search results. You can also include all your own grading forms in the search results. This way, you can simply re-use your grading forms without sharing them. Only forms marked as 'Ready for usage' can be re-used this way.

Permissions

There are two capabilities that affect the user's permission to work with templates.

• Share advanced grading form as a template (moodle/grade:sharegradingforms) - grants the ability to save a grading form as a new shared template and eventually edit and remove own templates (templates originally shared by that user). Users with the role of manager are given this permission by default.
• Manage advanced grading form templates (moodle/grade:managesharedforms) - grants the ability to edit and remove any shared template, even those originally shared by other users.

If you want to give these permissions to other users (eg to experienced teachers who are known to be able to produce high quality grading forms), ask your site administrator to define new system roles, eg. 'Grading forms publisher' and 'Grading forms manager', having the above capabilities granted respectively. Your site admin can then assign these roles to the selected users.

Sharing your grading forms world-wide

At the moment, there is no way how to export/import grading form definitions. The known workaround is to create an empty assignment module and attach the grading form to it. Then make a standard activity backup of this assignment in the MBZ format and share it. By restoring the assignment, the attached grading form is restored, too. It can be then picked for your own activities or shared as a template at your site.

See also

• Rubrics plugin specific documentation

Using Moodle forum discussions:

• A few Advanced Grading questions for Moodle 2.2.1
• Wrong Gradebook Calculation from 2.2 Rubric