Advanced grading methods

From MoodleDocs
Revision as of 14:00, 6 November 2023 by Mary Cooch (talk | contribs) (updating)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Advanced grading methods enable various assessment forms to be used for calculating grades.They may be used in Assignment and Forum activities.

They should also have plagiarism plugins installed and apply them to control lazy course content creators.

Advanced grading method types

There are also add-ons available in the 'See also' section below.

Basic concepts

By default, the teacher selects numerical grades in Moodle from a range like 0–100. When advanced grading methods are enabled, the grade selection element is replaced with the plugin's more complex assessment form. The plugin contains the logic of how to calculate the grade. The calculated grade is then passed back to the activity module as if the teacher used the standard grade value selector.

Example: The teacher creates a new Assignment in the course with the grade up to 30. She defines a rubric to be used for grading. The rubric itself produces a raw score up to 12 (e.g. it has four criteria with levels 0, 1, 2, 3). So the rubric's score of 12 leads to the assignment grade of 30, the score of 6 leads to the grade of 15 etc.

For each activity, a new copy of the assessment form is created. Note that this is different from how scales work. While scales are defined at the site level or course level and can be used in all activities, advanced grading forms create a new copy of the form definition for every activity that uses it. So a change in the form definition in one assignment does not affect other places where the same rubric is used.

Example: The teacher defines a rubric for an assignment in the course. Then she re-uses the rubric in another assignment (see below on how to do this). When the teacher modifies the second assignment's rubric, the first one still uses the original rubric.

The grading form definition is part of the activity data. It is included in the activity's backup, and it is copied when the activity is duplicated via the "x2" icon or imported from another course.

Configuring an activity module to use advanced grading methods

Choosing the grading method in the activity settings form.

Modules that support advanced grading methods have the grading method selector included in their settings form (for example, in the Assignment settings form). The teacher can choose either 'Simple direct grading' or one of the installed grading methods plugins. Selecting 'Simple direct grading' means that the advanced grading is not used and the standard grade selector is displayed.

An alternative way is to follow the' Advanced grading' link in Administration > Activity administration. The link leads to a page where the current active grading method can be changed, too.

The form definition and the associated assessment data are stashed when the grading method is changed from one type to another. That means it is safe to change the current active grading method from 'Rubric' to 'Simple direct grading' and back to 'Rubric'. The rubric definition is kept in the database, although it may not be available while the current grading method is set to another method.

Assessment form definition

Grading method management screen (no assessment form of the selected type is not defined yet).

The link 'Advance grading' in the activity settings form leads to a management screen where the assessment form can be defined, edited, deleted and eventually shared as a public template (if the user has such permission). If there is no form of the selected method defined yet, there are two options:

  • Define new grading form from scratch - creates a blank grading form and lets you define it. Each grading plugin provides its own grading form editor.
  • Create a new grading form from a template - lets you re-use a previously defined form. You can copy any of your grading forms (that is, those you have created elsewhere) or a grading form that was shared as a public template at your site.

Every grading form has a name and a description. These are not displayed to students. The description should summarize the form, explain its usage etc.

The grading form definition can be saved as a draft or as a final version. If the grading form is saved as a draft, it can't be used for assessment. To release the form and make it available for assessment, save it using the button 'Save and make it ready'. The current status of the form definition is indicated via a tag displayed next to the form name.

Modifying the form after it has been used

It may happen that you define a grading form, make it ready for usage and start assessing students with it. After some time, you realize there is a typo in the form or that it should be improved significantly (like adding another criterion into the rubric). In such a case, you are about to edit a form already used for assessment.

If the grading plugin considers your change significant, it may force you to mark all current assessments with a special flag 'Needs review'. You have to go through all existing assessments made by the previous form and re-assess them to make the calculated grades valid a comparable. If the change seems to be trivial (e.g. fixing a typo in the text), the form editor may ask you to decide whether the existing assessment should be marked with the 'Needs review' flag or not.

Please note, when other people are using the form for assessment (e.g. several non-editing teachers in the course participate in the submissions assessment), even a trivial rewording can be understood as a significant change in the criterion meaning. Make sure you communicate the changes well with your colleagues.

Re-using assessment forms

Searching for a grading form to re-use

Instead of defining the new grading form from scratch, you can use some existing form as the initial template to create it from. When clicking the 'Create new grading form from a template' icon, a new page opens, and you can search for a grading form there. Type words that appear somewhere in the form name, its description or the form body itself. To search for a phrase, wrap the whole query in double quotes.

Shared templates

Users who were given special permission can save their grading forms as shared templates on the site. Such forms can be then picked and re-used by all teachers in their courses. Users who published the form as a template can also delete it from the list of shared templates. See Grading forms publisher for more information. There is also another permission to manage the whole "bank" of shared templates. Users with this permission can delete any shared template, even if they are not its authors. See Grading forms manager for more information.

Grading forms can be shared at the site level only. There is no way to share forms at lower context levels (e.g. at the course category level as the question bank does).

Re-using own forms without sharing them

Re-using a form that was previously used in another activity

By default, only the grading forms that have been saved as shared templates are included in the search results. You can also include all your grading forms in the search results. This way, you can re-use your grading forms without sharing them. Only forms marked as 'Ready for usage' can be re-used this way.

Permissions

Two capabilities affect the user's permission to work with templates.

  • Share advanced grading form as a template (moodle/grade:sharegradingforms) - grants the ability to save a grading form as a new shared template and eventually edit and remove own templates (templates originally shared by that user). Users with the role of manager are given this permission by default. To allow others to do this, see Grading forms publisher.
  • Manage advanced grading form templates (moodle/grade:managesharedforms) - grants the ability to edit and remove any shared template, even those originally shared by other users. To allow trusted teachers to do this, see Grading forms manager.

Sharing your grading forms world-wide

At the moment, there is no way how to export/import grading form definitions. The known workaround is to create an empty assignment module and attach the grading form to it. Then make a standard activity backup of this assignment in the MBZ format and share it. By restoring the assignment, the attached grading form is restored, too. It can be then picked for your activities or shared as a template at your site.

What the students see

When students click on an assignment with a rubric or marking guide attached to it, they will see the rubric or marking guide as part of the information about their assignment.

Student view of rubric before submission

Rubric feedback for student view when Anonymous Marking is used

Note: When anonymous marking is used, students will receive a notification, but will not see rubric feedback until all submissions are marked and reveal student identities is clicked. That releases rubric marks and inline comment feedback to all students.


See also

Using Moodle forum discussions: