Advanced grading methods: Difference between revisions
Helen Foster (talk | contribs) (removing new features template) |
Mary Cooch (talk | contribs) m (updating) |
||
(28 intermediate revisions by 8 users not shown) | |||
Line 1: | Line 1: | ||
{{Grades}}'''Advanced grading methods''' | {{Grades}}'''Advanced grading methods''' enable various assessment forms to be used for calculating grades.They may be used in [[Assignment]] and [[Forum]] activities. | ||
[[image:comicstrip-rubrics.png|600px|They should also have plagiarism plugins installed and apply them to control lazy course content creators.]] | [[image:comicstrip-rubrics.png|600px|They should also have plagiarism plugins installed and apply them to control lazy course content creators.]] | ||
==Advanced grading method types== | |||
* [[Rubrics]] | |||
* [[Marking guide]] | |||
There are also add-ons available in the 'See also' section below. | |||
== Basic concepts == | == Basic concepts == | ||
By default, numerical grades in Moodle | By default, the teacher selects numerical grades in Moodle from a range like 0–100. When advanced grading methods are enabled, the grade selection element is replaced with the plugin's more complex assessment form. The plugin contains the logic of how to calculate the grade. The calculated grade is then passed back to the activity module as if the teacher used the standard grade value selector. | ||
:''Example:'' The teacher creates new Assignment in the course with the grade up to 30. She defines a rubric to be used for grading. The rubric itself produces raw score up to 12 ( | :''Example:'' The teacher creates a new Assignment in the course with the grade up to 30. She defines a rubric to be used for grading. The rubric itself produces a raw score up to 12 (e.g. it has four criteria with levels 0, 1, 2, 3). So the rubric's score of 12 leads to the assignment grade of 30, the score of 6 leads to the grade of 15 etc. | ||
For each activity, a new copy of the assessment form is created. Note that this is different from how [[ | For each activity, a new copy of the assessment form is created. Note that this is different from how [[scales]] work. While scales are defined at the site level or course level and can be used in all activities, advanced grading forms create a new copy of the form definition for every activity that uses it. So a change in the form definition in one assignment does not affect other places where the same rubric is used. | ||
:''Example:'' The teacher defines a rubric for an assignment in the course. Then she re-uses the rubric in another assignment (see below on how to do this). When the teacher modifies | :''Example:'' The teacher defines a rubric for an assignment in the course. Then she re-uses the rubric in another assignment (see below on how to do this). When the teacher modifies the second assignment's rubric, the first one still uses the original rubric. | ||
The grading form definition is part of the activity data. It is included in the activity's backup and it is copied when the activity is duplicated via the "x2" icon or imported from another course. | The grading form definition is part of the activity data. It is included in the activity's backup, and it is copied when the activity is duplicated via the "x2" icon or imported from another course. | ||
== Configuring an activity module to use advanced grading methods == | == Configuring an activity module to use advanced grading methods == | ||
Line 19: | Line 26: | ||
[[image:grading-method-selection-modform.png|thumb|right|Choosing the grading method in the activity settings form.]] | [[image:grading-method-selection-modform.png|thumb|right|Choosing the grading method in the activity settings form.]] | ||
Modules that support advanced grading methods have the grading method selector included in their settings form (for example in the [[Assignment settings]] form). The teacher can choose either 'Simple direct grading' or one of the installed grading methods plugins. Selecting 'Simple direct grading' means that the advanced grading is not used and the standard grade selector is displayed. | Modules that support advanced grading methods have the grading method selector included in their settings form (for example, in the [[Assignment settings]] form). The teacher can choose either 'Simple direct grading' or one of the installed grading methods plugins. Selecting 'Simple direct grading' means that the advanced grading is not used and the standard grade selector is displayed. | ||
An alternative way is to follow the' Advanced grading' link in ''Administration > Activity administration''. The link leads to a page where the current active grading method can be changed, too. | |||
The form definition and the associated assessment data are stashed when the grading method is changed from one type to another. That means it is | The form definition and the associated assessment data are stashed when the grading method is changed from one type to another. That means it is safe to change the current active grading method from 'Rubric' to 'Simple direct grading' and back to 'Rubric'. The rubric definition is kept in the database, although it may not be available while the current grading method is set to another method. | ||
== Assessment form definition == | == Assessment form definition == | ||
Line 32: | Line 39: | ||
* Define new grading form from scratch - creates a blank grading form and lets you define it. Each grading plugin provides its own grading form editor. | * Define new grading form from scratch - creates a blank grading form and lets you define it. Each grading plugin provides its own grading form editor. | ||
* Create new grading form from a template - lets you re-use a previously defined form. You can copy any of your | * Create a new grading form from a template - lets you re-use a previously defined form. You can copy any of your grading forms (that is, those you have created elsewhere) or a grading form that was shared as a public template at your site. | ||
Every grading form has a name and a description. These are not displayed to students. The description should summarize the form, explain its usage etc. | Every grading form has a name and a description. These are not displayed to students. The description should summarize the form, explain its usage etc. | ||
The grading form definition can be saved as a draft or as a final version. If the grading form is saved as a draft, it can't be used for | The grading form definition can be saved as a draft or as a final version. If the grading form is saved as a draft, it can't be used for assessment. To release the form and make it available for assessment, save it using the button 'Save and make it ready'. The current status of the form definition is indicated via a tag displayed next to the form name. | ||
=== Modifying the form after it has been used === | === Modifying the form after it has been used === | ||
It may happen that you define a grading form, make it ready for usage and start assessing students with it. After some time you realize there is a typo in the form or that it should be | It may happen that you define a grading form, make it ready for usage and start assessing students with it. After some time, you realize there is a typo in the form or that it should be improved significantly (like adding another criterion into the rubric). In such a case, you are about to edit a form already used for assessment. | ||
If the grading plugin considers your change | If the grading plugin considers your change significant, it may force you to mark all current assessments with a special flag 'Needs review'. You have to go through all existing assessments made by the previous form and re-assess them to make the calculated grades valid a comparable. If the change seems to be trivial (e.g. fixing a typo in the text), the form editor may ask you to decide whether the existing assessment should be marked with the 'Needs review' flag or not. | ||
Please note, when | Please note, when other people are using the form for assessment (e.g. several non-editing teachers in the course participate in the submissions assessment), even a trivial rewording can be understood as a significant change in the criterion meaning. Make sure you communicate the changes well with your colleagues. | ||
== Re-using assessment forms == | == Re-using assessment forms == | ||
Line 50: | Line 57: | ||
[[image:grading-pick-search.png|thumb|right|Searching for a grading form to re-use]] | [[image:grading-pick-search.png|thumb|right|Searching for a grading form to re-use]] | ||
Instead of defining the new grading form from scratch, you can use some existing form as the initial template to create it from. When clicking the 'Create new grading form from a template' icon, a new page opens and you can search for a grading form there. | Instead of defining the new grading form from scratch, you can use some existing form as the initial template to create it from. When clicking the 'Create new grading form from a template' icon, a new page opens, and you can search for a grading form there. Type words that appear somewhere in the form name, its description or the form body itself. To search for a phrase, wrap the whole query in double quotes. | ||
=== Shared templates === | === Shared templates === | ||
Users who were given | Users who were given special permission can save their grading forms as shared templates on the site. Such forms can be then picked and re-used by all teachers in their courses. Users who published the form as a template can also delete it from the list of shared templates. See [[Grading forms publisher]] for more information. There is also another permission to manage the whole "bank" of shared templates. Users with this permission can delete any shared template, even if they are not its authors. See [[Grading forms manager]] for more information. | ||
Grading forms can be shared at the site level only. There is no way | Grading forms can be shared at the site level only. There is no way to share forms at lower context levels (e.g. at the course category level as the question bank does). | ||
=== Re-using own forms without sharing them === | === Re-using own forms without sharing them === | ||
Line 62: | Line 69: | ||
[[image:grading-pick-ownform.png|thumb|right|Re-using a form that was previously used in another activity]] | [[image:grading-pick-ownform.png|thumb|right|Re-using a form that was previously used in another activity]] | ||
By default, only the grading forms that have been saved as shared templates are included in the search results. You can also include all your | By default, only the grading forms that have been saved as shared templates are included in the search results. You can also include all your grading forms in the search results. This way, you can re-use your grading forms without sharing them. Only forms marked as 'Ready for usage' can be re-used this way. | ||
=== Permissions === | === Permissions === | ||
Two capabilities affect the user's permission to work with templates. | |||
* Share advanced grading form as a template ([[Capabilities/moodle/grade:sharegradingforms|moodle/grade:sharegradingforms]]) - grants the ability to save a grading form as a new shared template and eventually edit and remove own templates (templates originally shared by that user). Users with the role of manager are given this permission by default. | * Share advanced grading form as a template ([[Capabilities/moodle/grade:sharegradingforms|moodle/grade:sharegradingforms]]) - grants the ability to save a grading form as a new shared template and eventually edit and remove own templates (templates originally shared by that user). Users with the role of manager are given this permission by default. To allow others to do this, see [[Grading forms publisher]]. | ||
* Manage advanced grading form templates ([[Capabilities/moodle/grade:managesharedforms|moodle/grade:managesharedforms]]) - grants the ability to edit and remove any shared template, even those originally shared by other users. | * Manage advanced grading form templates ([[Capabilities/moodle/grade:managesharedforms|moodle/grade:managesharedforms]]) - grants the ability to edit and remove any shared template, even those originally shared by other users. To allow trusted teachers to do this, see [[Grading forms manager]]. | ||
=== Sharing your grading forms world-wide === | |||
== | At the moment, there is no way how to export/import grading form definitions. The known workaround is to create an empty assignment module and attach the grading form to it. Then make a standard activity backup of this assignment in the MBZ format and share it. By restoring the assignment, the attached grading form is restored, too. It can be then picked for your activities or shared as a template at your site. | ||
==What the students see== | |||
When students click on an assignment with a rubric or marking guide attached to it, they will see the rubric or marking guide as part of the information about their assignment. | |||
{| | |||
|[[File:rubricbeforesubmission.png|thumb|Student view of rubric '''before''' submission]] | |||
|} | |||
==Rubric feedback for student view when Anonymous Marking is used== | |||
Note: When '''[[Assignment settings#Anonymous marking|anonymous marking]]''' is used, students ''will'' receive a notification, but will ''not'' see rubric feedback until ''all'' submissions are marked and '''reveal student identities''' is clicked. That releases rubric marks and inline comment feedback to all students. | |||
* [[ | ==See also== | ||
* [[Learning Analytics Enriched Rubric]] | |||
* [[BTEC marking]] for use with Moodle assignments | |||
Using Moodle forum discussions: | Using Moodle forum discussions: | ||
* [http://moodle.org/mod/forum/discuss.php?d=193460 A few Advanced Grading questions for Moodle 2.2.1] | * [http://moodle.org/mod/forum/discuss.php?d=193460 A few Advanced Grading questions for Moodle 2.2.1] | ||
* [http://moodle.org/mod/forum/discuss.php?d=193961 Wrong Gradebook Calculation from 2.2 Rubric] | * [http://moodle.org/mod/forum/discuss.php?d=193961 Wrong Gradebook Calculation from 2.2 Rubric] | ||
[[de:Erweiterte Bewertungsmethoden]] | |||
[[es:Métodos avanzados de calificar]] |
Latest revision as of 14:00, 6 November 2023
Advanced grading methods enable various assessment forms to be used for calculating grades.They may be used in Assignment and Forum activities.
Advanced grading method types
There are also add-ons available in the 'See also' section below.
Basic concepts
By default, the teacher selects numerical grades in Moodle from a range like 0–100. When advanced grading methods are enabled, the grade selection element is replaced with the plugin's more complex assessment form. The plugin contains the logic of how to calculate the grade. The calculated grade is then passed back to the activity module as if the teacher used the standard grade value selector.
- Example: The teacher creates a new Assignment in the course with the grade up to 30. She defines a rubric to be used for grading. The rubric itself produces a raw score up to 12 (e.g. it has four criteria with levels 0, 1, 2, 3). So the rubric's score of 12 leads to the assignment grade of 30, the score of 6 leads to the grade of 15 etc.
For each activity, a new copy of the assessment form is created. Note that this is different from how scales work. While scales are defined at the site level or course level and can be used in all activities, advanced grading forms create a new copy of the form definition for every activity that uses it. So a change in the form definition in one assignment does not affect other places where the same rubric is used.
- Example: The teacher defines a rubric for an assignment in the course. Then she re-uses the rubric in another assignment (see below on how to do this). When the teacher modifies the second assignment's rubric, the first one still uses the original rubric.
The grading form definition is part of the activity data. It is included in the activity's backup, and it is copied when the activity is duplicated via the "x2" icon or imported from another course.
Configuring an activity module to use advanced grading methods
Modules that support advanced grading methods have the grading method selector included in their settings form (for example, in the Assignment settings form). The teacher can choose either 'Simple direct grading' or one of the installed grading methods plugins. Selecting 'Simple direct grading' means that the advanced grading is not used and the standard grade selector is displayed.
An alternative way is to follow the' Advanced grading' link in Administration > Activity administration. The link leads to a page where the current active grading method can be changed, too.
The form definition and the associated assessment data are stashed when the grading method is changed from one type to another. That means it is safe to change the current active grading method from 'Rubric' to 'Simple direct grading' and back to 'Rubric'. The rubric definition is kept in the database, although it may not be available while the current grading method is set to another method.
Assessment form definition
The link 'Advance grading' in the activity settings form leads to a management screen where the assessment form can be defined, edited, deleted and eventually shared as a public template (if the user has such permission). If there is no form of the selected method defined yet, there are two options:
- Define new grading form from scratch - creates a blank grading form and lets you define it. Each grading plugin provides its own grading form editor.
- Create a new grading form from a template - lets you re-use a previously defined form. You can copy any of your grading forms (that is, those you have created elsewhere) or a grading form that was shared as a public template at your site.
Every grading form has a name and a description. These are not displayed to students. The description should summarize the form, explain its usage etc.
The grading form definition can be saved as a draft or as a final version. If the grading form is saved as a draft, it can't be used for assessment. To release the form and make it available for assessment, save it using the button 'Save and make it ready'. The current status of the form definition is indicated via a tag displayed next to the form name.
Modifying the form after it has been used
It may happen that you define a grading form, make it ready for usage and start assessing students with it. After some time, you realize there is a typo in the form or that it should be improved significantly (like adding another criterion into the rubric). In such a case, you are about to edit a form already used for assessment.
If the grading plugin considers your change significant, it may force you to mark all current assessments with a special flag 'Needs review'. You have to go through all existing assessments made by the previous form and re-assess them to make the calculated grades valid a comparable. If the change seems to be trivial (e.g. fixing a typo in the text), the form editor may ask you to decide whether the existing assessment should be marked with the 'Needs review' flag or not.
Please note, when other people are using the form for assessment (e.g. several non-editing teachers in the course participate in the submissions assessment), even a trivial rewording can be understood as a significant change in the criterion meaning. Make sure you communicate the changes well with your colleagues.
Re-using assessment forms
Instead of defining the new grading form from scratch, you can use some existing form as the initial template to create it from. When clicking the 'Create new grading form from a template' icon, a new page opens, and you can search for a grading form there. Type words that appear somewhere in the form name, its description or the form body itself. To search for a phrase, wrap the whole query in double quotes.
Users who were given special permission can save their grading forms as shared templates on the site. Such forms can be then picked and re-used by all teachers in their courses. Users who published the form as a template can also delete it from the list of shared templates. See Grading forms publisher for more information. There is also another permission to manage the whole "bank" of shared templates. Users with this permission can delete any shared template, even if they are not its authors. See Grading forms manager for more information.
Grading forms can be shared at the site level only. There is no way to share forms at lower context levels (e.g. at the course category level as the question bank does).
Re-using own forms without sharing them
By default, only the grading forms that have been saved as shared templates are included in the search results. You can also include all your grading forms in the search results. This way, you can re-use your grading forms without sharing them. Only forms marked as 'Ready for usage' can be re-used this way.
Permissions
Two capabilities affect the user's permission to work with templates.
- Share advanced grading form as a template (moodle/grade:sharegradingforms) - grants the ability to save a grading form as a new shared template and eventually edit and remove own templates (templates originally shared by that user). Users with the role of manager are given this permission by default. To allow others to do this, see Grading forms publisher.
- Manage advanced grading form templates (moodle/grade:managesharedforms) - grants the ability to edit and remove any shared template, even those originally shared by other users. To allow trusted teachers to do this, see Grading forms manager.
Sharing your grading forms world-wide
At the moment, there is no way how to export/import grading form definitions. The known workaround is to create an empty assignment module and attach the grading form to it. Then make a standard activity backup of this assignment in the MBZ format and share it. By restoring the assignment, the attached grading form is restored, too. It can be then picked for your activities or shared as a template at your site.
What the students see
When students click on an assignment with a rubric or marking guide attached to it, they will see the rubric or marking guide as part of the information about their assignment.
Rubric feedback for student view when Anonymous Marking is used
Note: When anonymous marking is used, students will receive a notification, but will not see rubric feedback until all submissions are marked and reveal student identities is clicked. That releases rubric marks and inline comment feedback to all students.
See also
- Learning Analytics Enriched Rubric
- BTEC marking for use with Moodle assignments
Using Moodle forum discussions: