Rubrics: Difference between revisions

From MoodleDocs
(Added preliminary section on Enabling rubrics)
m (school demo account details)
 
(22 intermediate revisions by 6 users not shown)
Line 1: Line 1:
{{Advanced grading methods}}
{{Advanced grading methods}}
==About rubrics==
'''Rubrics''' are an [[Advanced grading methods|advanced grading method]] used for criteria-based assessment. The rubric consists of a set of criteria plotted against levels of achievement. A numeric grade is assigned to each level. For each criterion, the assessor chooses the level they judge the work to have reached. The raw rubric score is calculated as a sum of all criteria grades. The final grade is calculated by comparing the actual score with the worst/best possible score that could be received.
'''Rubrics''' are an [[Advanced grading methods|advanced grading method]] used for criteria-based assessment. The rubric consists of a set of criteria plotted against levels of achievement. A numeric grade is assigned to each level. For each criterion, the assessor chooses the level they judge the work to have reached. The raw rubric score is calculated as a sum of all criteria grades. The final grade is calculated by comparing the actual score with the worst/best possible score that could be received.


==First enable a rubric in your assignment==
==Enable a rubric in your assignment==
There are two ways.
 
The first is at the point of setting up the Assignment.
#In your assignment's Settings, expand the '''Grade''' section.
#In your assignment's Settings, expand the '''Grade''' section.
#From the '''Grading method''' menu, choose Rubric.
#From the '''Grading method''' menu, choose Rubric.
Line 8: Line 12:
#Save the settings; Rubric is now enabled for that particular Assignment.
#Save the settings; Rubric is now enabled for that particular Assignment.


==Prepare your rubric==
The other is via the Assignment's '''Settings''' block:
 
#From the Assignment's summary page, in its Settings block, click '''Advanced grading'''; a new page displays a menu.
[[image:gradingfrom-rubric-editor.png|thumb|right|Rubric editor]]
#From the '''Change active grading method to''' menu, choose '''Rubric'''; this initiates the rubric setup process.
 
The rubric editor is available via the advanced grading method management screen which in turn is available via the 'Advanced grading' link in the activity settings block. The editor lets you set the rubric form name, the description and the rubric itself. The editor lets you add new criteria and levels, delete them and change the criteria order. There are several rubric options that can be configured, too. For each criterion, the criterion description should be filled. For each level, the level definition and the number of points associated with the level should be specified. Neither the criterion description nor the level definition text fields support embedded images yet.


The rubric definition must be saved using either 'Save rubric and make it ready' or 'Save as draft' button. The button sets the form definition status respectively as described at the [[Advanced grading methods]] page.
==Define your rubric==


''Hint:'' You can modify the effective weight of a criterion by setting the value of the points assigned to its levels. If there is one criterion with levels 0, 1, 2, 3 and the second one with levels 0, 2, 4, 6 then the later one's impact on the final grade is twice as much as the first one's.
[[image:gradingfrom-rubric-editor.png|thumb|right|A rubric]]
To define a new rubric from scratch:
#Go to the '''Rubric editor''' via the '''Advanced grading''' link in the assignment's '''Settings''' block.
#Click '''Define a new rubric from scratch'''.
#Type in a brief distinctive '''Name''' and (if needed) a description.
#'''Click to edit a criterion''' and '''Click to edit level''' lets you tab through the rubric to type a description and assign points to each level.  
#Describe further criteria and levels as appropriate.
#Set '''Rubric options'''.
#Finally save the rubric definition by clicking '''Save rubric and make it ready''' or '''Save as draft'''. These set the form definition status respectively as described at the [[Advanced grading methods]] page.


''Hint:'' Use the Tab key to jump to the next level/criteria and even to add new criteria.
Notes:
*Unless there is a good reason otherwise, enable '''Allow users to preview rubric''' so that they know in advance the standards by which they will be judged. Enabling '''Remarks''' allows assessors to make constructive suggestions for each criterion.
*Numeric points are required, but if you want to use your rubric to give feedback without a numeric grade it is possible to hide these from students, and hide the final calculated grade from students.
*You can enter negative points, for example as a late submission penalty.
*You can modify the weight of any criterion by setting the value of the points assigned to its levels. If there is one criterion with levels 0, 1, 2, 3 and the second one with levels 0, 2, 4, 6 then the latter's impact on the final grade is twice as much as the former's.
*You can use the Tab key to jump to the next level/criteria and even to add new criteria.
* In Moodle 3.2 onwards, a new rubric option 'Calculate grade based on the rubric having a minimum score of 0' allows you to choose whether the grade is calculated as in previous versions of Moodle (box unticked) or whether an improved calculation method is used (box ticked). Please see below for details of the calculation.


== Using the rubric ==
== Grading submissions with a rubric==


[[image:gradingfrom-rubric-usage.png|thumb|right|Filling the rubric to assess a submission in the Assignment module]]
[[image:gradingfrom-rubric-usage.png|thumb|right|Filling in the rubric to assess an assignment submission]]


When teachers use the rubric to assess some student's work, they select the level describing the student's performance best for each criterion. Currently selected levels are highlighted in light green. If the rubric filling is re-edited later, the previously selected level is highlighted in light red. A level must be selected for each criterion, otherwise the rubric is not validated by the server as the final grade can't be calculated.
#To access the submissions, click a link to the Assignment; its summary page displays.
#Click '''Grade'''; the Student Grading Page displays the work of the first student listed in the Grading Table.
#The rubric you have set up will display as a table on one side of the screen - you can display it larger by clicking its Expand / arrowheads icon (to dock the rubric, click the icon again).
#For each criterion, select a level by clicking in its cell; when selected the level displays shaded (default pale green).
#If enabled on the rubric form, you can type in comments for each criterion.
#Save changes.


If the form definition allows it, an optional remark can be filled for each criterion providing a detailed feedback/explanation of the assessment.
Notes:
*As well as the rubric you can add summary '''Feedback comments''' for the work, and optionally '''Feedback files'''.
*A level must be selected for each criterion, otherwise the rubric is not validated by the server as the final grade can't be calculated.
*If the rubric filling is re-edited later, the previously selected level displays temporarily shaded (default: pink).
*Students may need to be instructed to scroll down to find the completed rubric and any other comments - the example rubric continues to display at the top of their assignment '''Submission status''' page.


== Grade calculation ==
== Grade calculation ==


The rubric normalized score (ie basically a percentage grade) is calculated as
The rubric normalized score (i.e. basically a percentage grade) is calculated as


: <math>G_s = \frac{\sum_{i=1}^N (g_i - min_i) }{\sum_{i=1}^N (max_i - min_i)}</math>
: <math>G_s = \frac{\sum_{i=1}^N (g_i - min_i) }{\sum_{i=1}^N (max_i - min_i)}</math>
Line 42: Line 67:


Note that this calculation may be different from how you intuitively use rubric. For example, when the teacher in the previous example chose both levels with 1 point, the plain sum would be 2 points. But that is actually the lowest possible score so it maps to the grade 0 in Moodle.  
Note that this calculation may be different from how you intuitively use rubric. For example, when the teacher in the previous example chose both levels with 1 point, the plain sum would be 2 points. But that is actually the lowest possible score so it maps to the grade 0 in Moodle.  
TIP: '''To avoid confusion from this sort of thing, we recommend including a level with 0 points in every rubric criterion.'''
A student's score is calculated by subtracting the minimum score available on the rubric from the student's actual score achieved on the rubric, and dividing the resulting answer by the difference between the maximum and minimum score available"


==How students access the rubric==
==How students access the rubric==
Line 53: Line 74:
|}
|}


When students click on an assignment which has a rubric  attached to it, they will see the rubric as part of the information about their assignment. Thus, they can see the rubric before they submit.
Assuming 'Allow users to preview rubric' is ticked (recommended), when students click on an assignment which has a rubric  attached to it, they will see the rubric as part of the information about their assignment. Thus, they can see the rubric before they submit.


==How teachers access the rubric==
==How teachers access the rubric==
Teachers will see the rubric when they click 'View/grade all submissions' and access the work of a particular student. They don't by default see the rubric on the grading page before grading. If you wish to allow teachers to see the rubric, then the site administrator must set the capability [[Capabilities/mod/assign:submit|mod/assign:submit]] to 'Allow' for the editing teacher role in that assignment (or sitewide if really necessary). '''NOTE:''' This then has the side effect of the teacher appearing in the gradebook.
Teachers will see the rubric when they click 'View/grade all submissions' and access the work of a particular student. They don't by default see the rubric on the grading page before grading. If you wish to allow teachers to see the rubric, then the site administrator must set the capability [[Capabilities/mod/assign:viewownsubmissionsummary|mod/assign:viewownsubmissionsummary]] to 'Allow' for the editing teacher role in that assignment (or sitewide if really necessary).


==FAQ==
==FAQ==
===Where do you go to edit a rubric?===
===Where do you go to edit a rubric?===
To edit a rubric go to
To edit a rubric click on an Assignment and then click Advanced Grading and 'Edit the current form definition.'
''Administration > Assignment Administration > Advanced grading > Define Rubric''.
 
Select 'Rubric' from Change active grading method to drop down menu.
You can see your created rubric with three options above Edit the current form definition, Delete the currently defined form, Publish the form as a new template. Click "Edit the current form definition" to edit your predefined rubric form.
===Can you copy rows of the rubric?===
===Can you copy rows of the rubric?===


Line 74: Line 93:


===Why are total grades coming out strange?===
===Why are total grades coming out strange?===
It's likely that the lowest total grade in your rubric is not zero.  In this case your rubric grades from RUBRIC MIN to RUBRIC MAX are being converted to the assignment grades of ZERO to ASSIGNMENT MAX, which is probably what you don't want. To fix this, just make sure you have a ZERO level in each of your rubric criteria (even if you never use them).
 
If you are using a criterion without a 0-points level or with a level with negative points, then the rubric option 'When converting rubric score to points/scale assume that minimum number of points is 0' (new in 3.2) should be ticked to avoid unexpected grades.


==See also==
==See also==


* [http://school.demo.moodle.net/grade/grading/form/rubric/preview.php?areaid=33 School demo example of student view of rubric] (Log in as username '''student'''/password '''moodle''')
* [http://school.demo.moodle.net/mod/assign/view.php?id=205&rownum=1&action=grade School demo example of teacher view of rubric in student assignment] (Log in as username '''teacher'''/password '''moodle''')
*[http://youtu.be/KXavtUhDINA A first look at rubrics] Screencast
* [[Advanced grading methods]] page for general concepts of advanced grading in Moodle
* [[Advanced grading methods]] page for general concepts of advanced grading in Moodle
* [https://school.moodledemo.net/grade/grading/form/rubric/preview.php?areaid=33 School demo example of student view of rubric] (Log in as username '''student'''.)
* [https://school.moodledemo.net/mod/assign/view.php?id=205&rownum=1&action=grade School demo example of teacher view of rubric in student assignment] (Log in as username '''teacher'''.)
* [http://en.wikipedia.org/wiki/Rubric_(academic) Rubric description] at Wikipedia
* [http://en.wikipedia.org/wiki/Rubric_(academic) Rubric description] at Wikipedia
* [http://school.discoveryeducation.com/schrockguide/assess.html Examples of Assessment Rubrics] at Kathy Schrock's Guide for Educators
* http://rubistar.4teachers.org/ - a free tool to help teachers create quality rubrics
* http://rubistar.4teachers.org/ - a free tool to help teachers create quality rubrics
* [https://digiteacher.wordpress.com/2014/11/20/my-teacher-is-a-zombie-marking-by-rubric-on-moodle/ My Teacher is a Zombie – Marking by Rubric on Moodle] Using an electronic rubric frees up the time to ...
* [https://digiteacher.wordpress.com/2014/11/20/my-teacher-is-a-zombie-marking-by-rubric-on-moodle/ My Teacher is a Zombie – Marking by Rubric on Moodle] Using an electronic rubric frees up the time to ...


[[fr:Grille d'évaluation]]
[[de:Rubriken]]
[[de:Rubriken]]
[[es:Rúbricas]]
[[es:Rúbricas]]

Latest revision as of 09:05, 22 October 2024

About rubrics

Rubrics are an advanced grading method used for criteria-based assessment. The rubric consists of a set of criteria plotted against levels of achievement. A numeric grade is assigned to each level. For each criterion, the assessor chooses the level they judge the work to have reached. The raw rubric score is calculated as a sum of all criteria grades. The final grade is calculated by comparing the actual score with the worst/best possible score that could be received.

Enable a rubric in your assignment

There are two ways.

The first is at the point of setting up the Assignment.

  1. In your assignment's Settings, expand the Grade section.
  2. From the Grading method menu, choose Rubric.
  3. Note the Maximum grade setting - whatever numeric grade you assign to your criteria levels, the ultimate grade for the assignment will be recalculated as the proportion of that maximum grade.
  4. Save the settings; Rubric is now enabled for that particular Assignment.

The other is via the Assignment's Settings block:

  1. From the Assignment's summary page, in its Settings block, click Advanced grading; a new page displays a menu.
  2. From the Change active grading method to menu, choose Rubric; this initiates the rubric setup process.

Define your rubric

A rubric

To define a new rubric from scratch:

  1. Go to the Rubric editor via the Advanced grading link in the assignment's Settings block.
  2. Click Define a new rubric from scratch.
  3. Type in a brief distinctive Name and (if needed) a description.
  4. Click to edit a criterion and Click to edit level lets you tab through the rubric to type a description and assign points to each level.
  5. Describe further criteria and levels as appropriate.
  6. Set Rubric options.
  7. Finally save the rubric definition by clicking Save rubric and make it ready or Save as draft. These set the form definition status respectively as described at the Advanced grading methods page.

Notes:

  • Unless there is a good reason otherwise, enable Allow users to preview rubric so that they know in advance the standards by which they will be judged. Enabling Remarks allows assessors to make constructive suggestions for each criterion.
  • Numeric points are required, but if you want to use your rubric to give feedback without a numeric grade it is possible to hide these from students, and hide the final calculated grade from students.
  • You can enter negative points, for example as a late submission penalty.
  • You can modify the weight of any criterion by setting the value of the points assigned to its levels. If there is one criterion with levels 0, 1, 2, 3 and the second one with levels 0, 2, 4, 6 then the latter's impact on the final grade is twice as much as the former's.
  • You can use the Tab key to jump to the next level/criteria and even to add new criteria.
  • In Moodle 3.2 onwards, a new rubric option 'Calculate grade based on the rubric having a minimum score of 0' allows you to choose whether the grade is calculated as in previous versions of Moodle (box unticked) or whether an improved calculation method is used (box ticked). Please see below for details of the calculation.

Grading submissions with a rubric

Filling in the rubric to assess an assignment submission
  1. To access the submissions, click a link to the Assignment; its summary page displays.
  2. Click Grade; the Student Grading Page displays the work of the first student listed in the Grading Table.
  3. The rubric you have set up will display as a table on one side of the screen - you can display it larger by clicking its Expand / arrowheads icon (to dock the rubric, click the icon again).
  4. For each criterion, select a level by clicking in its cell; when selected the level displays shaded (default pale green).
  5. If enabled on the rubric form, you can type in comments for each criterion.
  6. Save changes.

Notes:

  • As well as the rubric you can add summary Feedback comments for the work, and optionally Feedback files.
  • A level must be selected for each criterion, otherwise the rubric is not validated by the server as the final grade can't be calculated.
  • If the rubric filling is re-edited later, the previously selected level displays temporarily shaded (default: pink).
  • Students may need to be instructed to scroll down to find the completed rubric and any other comments - the example rubric continues to display at the top of their assignment Submission status page.

Grade calculation

The rubric normalized score (i.e. basically a percentage grade) is calculated as

where is the number of points given to the i-th criterion, is the minimal possible number of points for of the i-th criterion, is the maximal possible number of points for the i-th criterion and is the number of criteria in the rubric.

Example of a single criterion can be: Overall quality of the paper with the levels 5 - An excellent paper, 3 - A mediocre paper, 0 - A weak paper (the number represent the number of points).

Example: let us have an assessment form with two criteria, which both have four levels 1, 2, 3, 4. The teacher chooses level with 2 points for the first criterion and 3 points for the second criterion. Then the normalized score is:

Note that this calculation may be different from how you intuitively use rubric. For example, when the teacher in the previous example chose both levels with 1 point, the plain sum would be 2 points. But that is actually the lowest possible score so it maps to the grade 0 in Moodle.

How students access the rubric

How students view a rubric

Assuming 'Allow users to preview rubric' is ticked (recommended), when students click on an assignment which has a rubric attached to it, they will see the rubric as part of the information about their assignment. Thus, they can see the rubric before they submit.

How teachers access the rubric

Teachers will see the rubric when they click 'View/grade all submissions' and access the work of a particular student. They don't by default see the rubric on the grading page before grading. If you wish to allow teachers to see the rubric, then the site administrator must set the capability mod/assign:viewownsubmissionsummary to 'Allow' for the editing teacher role in that assignment (or sitewide if really necessary).

FAQ

Where do you go to edit a rubric?

To edit a rubric click on an Assignment and then click Advanced Grading and 'Edit the current form definition.'

Can you copy rows of the rubric?

A 'duplicate' button allows you to quickly make a copy of a row:

duplicaterubricrow.png

How do you choose another rubric for an assignment?

From Administration>Assignment administration>Advanced grading access your rubric and delete it. The see #5 in Advanced grading methods

Why are total grades coming out strange?

If you are using a criterion without a 0-points level or with a level with negative points, then the rubric option 'When converting rubric score to points/scale assume that minimum number of points is 0' (new in 3.2) should be ticked to avoid unexpected grades.

See also