Workshop settings

Adding a new workshop

With the editing turned on, in the section you wish to add your workshop, click the "Add an activity or resource" link (or, if not present, the "Add an activity" drop down menu) and choose Workshop.
On the next screen, in the General section, give the workshop a name and a description which explains to the students what the workshop will be about. You can display this description by ticking the checkbox
All settings may expanded by clicking the "Expand all" link top right

Grading settings

Grading Strategy

What you choose here determines the assessment form students will use and also the strategy for grading submissions. For more detailed descriptions see Grading Strategies. Note: Grading strategies can't be changed once we have entered the submission phase of a workshop

Accumulative grading: Comments and a grade are given regarding the aspects of the workshop specified.

Comments: Comments are given but no grade can be given to the specified aspects

Number of Errors: A yes/no assessment is used and comments are given for specified assertions

Rubric: A level assessment is given regarding specified criteria

Grade for Submission

This sets the maximum grade a student can attain from a teacher for a given submission. It is scaled between 0-100. If you have set up any Grade Categories, you will see a picklist.

Submission grade to pass

Here you can set a passing grade for the workshop submission. This may be connected with Activity completion and Conditional activities such that a student will not be able to access a follow up activity until they have obtained the required grade.

Grade for Assessment

Sets the maximum grade a student can receive for assessing other students’ work. It is also scaled between 0-100. If you have set up any Grade Categories, you will see a picklist.

Assessment grade to pass

Here you can set a passing grade for the workshop assessment. This may be connected with Activity completion and Conditional activities such that a student will not be able to access a follow up activity until they have obtained the required grade.

Submission settings

Instructions for submission

Students see this when they click on the link to the Workshop. Explain here what they need to do to make a successful submission (It may also help to refer them back to general instructions for using the Workshop - how to find out when the deadlines are and what they do at each stage).

If you wish students to attach files, select how many here, up to a maximum of 7. If you leave it at 0 then they can only enter text. You can also specify the maximum upload size of the files they upload - depending on the course limit.

Late Submissions

Ticking this box will allow students to submit after the deadline. Any late submissions cannot be edited by the student - they just have one chance to submit.

If late submissions are allowed, there is no way to automatically allocate assessors to them. You'll need to to manually allocate assessors to these late submissions.

(Allocation settings are explained below - they will be made after these workshop settings have been saved by clicking the “Allocate Submissions” link highlighted with a red box in the picture of the dashboard. See the section Submission phase.)

"Where to locate more settings for submissions"

Submission settings for allocating reviewers to submissions

Assessment settings

Instructions for assessment

Students see these instructions when the Workshop is in Assessment Phase. They are important to students' understanding of the task before assessing their classmates’ submissions.

After these workshop settings have been saved, Teachers can access further settings related to allocating assessments. See the section Setup phase.

Use self-assessment

Checking this box means that students may be allocated their own work to assess. This will depend on Moodle's allocation i.e. the larger the group of students the less likely it is that anyone will be allocated their own work.

Feedback

Overall feedback mode

If this is enabled, a text box appears at the bottom of each assessment form for reviewers to give an overall comment about the submission. You can make this required or optional, and you can also specify a number of attachments and maximum upload size of these attached files, dependent on the course upload limit.

Conclusion

Text you add here will be shown to the students when the workshop is over. It is a good idea to signpost students to how they can access the assessments they have received. It might also include suggestions on what students should do next.

Example submissions

In some situations, it might be helpful to the students to see one or more examples of what they must submit. If you offer example submission, you can choose whether students are required to assess them or if is optional. If they are required to assess the example submissions, then you can also decide whether they assess them before they submit their own work or afterwards, but before peer assessing.

Note: Assessments of the example submission are not counted when calculating the grade for assessment.

Availability

This section deals with setting submission times and assessment times for the workshop. That is the time when students can start submitting as well as the deadline for submitting, and similarly the time assessments for other students’ work start and when they must finish assessing other students work.

All dates - open for submissions from, submissions deadline, open for assessment from and assessment deadline - are displayed in the course calendar.

Availability lets a teacher decide if they want a workshop with a closed schedule or one that is open ended. Setting an opening time but leaving the deadline open makes it an ongoing activity. To set the opening time and deadline for either submissions or assessments teachers must click the enable button next to the option they want to set. Once the enabled has been checked the 5 drop down boxes will be activated and available for change.

The first three boxes correspond to the date and we can either set this box by box or by selecting the date in the calendar that pops up when any of the date boxes are selected. The last two boxes correspond to the time in 24 hour time, the first of the two being hours and the second being minutes. Teachers simply set the desired time for each of the sections they wish to activate.

If teachers check the box "Switch to the next phase after the submissions deadline", the workshop will automatically switch to the assessment phase after the next cron job.

Note that even if Switch to the next phase after the submissions deadline is enabled, a teacher will need to manually move the workshop into Submission Phase and click on Close to conclude the workshop and reveal the assessments.

Common module settings

See Common module settings

Restrict access/Activity completion

These settings are visible if Restrict access and Activity completion have been enabled in the site and the course.

Click Save and Display to access further settings

Setup phase

You must now click 'Edit assessment form' to set the criteria students will need for when they do their peer assessments later on.
Include an example submission if you want students to be able to see this form when they submit.
You can choose from several grading strategies. See Workshop grading strategies for more information.

Submission phase

To decide how students will receive the submissions of their peers, click the 'Allocate submissions' link in the Submission phase section.

Manual Allocation options

Random Allocation options

Scheduled Allocation options

Manual Allocation

Here,a teacher can manually choose which students review whose work. A student can review work even if they have not submitted anything themselves.

Random Allocation

The teacher is given 5 settings that determine how the random allocation will work.

Number of reviews: Here the teacher picks between 0 and 30 reviews for either each submission or per reviewer. That is the teacher may choose to either set the number of reviews each submission must have or the number of reviews each student has to carry out
Prevent Reviews: If the teacher wishes for students of the same group to never review each other’s work, as most likely it is their work too in a group submission, then they can check this box and moodle will ensure that they are only allocated other students out of their group’s work to access
Remove current allocations: Checking this box means that any manual allocations that have been set in the Manual Allocation menu will be removed
Can access with no submission: Having this box checked allows students to assess other students’ work without having already submitted their own work.
Add self assessments: This options when checked make sure that as well as assessing other students’ work they must also assess their own. This is a good option to teach students how to be objective towards their own work.

Scheduled Allocation

-TBC-

Assessment phase

Examples:

Students can assess example submissions for practice before assessing their peers' work if this feature is enabled. They can compare their assessments with reference assessments made by the teacher. The grade will not be counted in the grade for assessment.

Teachers need to upload one or more example submissions and the corresponding reference assessment to support this function.

Teachers can also edit the reference assessment later by clicking the ‘re-assess’ button in the first page.

Peer assessment:

If this feature is enabled, a student will be allocated a certain amount of submissions from his peers to assess. He will receive a grade for each assessment, which will be added together with the grade for his own submission and this will be used as his final grade for this assignment.

This is the key feature of workshop: To encourage students to assess the work of their peers and learn from each other. Through this, they will see the strengths of their classmates’ submissions and have a better understanding about how to do a good job. In addition, the advices they get from their peers will give them a more comprehensive view of their own work: The comments from their peers will point out the weakness of their work, which is generally difficult to find out by themselves.

Self-assessment:

If this option is turned on, a student may be allocated his own work to assess. The grade he receives from assessment of his own work will be counted into the grade for assessment, which will be added together with the grade for submission and used to calculate his final grade for this assignment.

This setting enables teachers to see whether students can find out the strength and weakness of their own submissions and judge them objectively. It is a good way to help students think more comprehensively.

Grading evaluation phase

Grading evaluation settings

Here you can choose your settings for calculation of the grade for assessments.

Grade calculation method

This setting determines how to calculate grade for assessments. Currently there is only one option- comparison with the best assessment.

The Comparison with the best assessment tries to imagine what a hypothetical absolutely fair assessment would look like.

For example, a teacher uses Number of errors as grading strategy to peer-assess one assignment. This strategy uses a couple of assertions and assessors just need to check if the given assertion is passed or failed. That is, they only need to choose ‘yes’ or ‘no’ for each criterion in the assessment form. In this case, there are three assessors, Alice, Bob and Cindy. And the assessment form contains three criteria. The author will get 100% grade if all the criteria are passed, 75% if two criteria are passed, 25% if only one criterion is passed and 0% if the assessor gives ‘no’ for all three assertions. Here are the assessments they give to one certain work:

Alice: yes/yes/no
Bob: yes/yes/no
Cindy: no/yes/yes

Then the best assessment will be:
Yes/yes/no

Second, the workshop will give the best assessment 100% grade. Next it will measure the ‘distance’ from other assessments to this best assessment. The farther the distance, the lower grade the assessment will receive. And Comparison of assessments setting, next to the Grade evaluation setting, will determine how quickly the grade falls down if the assessment differs from the best one.

Note: Comparison with the best assessment method will compare responses to each individual criterion instead of comparing the final grades. In the example above, all of the three assessors give 75% to the submission. However, only Alice and Bob will get 100% grade for their assessments, while Cindy will get a lower grade. Because Alice and Bob agree in individual responses too, while the responses in Cindy’s assessment are different.

Comparison of assessments:

This setting has 5 options: very lax, lax, fair, strict and very strict. It specifies how strict the comparison of assessment should be. By using comparison with the best assessment method, all assessments will be compared with the best assessment picked up by workshop. The more similar one assessment is with the best assessment, the higher grade this assessment will get, and vice versa. This setting determines how quickly the grades fall down when the assessments differ from the best assessment.

Workshop toolbox

Clear all aggregated grades

Clicking this button will reset aggregated grades for submission and grades for assessment. Teachers can re-calculate these grades from scratch in Grade evaluation phase.

Clear assessments

By clicking this button, grades for assessments along with grades for submission will be reset. The assessment form will remain the same but all the reviewers need to open the assessment form again and re-save it to get the given grades calculated again.

Site administration settings

The workshop module has additional settings which may be changed by an administrator in Administration > Site administration > Plugins > Activity modules > Workshop. The settings enable default values to be set for all edit workshop settings.

Documentation