Difference between revisions of "Quiz settings"
Note: You are currently viewing documentation for Moodle 2.2. Up-to-date documentation for the latest stable version is available here: Quiz settings.
m (→Certainty-based marking)
|Line 78:||Line 78:|
| [[File:cbm03.png|thumb|correct answer; very sure]]
| [[File:cbm03.png|thumb|correct answer; very sure]]
| [[File:.png|thumb|correct answer; fairly sure]]
| [[File:cmb04.png|thumb|correct answer; not very sure]]
| [[File:cmb04.png|thumb|correct answer; not very sure]]
| [[File:cbm01.png|thumb|wrong answer; very sure]]
| [[File:cbm01.png|thumb|wrong answer; very sure]]
Revision as of 18:39, 7 October 2012
Creating a new quiz is a two-step process. In the first step, you create the quiz activity and set its options which specify the rules for interacting with the quiz. In the second step you add questions to the quiz. This page describes the options you can set for the quiz activity. The page Building Quiz describes how to set up the questions for the quiz.
Quiz options There are a large number of options and your administrator should already have chosen the default values for most of them so that you will not have to modify them for the type of quiz that you use most often. The administrator may also have classified some of the settings as 'advanced' which means that they will be hidden from the set-up screen by default. This can help to keep the screen simpler. You can turn on the display of these advanced options by clicking on the Show advanced settings button. They will then remain visible until you click on Hide advanced settings.
- 1 Quiz administration
- 2 Group and User overrides
- 3 Site administration settings
- 4 See also
When you first set up your quiz from Add an activity > Quiz, you will get the following settings, (which can also be changed later in the Edit Settings link of the Quiz administration settings block)
- This is the standard name field. This name will appear on the home page of the course, navigation menu and other places which will show or provide links to this quiz.
- Write an introduction for the quiz. A student will see the introduction immediately after clicking on the quiz name. The student will see this description before they click on the "Attempt quiz" link and thus before the quiz timer is started (if used). This is a good place to include any special instructions for taking the quiz like the number of attempts allowed, time limit or scoring rules.
in Moodle 2.2!
- Display description on course page
- You can choose to make the description visible with the activity on the course page.
- Open the quiz
- You can specify times when the quiz is accessible for people to make attempts. Before the opening time the quiz will be unavailable to students. They will be able to view the quiz introduction but will not be able to view the questions.
Note: You can make the quiz available at different times for different groups or users in the Group or User override sections of the Quiz Adminstration settings block.
- Close the quiz
- After the closing time, the students will not be able to start new attempts. Answers that the student submits after the quiz closing date will be saved but they will not be marked.
- Even after the quiz has closed students will still be able to see the quiz description and review their attempts. What exactly they will see depends on the settings you choose for review options (see below).
Note: The quiz closing time is the last access time AND the time when the quiz must be completed. If a time limit is set, regardless of whether there is time left on the timer, the quiz closing time determines when a student's attempt ends.
- Time limit
- By default, quizzes do not have a time limit, which allows students as much time as they need to complete the quiz. If you do specify a time limit, several things are done to try and ensure that quizzes are completed within that time:
- A countdown timer is shown in the quiz navigation block
- When the timer has run out, the quiz is submitted automatically with whatever answers have been filled in so far
- If a student manages to cheat and goes over the allotted time, no marks are awarded for any answers entered after the time ran out
Note: If a quiz closing time is set, a student's attempt will end on or before this time, regardless of whether there is time left on the timer. Thus, if a quiz closing time is set together with a time limit of say 3 hours, it is recommended that students are informed that they must begin their quiz attempt at least 3 hours before the quiz closing time.
Note: You can make the quiz available last a different period of time for different groups or users in the Group or User override sections of the Quiz Administration settings block (see below).
- Attempts allowed
- Students may be allowed to have multiple attempts at a quiz. This can help make the process of taking the quiz more of an educational activity rather than simply an assessment. If the quiz is randomized then the student will get a new version for each attempt. This is useful for practice purposes.
Note: You can change the allowed number of attempts for different groups or users in the Group or User override sections of the Quiz Administration settings block.
- Grading method
- When multiple attempts are allowed, there are different ways you can use the grades to calculate the student's final grade for the quiz.
- Highest grade - the final grade is the highest (best) grade in any attempt
- Average grade - the final grade is the average (simple mean) grade of all attempts
- First grade - the final grade is the grade earned on the first attempt (other attempts are ignored)
- Last grade - the final grade is the grade earned on the most recent attempt only
- Question order
- If 'Shuffled randomly' is selected, then the order of questions in the quiz will be randomly shuffled each time a student starts a new attempt at the quiz. The intention is to make it a little harder for students to copy from each other.
- New page
- For longer quizzes it makes sense to stretch the quiz over several pages by limiting the number of questions per page. When adding questions to the quiz, page breaks will automatically be inserted according to the setting you choose here. However, you will also be able to move page breaks around by hand later on the editing page.
- Note that changing this setting has no effect on questions you have already added to the quiz. The setting will only apply to questions you add subsequently. To change the page breaks in an existing quiz, you need to go to the quiz editing screen, tick the 'Show page breaks' checkbox, then use the repaginate control.
- How questions behave
- Deferred feedback - Students must enter an answer to each question and then submit the entire quiz, before anything is graded or they get any feedback.
- Adaptive mode and Adaptive mode (no penalties) - Allows students to have multiple attempts at the question before moving on to the next question. The question can adapt itself to the student's answer, for example by giving some hints before asking the student to try again.
- Manual grading - Used for essay questions (irrespective of what the quiz is set to) but you can now choose to have every question in the quiz manually graded, if you wish.
- Interactive mode - After submitting one answer, and reading the feedback, the student has to click a 'Try again' button before they can try a new response. Once the student has got the question right, they can no longer change their response. Once the student has got the question wrong too many times, they are just graded wrong (or partially correct) and get shown the feedback and can no longer change their answer. There can be different feedback after each try the student makes.
- Immediate feedback - Similar to interactive mode in that the student can submit their response immediately during the quiz attempt, and get it graded. However, they can only submit one response, they cannot change it later.
- Deferred feedback or Immediate feedback with Certainty-based marking (CBM) - With CBM, the student does not only answer the question, but they also indicate how sure they are they got the question right. The grading is adjusted by the choice of certainty, so that students have to reflect honestly on their own level of knowledge in order to get the best mark. (See the See Also section below)
When a student answers a question they also have to state how sure they are of the answer: not very (less than 67%); fairly (more than 67%) or very (more than 80%). Their grading is then ajusted according to how certain they are, which means that for example if they answered correctly but were only guessing, their mark is adjusted from 1 to 0.33. If they answered wrongly but were very sure, their mark is adjusted from 0 to -2.
- Each attempt builds on the last
- If multiple attempts are allowed and this setting is set to Yes, then each new attempt contains the results of the previous attempt. This allows the student on the new attempt to concentrate on just those questions that were answered incorrectly on the previous attempt. If this option is chosen then each attempt by a particular student uses the same questions in the same order, independent of randomization settings. To show a fresh quiz on every attempt, select No for this setting.
This section controls what information students will be shown when they review their past attempts at the quiz, and during the attempt in adaptive mode. It is a maxtrix with check boxes.
The various pieces of information that can be controlled are:
- The attempt
- Will show how the student responded to each question.
- Whether correct
- Displays whether the students response to each question is correct or incorrect.
- Reveals the marks awarded to the student and the grade for the quiz.
- Specific feedback
- Will show the feedback for the response to the answer as set when adding the question to the quiz. Each response to a question can have feedback for both correct and incorrect answers.
- General feedback
- Displays the general feedback for the whole question as set when adding the question to the quiz. You can use the general feedback to give students some background to what knowledge the question was testing.
- Right answer
- Reveals the correct answer to each question, whether the student answered correctly or not (See note below).
- Overall feedback
- Displays feedback for the entire quiz as set in the quiz settings (See note below).
For each of the above items, you can determine the timeframe when the students will see them:
- During the attempt
- is only available when ‘How questions behave’ has been set to ‘Immediate feedback’, ‘Immediate feedback with CBM’ and ‘Interactive with multiple tries’. If set to one of these options then a ‘Check’ button will appear below the answer and when clicked the student will submit that response and then receive immediate feedback.
- Immediately after the attempt
- means within 2 minutes of the student clicking "submit all and finish".
- Later, while the quiz is still open
- means after 2 minutes, but before the close date (if the quiz does not have a close date, this phase never ends).
- After the quiz is closed
- means what it says (you never get here for quizzes without a close date).
- Tip: Checking any of the boxes in the timeframe row, will reveal the test to the student. For example, to allow students to see their quiz immediately after taking it but not later, make sure none of the boxes in "Later" or "After" rows are checked. The student will be able to see their grade but not get into the quiz.
Note: Currently, the Answers display is a bit inconsistent between different question types. For example, the matching question type shows students which of their responses are correct, but does not tell them the right answer for the ones they got wrong. The short answer and multiple choices question types do tell the student what the correct answer is.
Users with the capability 'View hidden grades' moodle/grade:viewhidden (typically teachers and administrators) are not affected by these settings and will always by able to review all information about a student's attempt at any time.
In your list of review options, you must have 'The attempt' (the first option in the lists) selected before you can enable the options to show 'Whether correct', 'Specific feedback', 'General feedback', and 'Right answer'. If you choose not to let the students review the attempt, your only options are to display 'Marks' and 'Overall feedback'.
- Decimal places in grades
- This option determines how many digits will be shown after the decimal point when the grade is displayed. A setting of 0 for example means that the grades are displayed as integers. This setting is only used for the display of grades, not for the display or marking of answers.
Extra restrictions on attempts
- Require password
- This field is optional.
- If you specify a password in here then participants must enter the same password before they are allowed to make an attempt on the quiz. This is useful to give only a selected group of students access to the quiz.
- Require network address
- This field is optional.
- You can restrict access for a quiz to particular subnets on the LAN or Internet by specifying a comma-separated list of partial or full IP address numbers. This is especially useful for a proctored (invigilated) quiz, where you want to be sure that only people in a certain room are able to access the quiz. For example: 192.168. , 22.214.171.124/20, 126.96.36.199
- There are three types of numbers you can use (you can not use text based domain names like example.com):
- Full IP addresses, such as 192.168.10.1 which will match a single computer (or proxy).
- Partial addresses, such as 192.168 which will match anything starting with those numbers.
- CIDR notation, such as 188.8.131.52/20 which allows you to specify more detailed subnets.
- Spaces are ignored.
- Browser security
- The options in this section offer various ways to try to restrict how students may try to 'cheat' while attempting a quiz. However, this is not a simple issue, and what in one situation is considered 'cheating' may, in another situation, just be effective use of information technology. (For example, the ability to quickly find answers using a search engine.)
- Note also that this is not just at problem of technology with a technical solution. Cheating has been going on since long before computers, and while computers make certain actions, like copy and paste, easier, they also make it easier for teachers to detect cheating - for example using the quiz reports. The options provided here are not fool-proof, and while they do make some forms of cheating harder for students, they also make it more inconvenient for students to attempt the quizzes, and they are not fool-proof.
- There is a limit to what the quiz, which runs on a web server, can do to restrict what the student sitting at their computer can do while attempting the quiz. However, this option does what is possible:
- The quiz appears in a fullscreen popup window that covers all the other windows and has no navigation controls.
- The students are prevented, as far as is possible, from using facilities like copy and paste.
- This setting does not work well with the MyMobile theme for mobile devices included in the standard installation. In particular, quiz time limits do not function correctly (MDL-32047).
- Require the use of Safe Exam Browser
- This option will only appear if your administrator has enabled it in Settings > Site administration > Development > Experimental > Experimental settings.
- Safe Exam Browser is a customised web browser that must be downloaded and installed on the computer that the student uses to attempt the quiz. It restricts student use more effectively than a pop up window option. Features include full screen, without web navigation options, shortcut keys including copy and paste are disabled and of course surfing the web during an exam.
Overall feedback is shown to a student after they have completed an attempt at the quiz. The text that is shown can depend on the grade the student got.
For example, if you entered:
- Grade boundary: 100%
- Feedback: "Well done"
- Grade boundary: 40%
- Feedback: "Please study this week's work again"
- Grade boundary: 0%
Then students who score between 100% and 40% will see the "Well done" message, and those who score between 39.99% and 0% will see "Please study this week's work again". That is, the grade boundaries define ranges of grades, and each feedback string is displayed to scores within the appropriate range.
Grade boundaries can be specified either as a percentage, for example "31.41%", or as a number, for example "7". If your quiz is out of 10 marks, a grade boundary of 7 means 7/10 or better.
Note that the maximum and minimum grade boundaries (100% and 0%) are set automatically.
You can set as many or as few grade boundaries as you wish. The form allows you up to 5 ranges at first, but you can add more by clicking the "Add 3 fields to form" button underneath.
If you're getting confusing error messages about a boundary being out of sequence (when it's obviously *in* sequence), or "boundaries must be between 0% and 100%" (and they are) -- check that the Maximum Grade for this quiz is set to something greater than zero.
Common module settings
- Group mode
- Here you can choose whether the quiz should be organized by group. This only has an effect on the review screens of the teachers where it determines which groups of students they see.
- Visible to students
- Determines whether the quiz will be visible to students. If you are still in the process of setting up the quiz then it is highly advisable to leave this set to 'Hide'. Otherwise students might view or even attempt the quiz before it is tested and ready. This setting is common to all activities and can also be toggled by clicking on the eye icon behind the activity's name on the course page.
Restrict access settings
Group and User overrides
Dates, timing and number of allowed attempts may be changed for individual users or groups by following the links Group Overrides or User Overrides in the Quiz Administration settings block.
To change a quiz setting for a particular group, click the "add group override" button in Quiz Administration>Group overrides, make the changes you wish and save or enter another override.
To change a quiz setting for a particular user or users, click the "add user override"button in Quiz Administration>Group overrides, make the changes you wish and save or enter another override.
Site administration settings
The quiz module has additional settings which may be changed by an administrator in Settings > Site administration > Plugins > Activity modules > Quiz.
The add a new quiz page may be simplified by selecting a number of options to be hidden by default and only displayed when users click the "Advanced settings" button.
How questions behave can be configured in Settings>Site administration>Plugins>Question behaviours>Manage question behaviours