Quiz reports

The standard quiz reports are located under the Results tab. Some sites may have added contributed code that presents more reports. Reports can be downloaded in several formats.

Overview

The overview sub tab has some options to display lists of students who have taken the quiz. The list is displayed in this subtab.

View of list

The list of quiz attempts arranged in four columns:

1. First name / Surname
2. Started on - that contains the information about the exact time the test was started
3. Time taken - the amount of time it took a given student to do the test
4. Grade/x - the number of points students scored; 'x' is the maximum number of points students could score

Download lists

There are three buttons to download the list of students with quiz results. The teacher may select specific student attempts or select all.

Overview list settings

The default view lists only the students who attempted the test. You can, however, change the display settings checking either of the two boxes (followed by clicking Go):

Overview report preferences in 1.9

1. Which users to include - there are four options available:
   • Show Students with attempts only - list only the students on the course who have done test
   • Show Students with no attempts only - list students who have not yet attempted the quiz
   • Show all Students - list all the students on the course no matter if they did the test or not
   • Show all attempts - like 'Show Students with attempts only', but this also includes attempts by users who used to be students on the course, but have since been unenrolled.
2. Show mark details - this extends the list with as many columns as there are questions in the test; each column is headed by 'n' (where 'n' stands for the question number)

With the Select all / Deselect all options you can check / uncheck all the names in the list, and, with selected, delete.

To sort the results by two columns, first click on the column heading you want to be the second key, and then click on the column heading you want to be the primary key.

Moodle1.9

In Moodle 1.9 onwards, you can set the number of rows displayed on each page of the overview report.

Regrade

This will report on all answers that have been changed through regrading. Selecting the regrade tab automatically starts the regrade process. Please note that this tab triggers the process and indicates through fonts those student answers which have been changed through the regrading process.

Manual grading

The grade of any question in a quiz can be manually overridden, and a comment added. A teacher can do this from the review page. There are also some question types that Moodle does not grade automatically (at the moment only the Essay question). This report helps you grade questions of these types by listing just the questions that still need to be graded.

Item analysis

This report presents data about each quiz's question in a table. The report gives measures that aid in analyzing and judging the performance of each question. This is done for all students or a group, who took the quiz at the time of the report.

In short, this report will tell the teacher what percentage of the students selected each answer, how the highest scoring quiz takers answered the question compared to lowest scoring quiz takers and other statistical assessment information. It is possible to sort the table by each of its data columns.

From this report it is also possible to find a link that will allow the teacher to edit any question in the quiz.

The statistical parameters used are defined in the help link next "Item Analysis Table" header, or in the help file \moodle\lang\en_utf8\help\quiz\itemanalysis.html

Analysis columns

• Q# - shows the question id number, icon type and a preview popup window link that has an edit link embedded in it.
• Question Text - the question
• Answer text - each answer
• Partial credit - how much credit was given by teacher for each answer
• R counts - how many selected the answer and the total attempts
• % R - the percentage that selected that answer
• Facility Index (% Correct) - the overall difficulty of the question
• Standard Deviation (SD) - measure of variation of selected answers
• DI & DC columns - Question effectiveness measures

Descriptions defined

• Facility Index (% Correct) - The overall difficulty of the questions.

FI = (Xaverage) / Xmax 

where Xaverage is the mean credit obtained by all users attempting the item, and Xmax is the maximum credit achievable for that item. If questions can be distributed dicotomically into correct / incorrect categories, this parameter coincides with the percentage of users that answer the question correctly.

• Standard Deviation (SD) - The range of responses

This parameter measures the spread of answers in the response population. If all users answers the same, then SD=0. SD is calculated as the statistical standard deviation for the sample of fractional scores (achieved/maximum) at each particular question.

• DI & DC columns - Effectiveness measures

Both DC and DI can be used as powerful methods of evaluating the effectiveness of the quiz when assessing differentiation of learners. The advantage of using Discrimination Coefficient as opposed to Discrimination Index is that the former uses information from the whole population of learners, not just the extreme upper and lower thirds. Thus, this parameter may be more sensitive to detect item performance.

• • Discrimination Index (DI)

This provides a rough indicator of the performance of each item to separate high scores vs. scorers. This parameter is calculated by first dividing learners into thirds based on the overall score in the quiz. Then the average score at the analysed item is calculated for the groups of top and bottom performers, and the average scored subtracted. The mathematical expression is:

DI = (Xtop - Xbottom)/ N 

where Xtop is the sum of the fractional credit (achieved/maximum) obtained at this item by the 1/3 of users having the highest grades in the whole quiz (i.e. number of correct responses in this group), and Xbottom is the analog sum for users with the lower 1/3 grades for the whole quiz.

This parameter can take values between +1 and -1. If the index goes below 0.0 it means that more of the weaker learners got the item right than the stronger learners. Such items should be discarded as worthless. In fact, they reduce the accuracy of the overall score for the quiz.

• • Discrimination Coefficient (DC) -

This is another measure of the separating power of the item to distinguish proficient from weak learners. The discrimination coefficient is a correlation coefficient between scores at the item and at the whole quiz. Here it is calculated as:

DC = Sum(xy)/ (N * sx * sy) 

where Sum(xy) is the sum of the products of deviations for item scores and overall quiz scores, N is the number of responses given to this question, sx is the standard deviation of fractional scores for this question and, sy is the standard deviation of scores at the quiz as a whole.

Again, this parameter can take values between +1 and -1. Positive values indicate items that do discriminate proficient learners, whereas negative indices mark items that are answered best by those with lowest grades. Items with negative DC are answered incorrectly by the seasoned learners and thus they are actually a penalty against the most proficient learners. Those items should be avoided.

Delete selected attempts

This is one of the buttons below the grades. This allows you to delete an attempt by a student who has mistakenly used up an attempt when the quiz is set to allow only 1 attempt or so.

A related discussion is here: http://moodle.org/mod/forum/discuss.php?d=62972

See also

• Additional contributed code report plugins your Moodle administrator has installed.

• Detailed responses report plugin
• Item analysis theoretical background