Difference between revisions of "Quiz reports"

Jump to: navigation, search
(Rewrite intro for 2.0)
m
 
(25 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
{{Quiz}}
 
{{Quiz}}
<p class="note">'''Please refer to [[TOC_with_notes#Quiz|these notes]] before editing this page.'''</p>
+
In the course you are in, click on your quiz and go to ''Administration> Quiz administration > Results''
The standard reports can be difficult to find for an old user of Moodle in a teacher's role.  Depending upon how the site is setup, you will find all of the reports on a navigation menu.  By clicking on the quiz name and then "Attempts" you will go to the default Results report called Grades.
+
This will open a submenu that offers reports on:
 +
* [[Quiz grades report|Grades report]]
 +
* [[Quiz responses report|Responses report]]
 +
* [[Quiz statistics report|Statistics report]]
 +
* [[Quiz manual grading report|Manual grading]]
  
 +
You can also get to the quiz reports where you see a summary of the number of attempts that have been made like "Attempts: 123". That link also goes to the reports.
  
  
 +
==Grades report==
  
 +
[[Quiz grades report|Grade reports]] shows all the students' quiz attempts, with the overall grade, and the grade for each question. There are links to review all the details of a student's attempt, just as the student would see it.
  
==Quiz Results > Grades page==
+
There is a setting form at the top of the page that can be used to control what is displayed.
When the teacher clicks on the link to the quiz, they will see an "Attempts" link just above the "Preview quiz now" button.  This will bring them to the Results > Grades page.
 
  
===Overview===
+
[[File:quizreportform1.png|thumb|500px|center|Form for selecting what to include in the report]]
On this page the teacher may:
 
*Set preferences for page
 
**Set show/download filters for attempts
 
**Set show/download filters for grading
 
*Set preferences for the report
 
**Page size
 
**Include question marks
 
There are also buttons for:
 
*Regrading the quiz
 
**Regrade all
 
**Dry run a full grade
 
**Regrade attempts marked as needing regrading
 
**Regrade selected attempts
 
**Delete selected attempts
 
*Downloading table data in several formats
 
*A chart showing # of students grades in a range
 
  
Depending upon the filter, the teacher may review each students quiz and see how they answered a specific question from this page.
+
The teacher can select from:
 +
* enrolled users who have attempted the quiz;
 +
* enrolled users who have not attempted the quiz;
 +
* enrolled users who have, or have not, attempted the quiz;
 +
* all users who have attempted the quiz
  
 +
[[File:Quiz_result_report_min_6_col_report.png|thumb|500px|center|Report showing information for 3 students]]
  
 +
The results can be downloaded in a variety of formats.
  
===Quiz result report===
+
There is a setting form at the top of the page that can be used to control what is displayed.
  
#First name / Surname -
+
At the bottom of the page is a graph showing the distribution of scores.
# Started on - the date and time quiz was started
 
# Completed - the date and time completed
 
# Time taken - the amount of time it took the student to start and submit the quiz
 
# Grade/x - the number of points students scored; 'x' is the maximum number of points
 
# Feedback - any feed back remarks
 
  
[[File:Quiz_result_report_min_6_col_report.png|thumb|center|Report showing only basic information]]
+
There are check boxes to allow you to individually regrade or delete the selected attempts.
  
===Preference for Results > Grades page===
+
By clicking on the score link, you are able to look at an individual student exam.
  
Show / download options :
+
==Responses report==
* Participants who have attempted the quiz
 
* Participants who have not attempted the quiz
 
* all attempts - list all the students on the course no matter if they did the test or not
 
* all Participants who have or have not attempted the quiz
 
  
Only show / download attempts check boxes for:
+
This is very similar to the Grades report, except that it shows the responses the students gave, rather than the marks they earned.
* that are graded for each user (Highest grade)
 
* that have been regraded / are marked as needing regrading
 
  
Report preferences
+
It is also possible to show the question text or the right answer, to compare with the student's response. This is helpful when the question is randomised.
*Page size
 
* Show/download marks for each question
 
  
===Show results report===
+
For quizzes with interactive question behaviour, it is possible to display responses for the first, last or all tries a student makes:
Once you set the above preferences, click on "Show report" button.  This produces a list of "Participants".
 
  
With the Select all / Deselect all options you can check / un-check all the names in the list. This will allow you to regrade or deleted the selected attempts.
+
{|
 +
| [[File:ShowResponses.png|thumb|350px|Selecting number of tries to display]]
 +
| [[File: ResponsesAllTries.png|thumb|350px|Displaying all tries]]
 +
|}
  
:''Tip:'' To sort the results by two columns, first click on the column heading you want to be the '''''second''''' key, and then click on the column heading you want to be the '''''primary''''' key.
+
==Statistics report==
  
== Quiz Results > Responses page==
+
This report gives a statistical (psychometric) analysis of the quiz, and the questions within it. The front page of this report gives a summary of the whole test. There are then links to drill down into a detailed analysis of a particular question.
Same filters for show /download
 
*Only show /down load that are graded for each user
 
Include check boxes for
 
*Summary of the question
 
*Summary of the response given
 
*Summary of the right answer
 
  
== Quiz Results > Statistics page==
+
The full report (overview, and detailed analysis of all questions) can be downloaded in a variety of formats, as can the quiz structure analysis table.
This page produces a table of statistics and an analysis of each question and a graph of the Facility and discriminative efficiency for each question.
 
  
Preference are to calculate statistics from first attempt or all attempts
+
Please refer to [[Quiz statistics report]] for more detailed information about the different types of statistics that can be gathered via this link.
  
There is a lot of information on this page concerning the over all quiz.
+
==Manual grading report==
  
 +
The [[Quiz manual grading report]] makes it easy to manually grade questions in the quiz.
  
== Quiz Results > Manual grading page==
+
The first screen of the report lists all the questions in the quiz that need to be, or have been, manually graded (for example essay questions) with the number of attempts. There is an option to also show the questions that have been automatically graded, which if useful if you ever need to edit the grades by hand.
This page shows the questions in the quiz that require a teacher to manually grade. For example, an essay question.
 
  
==Regrade==
+
==See also==
(add this to the end of the Results > Grades section, 2.o does not have a regrade tab )
 
 
 
This will report on all answers that have been changed through regrading.  Selecting the regrade tab automatically starts the regrade process. Please note that this tab triggers the process and indicates through fonts those student answers which have been changed through the regrading process.
 
 
 
==Manual grading==
 
 
 
The grade of any question in a quiz can be manually overridden, and a comment added. A teacher can do this from the review page. There are also some question types that Moodle does not grade automatically (at the moment only the Essay question). This report helps you grade questions of these types by listing just the questions that still need to be graded.
 
 
 
==Item analysis==
 
 
 
This report presents data about each quiz's question in a table. The report gives measures that aid in analyzing and judging the performance of each question. This is done for all students or a group, who took the quiz at the time of the report.
 
 
 
In short, this report will tell the teacher what percentage of the students selected each answer, how the highest scoring quiz takers answered the question compared to lowest scoring quiz takers and other statistical assessment information. It is possible to sort the table by each of its data columns.
 
 
 
From this report it is also possible to find a link that will allow the teacher to edit any question in the quiz.
 
 
 
The statistical parameters used are defined in the help link next "Item Analysis Table" header, or in the help file \moodle\lang\en_utf8\help\quiz\itemanalysis.html
 
 
 
[[Image:Quiz Results ItemAnalysis example.JPG]]
 
===Analysis columns===
 
* '''Q#''' - shows the question id number, icon type and a preview popup window link that has an edit link embedded in it.
 
* '''Question Text''' - the question
 
* '''Answer text''' - each answer
 
* '''Partial credit''' - how much credit was given by teacher for each answer
 
* '''R counts''' - how many selected the answer and the total attempts
 
* '''% R''' - the percentage that selected that answer
 
* '''Facility Index (% Correct)''' - the overall difficulty of the question 
 
* '''Standard Deviation (SD)''' - measure of variation of selected answers
 
* '''DI & DC columns''' - Question effectiveness measures
 
 
 
===Descriptions defined===
 
* '''Facility Index (% Correct)''' - The overall difficulty of the questions.
 
FI = (Xaverage) / Xmax
 
where Xaverage is the mean credit obtained by all users attempting the item, and Xmax is the maximum credit achievable for that item. If questions can be distributed dicotomically into correct / incorrect categories, this parameter coincides with the percentage of users that answer the question correctly.
 
 
 
* '''Standard Deviation (SD)''' - The range of responses
 
 
 
This parameter measures the spread of answers in the response population. If all users answers the same, then SD=0. SD is calculated as the statistical standard deviation for the sample of fractional scores (achieved/maximum) at each particular question.
 
 
 
* '''DI & DC columns''' - Effectiveness measures
 
Both DC and DI can be used as powerful methods of evaluating the effectiveness of the quiz when assessing differentiation of learners. The advantage of using Discrimination Coefficient as opposed to Discrimination Index is that the former uses information from the whole population of learners, not just the extreme upper and lower thirds. Thus, this parameter may be more sensitive to detect item performance.
 
 
 
** '''Discrimination Index (DI)'''
 
This provides a rough indicator of the performance of each item to separate high scores vs. scorers. This parameter is calculated by first dividing learners into thirds based on the overall score in the quiz. Then the average score at the analysed item is calculated for the groups of top and bottom performers, and the average scored subtracted. The mathematical expression is:
 
DI = (Xtop - Xbottom)/ N
 
where Xtop is the sum of the fractional credit (achieved/maximum) obtained at this item by the 1/3 of users having the highest grades in the whole quiz (i.e. number of correct responses in this group), and Xbottom is the analog sum for users with the lower 1/3 grades for the whole quiz.
 
  
This parameter can take values between +1 and -1. If the index goes below 0.0 it means that more of the weaker learners got the item right than the stronger learners. Such items should be discarded as worthless. In fact, they reduce the accuracy of the overall score for the quiz.
+
* Details of the [[:dev:Quiz_statistics_calculations|Quiz statistics calculations]]
 
+
* Contributed [http://moodle.org/plugins/browse.php?list=category&id=13 Quiz report plugins] available
** '''Discrimination Coefficient (DC)''' -
 
 
 
This is another measure of the separating power of the item to distinguish proficient from weak learners.
 
The discrimination coefficient is a correlation coefficient between scores at the item and at the whole quiz. Here it is calculated as:
 
DC = Sum(xy)/ (N * sx * sy)
 
where Sum(xy) is the sum of the products of deviations for item scores and overall quiz scores,
 
N is the number of responses given to this question,
 
sx is the standard deviation of fractional scores for this question and,
 
sy is the standard deviation of scores at the quiz as a whole.
 
 
 
Again, this parameter can take values between +1 and -1. Positive values indicate items that do discriminate proficient learners, whereas negative indices mark items that are answered best by those with lowest grades. Items with negative DC are answered incorrectly by the seasoned learners and thus they are actually a penalty against the most proficient learners. Those items should be avoided.
 
 
 
==Delete selected attempts==
 
This is one of the buttons below the grades.  This allows you to delete an attempt by a student who has mistakenly used up an attempt when the quiz is set to allow only 1 attempt or so.
 
 
 
A related discussion is here:
 
http://moodle.org/mod/forum/discuss.php?d=62972
 
 
 
==See also==
 
*[http://moodle.org/mod/data/view.php?d=13&perpage=10&search=Quiz+report&sort=46&order=ASC Additional contributed code report plugins] your Moodle administrator has installed.
 
  
*[[Detailed responses report plugin]]
+
[[Category:Report]]
*[[Item analysis theoretical background]]
 
  
 
[[de:Test-Berichte]]
 
[[de:Test-Berichte]]
 +
[[es:Reportes de examen]]

Latest revision as of 10:54, 18 August 2016

In the course you are in, click on your quiz and go to Administration> Quiz administration > Results This will open a submenu that offers reports on:

You can also get to the quiz reports where you see a summary of the number of attempts that have been made like "Attempts: 123". That link also goes to the reports.


Grades report

Grade reports shows all the students' quiz attempts, with the overall grade, and the grade for each question. There are links to review all the details of a student's attempt, just as the student would see it.

There is a setting form at the top of the page that can be used to control what is displayed.

Form for selecting what to include in the report

The teacher can select from:

  • enrolled users who have attempted the quiz;
  • enrolled users who have not attempted the quiz;
  • enrolled users who have, or have not, attempted the quiz;
  • all users who have attempted the quiz
Report showing information for 3 students

The results can be downloaded in a variety of formats.

There is a setting form at the top of the page that can be used to control what is displayed.

At the bottom of the page is a graph showing the distribution of scores.

There are check boxes to allow you to individually regrade or delete the selected attempts.

By clicking on the score link, you are able to look at an individual student exam.

Responses report

This is very similar to the Grades report, except that it shows the responses the students gave, rather than the marks they earned.

It is also possible to show the question text or the right answer, to compare with the student's response. This is helpful when the question is randomised.

For quizzes with interactive question behaviour, it is possible to display responses for the first, last or all tries a student makes:

Selecting number of tries to display
Displaying all tries

Statistics report

This report gives a statistical (psychometric) analysis of the quiz, and the questions within it. The front page of this report gives a summary of the whole test. There are then links to drill down into a detailed analysis of a particular question.

The full report (overview, and detailed analysis of all questions) can be downloaded in a variety of formats, as can the quiz structure analysis table.

Please refer to Quiz statistics report for more detailed information about the different types of statistics that can be gathered via this link.

Manual grading report

The Quiz manual grading report makes it easy to manually grade questions in the quiz.

The first screen of the report lists all the questions in the quiz that need to be, or have been, manually graded (for example essay questions) with the number of attempts. There is an option to also show the questions that have been automatically graded, which if useful if you ever need to edit the grades by hand.

See also