Difference between revisions of "Quiz reports"

Jump to: navigation, search
m
m
 
(67 intermediate revisions by 16 users not shown)
Line 1: Line 1:
Quiz reports tab includes three sub tabs:  
+
{{Quiz}}
 +
In the course you are in, click on your quiz and go to ''Administration> Quiz administration > Results''
 +
This will open a submenu that offers reports on:
 +
* [[Quiz grades report|Grades report]]
 +
* [[Quiz responses report|Responses report]]
 +
* [[Quiz statistics report|Statistics report]]
 +
* [[Quiz manual grading report|Manual grading]]
  
===Overview===
+
You can also get to the quiz reports where you see a summary of the number of attempts that have been made like "Attempts: 123". That link also goes to the reports.
  
This contains the list of quiz attempts arranged in four columns:
 
  
# '''First name / Surname'''
+
==Grades report==
# '''Started on''' - that contains the information about the exact time the test was started
 
# '''Time taken''' - the amount of time it took a given student to do the test
 
# '''Grade/x''' - the number of points students scored; 'x' is the maximum number of points students could score
 
  
 +
[[Quiz grades report|Grade reports]] shows all the students' quiz attempts, with the overall grade, and the grade for each question. There are links to review all the details of a student's attempt, just as the student would see it.
  
The default view lists only the students who attempted the test. You can, however, change the display settings checking either of the two boxes (followed by clicking Go):
+
There is a setting form at the top of the page that can be used to control what is displayed.
  
 +
[[File:quizreportform1.png|thumb|500px|center|Form for selecting what to include in the report]]
  
# '''Show students with no attempts''' - the list will include all the course students no matter if they did the test or not
+
The teacher can select from:
# '''Show mark details''' - this extends the list with as many columns as there are questions in the test; each column is headed by 'n' (where 'n' stands for the question number)
+
* enrolled users who have attempted the quiz;
 +
* enrolled users who have not attempted the quiz;
 +
* enrolled users who have, or have not, attempted the quiz;
 +
* all users who have attempted the quiz
  
 +
[[File:Quiz_result_report_min_6_col_report.png|thumb|500px|center|Report showing information for 3 students]]
  
With the Select all / Deselect all options you can check / uncheck all the names in the list, and, with selected, delete.  
+
The results can be downloaded in a variety of formats.
  
 +
There is a setting form at the top of the page that can be used to control what is displayed.
  
 +
At the bottom of the page is a graph showing the distribution of scores.
  
===Regrade attempts===
+
There are check boxes to allow you to individually regrade or delete the selected attempts.
  
That option will recalculate the quiz grades if you have changed the points possible for the quiz or a question.  
+
By clicking on the score link, you are able to look at an individual student exam.
  
 +
==Responses report==
  
 +
This is very similar to the Grades report, except that it shows the responses the students gave, rather than the marks they earned.
  
===Item analysis===
+
It is also possible to show the question text or the right answer, to compare with the student's response. This is helpful when the question is randomised.
  
This table presents processed quiz data in a way suitable for anayzing and judging the performance of each question for the function of assessment. The statistical parameters used are calculated as explained by classical test theory (ref. 1)
+
For quizzes with interactive question behaviour, it is possible to display responses for the first, last or all tries a student makes:
  
 +
{|
 +
| [[File:ShowResponses.png|thumb|350px|Selecting number of tries to display]]
 +
| [[File: ResponsesAllTries.png|thumb|350px|Displaying all tries]]
 +
|}
  
* '''Facility Index (% Correct)'''
+
==Statistics report==
  
This is a measure of how easy or difficult is a question for quiz-takers. It is calculated as:
+
This report gives a statistical (psychometric) analysis of the quiz, and the questions within it. The front page of this report gives a summary of the whole test. There are then links to drill down into a detailed analysis of a particular question.
FI = (Xaverage) / Xmax
 
where Xaverage is the mean credit obtained by all users attempting the item,  
 
and Xmax is the maximum credit achievable for that item.
 
If questions can be distributed dicotomically into correct / uncorrect categories, this parameter coincides with the percentage of users that answer the question correctly.  
 
  
 +
The full report (overview, and detailed analysis of all questions) can be downloaded in a variety of formats, as can the quiz structure analysis table.
  
* '''Standard Deviation (SD)'''
+
Please refer to [[Quiz statistics report]] for more detailed information about the different types of statistics that can be gathered via this link.
  
This parameter measures the spread of answers in the response population. If all users answers the same, then SD=0. SD is calculated as the statistical stadard deviation for the sample of fractional scores (achieved/maximum) at each particular question.
+
==Manual grading report==
  
 +
The [[Quiz manual grading report]] makes it easy to manually grade questions in the quiz.
  
* '''Discrimination Index (DI)'''
+
The first screen of the report lists all the questions in the quiz that need to be, or have been, manually graded (for example essay questions) with the number of attempts. There is an option to also show the questions that have been automatically graded, which if useful if you ever need to edit the grades by hand.
  
This provides a rough indicator of the performance of each item to separate proficient vs. less-proficient users. This parameter is calculated by first dividing learners into thirds based on the overall score in the quiz. Then the average score at the analyzed item is calculated for the groups of top and bottom performers, and the average scored substracted. The matematical expression is:
+
==See also==
DI = (Xtop - Xbottom)/ N
 
where Xtop is the sum of the fractional credit (achieved/maximum) obtained at this item by the 1/3 of users having tha highest grades in the whole quiz (i.e. number of correct responses in this group),
 
and Xbottom) is the analog sum for users with the lower 1/3 grades for the whole quiz.
 
  
This parameter can take values between +1 and -1. If the index goes below 0.0 it means that more of the weaker learners got the item right than the stronger learners. Such items should be discarded as worthless. In fact, they reduce the accuracy of the overall score for the quiz.  
+
* Details of the [[:dev:Quiz_statistics_calculations|Quiz statistics calculations]]
 +
* Contributed [http://moodle.org/plugins/browse.php?list=category&id=13 Quiz report plugins] available
  
 +
[[Category:Report]]
  
* '''Discrimination Coefficient (DC)'''
+
[[de:Test-Berichte]]
 
+
[[es:Reportes de examen]]
This is another measure of the separating power of the item to distinguish proficient from weak learners.
 
The discrimination coefficient is a correlation coefficient between scores at the item and at the whole quiz. Here it is calculated as:  
 
DC = Sum(xy)/ (N * sx * sy)
 
where Sun(xy) is the sum of the products of deviations for item scores and overall quiz scores,
 
N is the number of responses given to this question
 
sx is the standard deviation of fractional scores for this question and,
 
sy is the standard deviation of scores at the quiz as a whole.
 
 
 
Again, this parameter can take values between +1 and -1. Positive values indicate items that do discriminate proficient learners, whereas negative indices mark items that are answered best by those with lowest grades. Items with negative DC are answered incorrectly by the seasoned learners and thus they are actually a penalty against the most proficient learners. Those items should be avoided.
 
The advantage of Discrimination Coefficient vs. Discrimitation Index is that the former uses information from the whole population of learners, not just the extreme upper and lower thirds. Thus, this parameter may be more sensitive to detect item performance.
 

Latest revision as of 10:54, 18 August 2016

In the course you are in, click on your quiz and go to Administration> Quiz administration > Results This will open a submenu that offers reports on:

You can also get to the quiz reports where you see a summary of the number of attempts that have been made like "Attempts: 123". That link also goes to the reports.


Grades report

Grade reports shows all the students' quiz attempts, with the overall grade, and the grade for each question. There are links to review all the details of a student's attempt, just as the student would see it.

There is a setting form at the top of the page that can be used to control what is displayed.

Form for selecting what to include in the report

The teacher can select from:

  • enrolled users who have attempted the quiz;
  • enrolled users who have not attempted the quiz;
  • enrolled users who have, or have not, attempted the quiz;
  • all users who have attempted the quiz
Report showing information for 3 students

The results can be downloaded in a variety of formats.

There is a setting form at the top of the page that can be used to control what is displayed.

At the bottom of the page is a graph showing the distribution of scores.

There are check boxes to allow you to individually regrade or delete the selected attempts.

By clicking on the score link, you are able to look at an individual student exam.

Responses report

This is very similar to the Grades report, except that it shows the responses the students gave, rather than the marks they earned.

It is also possible to show the question text or the right answer, to compare with the student's response. This is helpful when the question is randomised.

For quizzes with interactive question behaviour, it is possible to display responses for the first, last or all tries a student makes:

Selecting number of tries to display
Displaying all tries

Statistics report

This report gives a statistical (psychometric) analysis of the quiz, and the questions within it. The front page of this report gives a summary of the whole test. There are then links to drill down into a detailed analysis of a particular question.

The full report (overview, and detailed analysis of all questions) can be downloaded in a variety of formats, as can the quiz structure analysis table.

Please refer to Quiz statistics report for more detailed information about the different types of statistics that can be gathered via this link.

Manual grading report

The Quiz manual grading report makes it easy to manually grade questions in the quiz.

The first screen of the report lists all the questions in the quiz that need to be, or have been, manually graded (for example essay questions) with the number of attempts. There is an option to also show the questions that have been automatically graded, which if useful if you ever need to edit the grades by hand.

See also