Note:

If you want to create a new page for developers, you should create it on the Moodle Developer Resource site.

Quiz UI redesign scenarios - Entering questions into an exam: Difference between revisions

From MoodleDocs
No edit summary
(→‎Paul Pedagogue: first draft)
 
(26 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Back to [[Quiz_UI_redesign]]
Back to [[Quiz_UI_redesign_scenarios_-_Scenarios_index|Scenarios index]]


==Organizing questions and entering them into an exam==
[http://moodle.org/mod/forum/discuss.php?d=99351 Discussion thread, where you can comment on the scenarios]


Unless exams are very simple, teachers often have a natural set of categories to put questions in, from course curriculum or from the actual material of the course. This can be regarded as metadata of actual questions.  
[http://www.youtube.com/watch?v=hyfLOSadJW4 Introductory video]


A teacher may or may not want to enter question metadata (such as categories) into the application, depending on:
==Organizing questions and adding them into an exam==
 
* their confidence (experience) with Moodle or computers in general
* the amount of time available: in a situation where a teacher only has the questions on paper or in some other application and they need to get the exam to the student in 15 minutes
* what they perceive feasible in the application's user interface.
 
It is also possible that the teacher imports the data from another application, and in this case the metadata may come with the questions; the questions will be in categories in the application after importing.


Unless exams are very simple, teachers often have a natural set of categories to organize questions in, from course curriculum or from the actual material of the course. In tech-speak, this can be regarded as metadata of the actual questions.
----
=== Mack Marketing ===
* [[Quiz_UI_redesign_scenarios_-_Background#Mack_Marketing|Mack's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Mack_Marketing|Mack: Preparing questions]]
* '''Mack: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]
----
* carefully crafted, can't reuse the questions (but may be able to use for reference)


Mack primarily creates just exams. For him, exams are one-time wholes and each question is a part of the whole, tightly bound to that one exam.


=== Fred ===
However, Mack can use his questions as templates, or at least sources for inspiration when creating new exams. Thus he keeps a copy all his exams, sorted by date. If he had time, he sometimes wonders, he would also create an thematical index of all the questions, so that whenever he needed a question from a certain theme, he could just look at the index and see which exams contained a question he needs.
* carefully crafted, can't reuse the questions (but may be able to use for reference)


Sometimes Mack finds himself in a real hurry when a student wants a renewal (another try or another, separate date for taking the exam for the first time) for an exam, since  some, even the more rarely taken exams he has don't have question banks. In this case, he might be willing to compromise how unique wholes his exams are, so that he can have a question bank full of spare questions, ready for use for surprising renewal exams.
----


=== Jack ===
=== Ida Informatics ===
Depending on how much of a hurry he is in, Jack creates either just exams or first a question bank from which to randomize questions. Even if Jack creates just single questions at first, he benefits from creating the questions in proper thematical categories, since his eventual aim with his question banks is to use those categories in future exams either for single or random questions.
* [[Quiz_UI_redesign_scenarios_-_Background#Ida_Informatics|Ida's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Ida_Informatics|Ida: Preparing questions]]
* '''Ida: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]
----
Based on the themes that come from course curriculum, Ida has organized her questions in categories. Under most themes she has further divided the questions into different difficulty levels and for most a given exam, she usually has about 60% of easier and 40% of more difficult questions. Since she has a lot (i.e. dozens ... thousands) of questions for each course, she would find it useful to categorize questions based on different criterias – that is, to be capable of tagging questions, as well as searching for particular questions based on their content, tags or other properties.


While grading exams, Jack often makes notes about some of the answers students have given to specific questions. When creating new exams, he often uses this information to make slight modifications to those questions or to help him to pick questions for a given exam.
To distribute questions according to a formula, Ida would like to be able to create a test of 100 questions dispersed something like the following: 10% of questions from category 1, 15% of questions from category 2, 25% of questions from category 3, etc. The questions would randomly appear on the exam. BUT on the other hand, there are times when Ida wants to select the exact questions for the exam and even place them in exact spots on the exam. OR select the exact questions but have Moodle randomly distribute them on the exam. (Do you think she'll ever be satisfied???)


=== Mary ===
=== Harvey Historian ===
* [[Quiz_UI_redesign_scenarios_-_Background#Harvey_Historian|Harvey's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Harvey_Historian|Harvey: Preparing questions]]
* '''Harvey: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]
----
Each time the exam is taken, Harvey picks one or two questions for each exam book from his comprehensive selection of questions.
----
===Grace Grader===
* [[Quiz_UI_redesign_scenarios_-_Background#Grace_Grader|Grace's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Grace_Grader|Grace: Preparing questions]]
* '''Grace: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]
----
----
===Susan Support===
* [[Quiz_UI_redesign_scenarios_-_Background#Susan_Support|Susan's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Susan_Support|Susan: Preparing questions]]
* '''Susan: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]
--------


=== Fred ===
* [[Quiz_UI_redesign_scenarios_-_Background#Fred|Fred's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Fred|Fred: Preparing questions]]
* '''Fred: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]
----
----
===Paul Pedagogue===
* [[Quiz_UI_redesign_scenarios_-_Background#Paul_Pedagogue|Paul's persona]]
* [[Quiz_UI_redesign_scenarios_-_Preparing_questions#Paul_Pedagogue|Paul: Preparing questions]]
* '''Paul: Organizing questions and adding them into an exam'''
* [http://moodle.org/mod/forum/discuss.php?d=99351 Forum discussion to comment on scenarios]


* designed to test the student's knowledge base on a certain subject
====National Exam====
As I've pointed out on other pages, Paul uses National Central Exams on paper for grading. He doesn't change them unless there is some unusual imbalance in material coverage that would be unfair to his students.


Based on the themes that come from course curriculum, Mary has organized her questions in categories. Under most themes she has subcategories for different difficulty levels and for most a given exam, she usually has about 60% of easier and 40% of mode difficult questions. Since she has a lot (i.e. dozens ... thousands) of questions for each course, she would find it useful to categorize questions based on different criterias – that is, to be capable of tagging questions, as well as searching for particular questions based on their content, tags or other properties.
====Organizing Interactive ("quiz") Questions====
He and several other colleagues like to share resources like quiz questions. They try to organize them in categories that will help. But being able to tag them would be much more flexible. There are many questions that can be useful in many different subjects and levels. A good search function and a meta marking system would also be valuable.


It would be important to preserve question metadata even when it is exported and imported. Even though her questions are selected randomly from categories exams, she sometimes wants to use questions that have not been seen by students before, to gather data about how well those questions work. She gets feedback about the exam from students, but since she does not use any question types where students could freely type their answers, she has not gotten feedback about exam questions with the exams.
====Random questions====
Since Paul's big interest is not absolute grading he is not especially interested in random questions (which are usually used to making cheating more difficult). He might have some training quizzes toward the end of sections/courses that could randomly choose some questions out of a larger bank.
----

Latest revision as of 09:48, 12 March 2009

Back to Scenarios index

Discussion thread, where you can comment on the scenarios

Introductory video

Organizing questions and adding them into an exam

Unless exams are very simple, teachers often have a natural set of categories to organize questions in, from course curriculum or from the actual material of the course. In tech-speak, this can be regarded as metadata of the actual questions.

Mack Marketing

  • carefully crafted, can't reuse the questions (but may be able to use for reference)

Mack primarily creates just exams. For him, exams are one-time wholes and each question is a part of the whole, tightly bound to that one exam.

However, Mack can use his questions as templates, or at least sources for inspiration when creating new exams. Thus he keeps a copy all his exams, sorted by date. If he had time, he sometimes wonders, he would also create an thematical index of all the questions, so that whenever he needed a question from a certain theme, he could just look at the index and see which exams contained a question he needs.

Sometimes Mack finds himself in a real hurry when a student wants a renewal (another try or another, separate date for taking the exam for the first time) for an exam, since some, even the more rarely taken exams he has don't have question banks. In this case, he might be willing to compromise how unique wholes his exams are, so that he can have a question bank full of spare questions, ready for use for surprising renewal exams.

Ida Informatics

Based on the themes that come from course curriculum, Ida has organized her questions in categories. Under most themes she has further divided the questions into different difficulty levels and for most a given exam, she usually has about 60% of easier and 40% of more difficult questions. Since she has a lot (i.e. dozens ... thousands) of questions for each course, she would find it useful to categorize questions based on different criterias – that is, to be capable of tagging questions, as well as searching for particular questions based on their content, tags or other properties.

To distribute questions according to a formula, Ida would like to be able to create a test of 100 questions dispersed something like the following: 10% of questions from category 1, 15% of questions from category 2, 25% of questions from category 3, etc. The questions would randomly appear on the exam. BUT on the other hand, there are times when Ida wants to select the exact questions for the exam and even place them in exact spots on the exam. OR select the exact questions but have Moodle randomly distribute them on the exam. (Do you think she'll ever be satisfied???)

Harvey Historian

Each time the exam is taken, Harvey picks one or two questions for each exam book from his comprehensive selection of questions.

Grace Grader

Susan Support

Fred

Paul Pedagogue

National Exam

As I've pointed out on other pages, Paul uses National Central Exams on paper for grading. He doesn't change them unless there is some unusual imbalance in material coverage that would be unfair to his students.

Organizing Interactive ("quiz") Questions

He and several other colleagues like to share resources like quiz questions. They try to organize them in categories that will help. But being able to tag them would be much more flexible. There are many questions that can be useful in many different subjects and levels. A good search function and a meta marking system would also be valuable.

Random questions

Since Paul's big interest is not absolute grading he is not especially interested in random questions (which are usually used to making cheating more difficult). He might have some training quizzes toward the end of sections/courses that could randomly choose some questions out of a larger bank.

Retrieved from "https://docs.moodle.org/dev/index.php?title=Quiz_UI_redesign_scenarios_-_Entering_questions_into_an_exam&oldid=9494"
Powered by MediaWiki