MoodleDocs - User contributions [en]

Development:Implementation of true negative marks in MC-type questions

2007-10-21T17:08:37Z

Snape: /* Purpose */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

Please make suggestions & comments here: http://moodle.org/mod/forum/discuss.php?d=82402#p366487

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attempts and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" or "simple", the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- code changes (branching, calculation modes)
- small changes to UI and documentation - Quiz Settings (addition of a quiz marking mode selector "simple/true"; "adaptive";
(confidence-based)); greying out of options incompatible with the chosen marking mode, e.g. penalty factors, to
avoid confusion

== Terms & Conditions ==

Limited funding is available to support the project. The exact status of the solutions (core, patch/hack, add-on) is immaterial as long as it is GPLd, designed for 1.9 and back-portable to 1.8+

I am very much looking forward to estimates of the workload and bids.

Pete

Development:Implementation of true negative marks in MC-type questions

2007-10-21T17:07:48Z

Snape: /* Design */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attempts and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" or "simple", the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- code changes (branching, calculation modes)
- small changes to UI and documentation - Quiz Settings (addition of a quiz marking mode selector "simple/true"; "adaptive";
(confidence-based)); greying out of options incompatible with the chosen marking mode, e.g. penalty factors, to
avoid confusion

== Terms & Conditions ==

Limited funding is available to support the project. The exact status of the solutions (core, patch/hack, add-on) is immaterial as long as it is GPLd, designed for 1.9 and back-portable to 1.8+

I am very much looking forward to estimates of the workload and bids.

Pete

Development:Implementation of true negative marks in MC-type questions

2007-10-21T17:03:52Z

Snape: /* Design */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attempts and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" or "simple", the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- code changes (branching, calculation modes)
- small changes to UI and documentation - Quiz Settings (addition of a quiz marking mode selector "simple/true"; "adaptive";
(confidence-based)); greying out of options incompatible with the chosen marking mode, e.g. penalty factors, to
avoid confusion

Development:Implementation of true negative marks in MC-type questions

2007-10-21T17:02:24Z

Snape: /* Design */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attempts and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" or "simple", the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- code changes (branching, calculation modes)
- small changes to UI and documentation - Quiz Settings (addition of a quiz marking mode selector "simple/true"; "adaptive";
(confidence-based)); greying out of options incompatible with the chosen marking mode, e.g. penalty factors, to avoid
avoid confusion

Development:Implementation of true negative marks in MC-type questions

2007-10-21T16:58:56Z

Snape: /* Design */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attempts and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" or "simple", the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- code changes (branching, calculation modes)
- small changes to UI and documentation - Quiz Settings (addition of a quiz mode selector "simple/true"; "adaptive"; [confidence-based]

Development:Implementation of true negative marks in MC-type questions

2007-10-21T16:53:09Z

Snape: /* Requirements */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attempts and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" (simple), the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- minimal changes to

Development:Implementation of true negative marks in MC-type questions

2007-10-21T16:52:10Z

Snape: /* Purpose of Development */

== Purpose ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores which encourages quiz takers to critically reflect on their abilities. However, CBM is not the object of the present proposal.

== Requirements ==
- full implementation of true negative marks in multiple choice questions,
- correct calculation of final quiz scores and scaling to percentages,
- appropriate representation of the negative marks in the various report formats,
- clean integration with multiple attemps and at least the option set "each attempt builds on the last" & "highest grade"

== Design ==

This section is work in progress. Developers are cordially invited to make suggestions and bids.

- separation and mutual exclusion of a "true" (simple), the adaptive and (potentially)a CBM mode,
- modification to the table structure to reflect this (input needed)
- minimal changes to

Development:Implementation of true negative marks in MC-type questions

2007-10-21T16:37:10Z

Snape: /* Purpose of Development */

== Purpose of Development ==

The purpose of this development project is to implement true negative marks for multiple choice-type questions in quiz. Up to now (1.8+), negative marks for incorrect answers are offered in the configuration options of individual multiple choice questions but are not reflected in the calculation of final quiz scores. Instructors wishing to use negative marking in their quizzes cannot do so or must rely on a potentially harmful hack to achieve the desired result.

'''Example:''' An instructor might wish to design a quiz consisting of 20 multiple choice questions with four options each (one correct, three incorrect, only one option selectable). An incorrect response on one question should, for example, lead to the subtraction of one full mark (-100%) from the final score so a student making five correct responses, two nonresponses and 13 incorrect responses should obtain a final raw score of 5x1 + 2x0 + 13x-1 = -13 Marks.

'''Note:''' True negative marks are conceptually different from penalties applied in '''adaptive mode'''. The latter allows a quiz taker to make multiple attempts on the same quiz, obtain feedback and change his/her answers. Penalties are the "price" quiz takers pay for obtaining additional information and changing their responses. '''Confidence Based Marking (CBM)''' is a didactically much more refined approach to obtaining valid quiz scores encouraging quiz takers to critically reflect their abilities. CBM is not the object of the present proposal.

Development:Implementation of true negative marks in MC-type questions

2007-10-21T16:26:03Z

Snape:

Development:Developer notes

2007-10-21T15:27:49Z

Snape: /* Quiz & question types */

<p class="note">'''Note:''' New developer documentation pages should be added to the ''Development namespace'' by typing <code>Development:</code> before the new page name i.e. <code><nowiki>[[Development:New page name]]</nowiki></code>.</p>

This area is for developers to work on various bits of code and documentation as necessary. Once material has matured it should be linked to from the main [[Development:Developer documentation|Developer documentation]] page.

==Core code==

*[[Other lang issues|Language issues]]
*[[Datalib Notes]]
*[[Application/session variables]]
*[[Filters schema]]
*[[Filterall support]]
*[[Groups documentation for module developers]]
*[[Development:Plan to improve ability to delegate administrator tasks to course category level|Plan to improve ability to delegate administrator tasks to course category level]]
*[[Development:Stealth mode and nested activities|Stealth mode and nested activities]]

==Modules and other recognised plugin types==

===Lesson===

*[[Adding_question_types_to_lesson|Adding question types to lesson module]]
*[[Development:New lesson navigation | New lesson navigation]]
*[[Development:Adding blocks to lesson | Adding blocks to lesson]]

===Quiz & question types===

*[[Calculated question development]]
*[[Development:quiz_navigation | Quiz navigation]]
*[[Numerical question units and intervals]]
*[[Development:Plans for adaptive mode|Plans for adaptive mode]]
*[[Development:Quiz UI redesign prototype | Quiz UI redesign prototype]]
*[[Development:Open_protocol_for_accessing_question_engines|Open protocol for accessing question engines]]
*[[Development:Implementation of true negative marks in MC-type questions]]

===Other activity modules===

*[[Forum development|Forum functional upgrade]]
*[[Wiki development|Wiki module development]]

===Other===

*[[Blogs and forums|Blogs, forums and the nature of discussion]]
*[[Conditional activities]]
*[[Improved Payment Plugin]]
*[[Development:Moodle-specific customisations to the HTML editor]]

==Other==

*[[MoodleDocs development]]
*[[Usability]]
*[[Document Management API]]
*[[wikindx|Possible integration of WIKINDX with Moodle]]
*[[Quiz and quesions community testing day]]

==Archive: past proposals==

===Things that got implemented===

*[[Roles]] - in Moodle 1.7
*[[Moodle forms library]] - in Moodle 1.8
**[[Martin form notes]]
*[[Development:Plan_to_Improve_Flexibility_of_Question_Category_Sharing_and_Permissions|Plans for enhancing the question bank]] - in Moodle 1.9
*[[Development:Email notification when a quiz is submitted|Email notification when a quiz is submitted]] - in Moodle 1.9
*[[Development:Plans for enhancing import/export in questiontype plugins]] - in Moodle 1.9

[[Category:Developer]]