Quiz UI redesign/usability testing of August 2008/Summary of solutions

Jump to: navigation, search

Return to: Quiz UI redesign | Quiz Usability portal

This page aggregates the solutions of the issues found in testing, for easier browsing. To find the justifications for the changes, see the related issues by using the link under each heading – this document does not make much sense by itself. This page should be kept in sync with the solutions in the issues page.


Confusion about where to add random questions/questions in random questions

Related issues

  • Solution: Add “Random question” to the end of Add question menu, under a separator? Having it double (both as a separate button and in the dropdown) might confuse users though?
  • Solution (not to the issue itself though): Indicate on the question editing page if the question is being added straight to quiz or just to category? A checkbox for this was included in the earlier OOo prototype but that confused users, too so the design of this must be carefully considered. Indicating this in the heading might work: “Adding question to”/”Editing question in” “Quiz quizname”/”Question Bank category categoryname”
  • Solution: Since the Quiz did not already contain any random questions, I'm interpreting this as confusion on conceptual level, i.e. the user was guessing since in the face of the task that was the first thing s/he came to think of.
  • Solution: Somehow imply *in the UI* that random questions are containers for questions, (...representing a single question in the actual quiz).

Question bank / question adding controls visibility

Related issues

  • Solution: Make the toolbox react to changes more noticeably. Show a "loading" animation in the question bank window if it changes. This might be done perhaps even with an absolutely positioned div with a partially transparent animated GIF. The problem is to only show the loading animation when the category is changed, not on every page load.
  • Solution: Make the question bank and its title more prominent at least when the window is open. Emphasize its borders and make the title seem more like an actual window title: invert background/foreground colours. This will need to be ensured across moodle themes.
  • Solution: clearly separate from the two other buttons the title, dropdown and possible button of creating single questions by grouping them together?

Conceptual confusion: categories/random questions

Related issues

  • Solution: Make the random question dialog select the top-level category by default, not the currently selected category of the question bank window.
  • Add clearer path: how to add questions to the category of a random question. One solution would be to add controls directly in the random question, but that may be misleading since that would disable users from undestanding categories. Another option is to create a separate wizard for creating random questions: since it would be a separate process, it is true novices would learn the actual concepts even less this way, but then again, they would also not be mislead to believe the concepts work some other way than they actually do.
  • Solution: Make the random question window show the parent category: make the category hierarchy clearer
  • Solution: discuss which default categories are really needed, what are their purposes, and how to communicate those purposes to users.
  • Solution: Make the distinction clearer that the page operations are for adding things on the page, not inside random questions ? It may be though that this error was due to conceptual confusion and as such, this solution would not help.
  • Solution: Make the YUI dialogs movable. I remember there was an option for this.

Reorder/paging issues

Related issues

  • Solution: change colouring, make a select dropdown?
  • Solution: Make pages look more like physical pages? But they are not.
  • Issue: The user commented that it would be easier if s/he could move the questions like other elements are moved in moodle course front page
  • Solution: Do it, this is important for Moodle's internal consistency
  • Solution: A page in Quiz is one of the basic concepts, so add a short explanation there about pages. In addition, add a more thorough explanation next to the paging button, and perhaps in the reordering tab.
  • Issue: After the user saw the "add new pages after selected questions" button s/he selected all the questions, thinking that a page will be added only after the last of them.
  • Solution: change the wording. this issue may only be there in finnish.
  • Solution: Make reordering a subtab of edit? DONE
  • Solution: Either add a notification that you have to select some questions, or add a new page anyway at the end?
  • Solution: If user tries to move questions from a page to the same page, do not alter the order. Separate the functionalities of reordering and moving on different pages.

Others

Related issues

  • Solution: fix preview for random questions; this may be related to the quiz having empty questions

Reorder/paging issues

  • Solution: Document the paging in “Basic ideas” help dialog
  • Solution: change colouring, make a select dropdown?
  • Solution: Make pages look more like physical pages? But they are not.
  • Issue: The user commented that it would be easier if s/he could move the questions like other elements are moved in moodle course front page
    • Solution: Do it, this is important for Moodle's internal consistency
  • Solution: A page in Quiz is one of the basic concepts, so add a short explanation there about pages. In addition, add a more thorough explanation next to the paging button, and perhaps in the reordering tab.
  • Solution: change the wording. this issue may only be there in finnish.
  • Solution: Make reordering a subtab of edit. DONE
  • Solution: Either add a notification that you have to select some questions, or add a new page anyway at the end?
  • Solution: If user tries to move questions from a page to the same page, do not alter the order. Separate the functionalities of reordering and moving on different pages.