Tracker: Difference between revisions

From MoodleDocs
(→‎How to write a good tracker entry: link to best practices, minor edit)
(redirect)
 
(57 intermediate revisions by 15 users not shown)
Line 1: Line 1:
[[Image:Tracker.jpg]] '''is Moodle's''' [[Image:Issue Tracker MoodleOrg link.JPG]]
#redirect [[:dev:Tracker introduction]]
 
Issue tracking is an important part of a continuous quality control process.  It involves reporting of problems (bugs), ideas for improvement and new features. Unlike most proprietary software programs, Moodle issue reporting and tracking information is open to everyone.  Moodle's issue tracking system  is called '''[http://tracker.moodle.org Moodle Tracker]'''.  We welcome your requests for new features, improvements, or even constructive criticism of existing features.
 
The beauty of open source is that anyone can participate and help to create a better product for all of us to enjoy. Please help us by using [http://tracker.moodle.org Moodle Tracker]!
 
==Basics==
===Logging in to Tracker===
*If you're a new Tracker user, create a user account [http://tracker.moodle.org here].  It is strongly suggested your Tracker username is the same name you use at Moodle.org. 
*If you've forgotten your password, go [http://tracker.moodle.org here] and select '<u>forgot password</u>' which is just under the 'log in' button.  Follow the prompts.
 
=== How to report a bug, improvement, or new feature request ===
NB See the section 'Tracker fields' below for a full description of every field.
*Login to [http://tracker.moodle.org Tracker]
*Select "Create New Issue" from the menu under the Moodle Tracker logo
*From the dropdown menu select the "Issue type": Bug, New Feature, Task or Improvement
*You will see a series of dropdown and free text fields.  Complete as many as you can.  Some fields are required while others are optional.
*Press the 'Create' button at the bottom of the page to create the bug.
 
=== How to write a good tracker entry===
*A good external reference to help write a tracker entry can be found at [http://developer.mozilla.org/en/docs/Bug_writing_guidelines mozilla bug writing guidelines], or see [[Tracker#Tracker_entry_best_practices|Best practices section]] below. Be sure to include these pieces of information:
** Summary (How would you describe the bug, in approximately 60 or fewer characters?)
** Description (The details of your problem report), including
*** Overview: More detailed restatement of summary.
*** Steps to Reproduce: Minimized, easy-to-follow steps that will trigger the bug. Include any special setup steps.
*** Actual Results: What the application did after performing the above steps.
*** Expected Results: What the application should have done, were the bug not present.
*** Additional Information: Any other useful information.
 
==Details==
==Tracker process==
===Resolving bugs in Tracker===
Only Moodle core developers and testers are permitted to change the status of bugs in Tracker to "resolved" or "closed".
 
* Bugs are assigned by developers or Component Leads.
* Developers modify or add code and check into CVS.
* Appropriate comments are added in Tracker.  The bug's status is changed to '''Resolved''' by using the "Resolve Issue" button.
* You must indicate which version of Moodle the change will be included in using the '''Fix Version/s'''. You should use this to indicate which branch(es) you checked the fix into (example below).
* The only exception to not moving a bug to Resolved is if a developer believes there is no value in testing the issue, in which case the bug status can be changed to Closed.
 
 
=== Tracker groups and permissions ===
'''Standard Users''' [groupname=jira-user] - This is the default group.  New user accounts are placed in this group at the time of creation, and users must be a member of this group in order to log into Tracker.  Members of this group can browse bugs, create new bugs, comment on bugs, create attachments, create sub-tasks, create filters, watch bugs, and vote for bugs.  Members of this group can also resolve bugs, which is primarily a way of closing bugs that are no longer relevant (eg duplicates, or logged in error).  Standard Users can configure their Tracker workspace by using the "Configure your Issue Navigator" button.  This feature allows users to view watch and voting lists and to manage preferences, profile, and password.
'''Developers''' [groupname=jira-developer] - Developers can do everything Standard Users can do.  In addition they can clone bugs, close bugs, edit bugs, link bugs, and assign bugs.  Members of this group can also use the Bulk Edit function which allows bulk updated to multiple bugs.
 
'''Testers''' [groupname=moodle-testers] - Testers can do everything a Developer can do.
 
'''Moodle Security groups''' [groupname=moodle-security] - Trusted developers and administrators who need to work on and learn about security issues.
 
NB You can browse a project while not logged in to Tracker, however you will be unable change/edit/comment on bugs.
===Tracker fields===
NB A short explanation appears under each field in Tracker.
 
'''Project''' - Required field.  Tracker is made of of multiple projects.  At present there are 2: 'moodle' and 'moodle.org sites'.  Specify 'moodle' for issues/bugs related to moodle software; specify 'moodle.org sites' for issues/bugs related to tracker.moodle.org, docs.moodle.org, demo.moodle.org, download.moodle.org, or moodle.org. 
 
'''Issue Type''' - Required field.  Bugs are classified as 1 of the following:
:''Bug'' - A problem which impairs or prevents Moodle from functioning correctly.
:''Improvement'' - An enhancement to an existing Moodle feature.
:''New Feature'' - A new Moodle feature which has yet to be developed.
:''Task'' - A task that needs to be completed. Tasks usually refer to work that must be done outside the product.
:''Sub-Task'' - Issues are sometimes broken into multiple sub-tasks.
 
'''Summary''' - Required field.  A brief, concise description of the problem.
 
'''Security Level''' - Optional field. Specify if this bug or change has security implications for Moodle. Bugs with serious security implications are restricted so that only members of the moodle-security group can see them.
 
'''Priority''' - Bugs are prioritised using one of the following:
:''Blocker'' - Blocks development and/or testing work, production could not run.
:''Critical'' - Crashes, loss of data, severe memory leak.
:''Major'' - Major loss of function.
:''Minor'' - Minor loss of function, or other problem where easy workaround is available.
:''Trivial'' - Cosmetic problem like misspelled words or misaligned text.
 
'''Component/s''' - Required field.  Select the area in Moodle which is affected by this bug.  Select 'Unknown' if you are unsure.
 
'''Affects Version/s''' - Required field.  This is the Moodle version in which the bug has been found.  It is entered by the person logging the bug, and typically only 1 version is specified.  Enter your current version when logging an 'improvement', 'task', or 'new feature' as this will help assess the state of the product when the request was made.
 
'''Assigned To''' - This is the person who will fix (code) the problem.  This field is completed by developers or Component Leads.
 
'''Reporter''' - The person who logs the bug.  This field is automatically filled by Tracker.
 
'''Environment''' - Specify the operating system, software platform and/or hardware specifications if applicable to this bug.
 
'''Description''' - A full and complete yet concise description of the problem or improvement.
 
'''Database''' - Optional field.  If applicable to the bug, identify the database type.
 
'''URL''' - Optional field.  If possible, provide a URL address that demonstrates an example of this bug.
 
'''QA Assignee''' - Used to designate the person who will test this bug.
 
'''Fixed Version/s''' - This is the Moodle version the bug was or will be fixed in. This field is normally completed by the developer when the bug has been resolved or by lead developers allocating bugs for a specific release.  Normally only one version is specified in this field.  It symbolises the ''first'' version of Moodle where the change will be seen.
 
'''Attachment''' - Optional.  Attach a file that will help developers and testers better understand the bug.  Maximum attachement size is 512Kb.
 
'''Comment''' - The comment field is a detailed register of all changes that relate to this bug.
 
'''Resolution''' - This field is only displayed when resolving or closing a bug.  Specify a code that best describes how this bug was resolved.
:''Fixed'' - Bug has been fixed; a code change will be checked into CVS.  Use this resolution code only when actual changes were made to Moodle code.
:''Won't Fix'' - The problem described is an issue which will never be fixed.
:''Not a bug'' - This issue is not a bug; was logged in error.  Use this code if the bug was fixed by another bug report or in some earlier Moodle version.
:''Duplicate'' - The problem is a duplicate of an existing issue.
:''Incomplete'' - More information is needed to understand this bug.
:''Can't Reproduce'' - All attempts at reproducing this issue failed, or not enough information was available to reproduce the issue.  Reading the code produces no clues as to why this behavior would occur. If more information appears later, please reopen the issue.
:''Deferred'' - The resolution to this bug will be deferred to a later release.
 
 
 
===More information about setting the Fix Version/s field===
 
Suppose that the current stable releases are 1.8.3, 1.7.3, 1.6.5 and that 1.9 has branched so we have 1.9 beta+ and 2.0dev. Suppose you fix a bug on the MOODLE_17_STABLE, MOODLE_18_STABLE, MOODLE_19_STABLE and HEAD. Then mark the bug as fixed in 1.7.4, 1.8.4 and 1.9.
 
After Moodle 1.9 has been released, if you fix a bug on the MOODLE_19_STABLE and HEAD branches, mark it as fixed in 1.9.1 and 2.0.
 
If you resolved the bug as Cannot reproduce, or Won't fix, etc. Then leave the Fix version blank.
 
If you resolve the bug as Duplicate, then create a link to the duplicate issue.
 
These Fix version/s are used to automatically build release notes (see the tabs on http://tracker.moodle.org/browse/MDL) so it is helpful if you can get this right, but don't lose sleep over it.
 
The Fix version/s filed can also be used before the issue is fixed, as a way of planning when you intend to fix the bug. In this case, you can use any future release. For example, in the situation above, if you have a bug that you think should be fixed on the 1.9 stable branch, but is not urgent, you could set the fix version to 1.9.2 - then when the bug is actually fixed, update that field as necessary.
 
==Testing bugs==
All users are encouraged to be active participants when it comes to testing Moodle.  Anyone with a Tracker user account can log, view, comment on, vote, and watch bugs.  If you find bugs or problems, have ideas for improvements, or want additional functionality added to Moodle, please log a bug in Tracker. 
 
We've formalised a group of testers in Tracker who are responsible for verifying the accuracy of changes made by developers.  These testers have responsibilities and authority in Tracker beyond that of standard users. Testers normally have a good understanding of Moodle, and are active in the Moodle community.  Obviously testers should have the skills and knowledge to sufficiently test the issue - experience is important - but don't forget there are others in the Moodle community who may be willing to lend a hand. If you are interested in becoming a member of the Moodle Testing team, make yourself known by logging a request through Tracker.  We'd love to have you join the team!  Log your request at the [http://tracker.moodle.org/secure/project/ViewProject.jspa?pid=10020 Moodle.org Sites] Tracker project.
 
<u>Testing a bug in Tracker</u>
 
NB This is the process members of the moodle-testers group should follow to move bugs from 'resolved' to 'closed'.
*Testers test bugs with Status=Resolved.  Global filters have been created based on upcoming releases (eg 1.7 Resolved) to make identification simple. 
*Use the '''QA Assignee''' field to identify yourself as the tester of a particular bug. 
*It's a good idea to add your name to the watch list for all bugs you test. (see "Tracker watch list", below.) 
*If the bug passes testing, close the bug using the "Close Issue" button.  You must add appropriate '''comments''' describing your testing methods, any issues that were found, etc.
*If the bug fails testing or if you feel the fix is incomplete, '''reopen''' the bug using the "Reopen Issue" button.  Ensure the bug is assigned to the correct developer.  Work with the developer to find a mutually agreeable resolution to the bug.
*A release will be deemed ready when all bugs fixed for a particular version have been closed.
*All resolved bugs should be tested.  Bugs with a resolution code of "fixed" represent bugs where code has been updated, and probably represent more of a challenge than bugs with resoluton codes of  duplicate, won't fix, and not a bug, and can't reproduce.  Please ensure bugs have been closed with a proper resolution code.  Unfortunately it's not easy to change a resolution code in Tracker once the bug has been resolved (the only way is to reopen, then re-resolve). 
*Don't be afraid to discuss your testing with the developer assigned to the bug.  Simply adding a comment should get the attention of the developer as they are notified of all changes.
 
==More about Tracker functionality==
*You will receive an email when you log a new bug or make updates to bugs you've reported.  You'll also receive notification when updates are made to bugs you're watching.  Read on for more information on watching a bug.
*You can monitor, or "watch" bugs reported by others. To do this, open the bug, then select "Watch it" from the left hand navigation panel. To add others to the watchlist for your bug, open the bug, select the option "Watching" from the left hand navigation panel. These people will receive email notification when updates are made to this bug.
*Tracker provides a facility to '''Link''' bugs.  Any user logged onto Tracker may link issues.  Multiple link types are defined in the system; you will be required to select one when linking bugs.  The following link types are available:
::duplicates - duplicates are inevitable in a project the size of Moodle.  They occur when a logger is unaware of an existing bug that describes the same problem.  Use ''duplicates'' to link to the first or most comprehensively described instance of the problem.  All duplicates should be linked together.
::blockers - use this to identify bugs that block others from being fixed.
::cloners - in some instances a duplicate bug is intentionally created in order to track the fix in another branch of the code - this almost never is used in the Moodle project.
::dependency - often a fix is dependent on another bug being resolved first, on in a specific order.
::relates - used to identify a bug that is somehow related to another bug.
:Links are bi-directional meaning that there's a concept of 'inward' and 'outward' - it affects how linked bugs are displayed.  This is why you'll see "blocks/is blocked by" or "duplicates/is duplicated by" in the drop down list of the ''Link Issue'' dialog.  Don't become too concerned about using the "correct" link type - all link types work similarly.
 
:'''Don't be afraid to link bugs.''' It's very helpful to developers and testers to get a complete picture of a problem.
 
*'''Vote''' for bugs you want to see addressed in Moodle.  Any user can vote.  To vote for a specific bug, browse to the bug, then select "Vote for it" from the left-hand navigation panel.  Developers may consider the number of votes a bug has when weighing the merits of two or more bugs.
 
*The Tracker '''Dashboard''' is flexible and customisable depending on your area of interest.  For instructions on configuring the Tracker dashboard click  [http://www.atlassian.com/software/jira/docs/v3.6.3/dashboard.html here].
 
*The Tracker '''Issue Navigator''' is used to find and filter bugs.  For instructions on configuring the Issue Navigator click [http://www.atlassian.com/software/jira/docs/v3.6.4/navigatorcolumns.html here].
 
*Tracker's '''Quick Search''' function is explained [http://www.atlassian.com/software/jira/docs/v3.6.4/quicksearch.html here]
 
 
== Tracker entry best practices ==
 
Good bug reports address these elements (in the field Description):
 
#'''Steps to reproduce'''. That is, a detailed sequence of steps a developer can follow to see the problem.  It is very hard to fix a bug that is not reproducible. If possible, provide a URL so we can see the problem with one click.
#'''What I expected to happen'''. Again, provide as much detail as possible. Your expectation might mean that our instructions need to be improved or our interface should be changed.
#'''What actually happened''' (with detail).
 
Here are some examples of good bug reports: MDL-6030, MDL-5688, MDL-12505
 
*If you have an error message, or information in your PHP or web server logs, copy and paste it into the bug report. If you can, turn on "debug" in your Admin configuration page and reproduce the problem to get the best possible error message.
*Screen shots are very helpful for some bugs, but please write a textual description of the problem too.
*Make sure we know everything we need to know about your setup including operating system, database, etc. If you run out of room in the environment section, add more detail in the description. The full set of information that might be relevant is:
**Server operating system type and version number
**Web server type and version number
**PHP version number (and whether you are using an accelerator)
**Database type and version number
**Moodle version (there is a dropdown menu on the top of the form, if that does not have what you want, add it in the description)
**Client-side operating system type and version number
**Web browser type and version number
 
You don't need to give all those details all the time. For example, for a layout rendering problem, you need to give only the client-side OS and browser info, and if it is a server-side problem you only need to describe the setup there. Use your judgment. Here are some examples:
 
::I see this bug with the latest Moodle HEAD running on PHP5.1.2/Apache 2.2.3 on Linux. My database is Postgres 8.1.
 
::This rendering problem happens using Internet Explorer 6.0 on Windows XP.
 
In summary stick with facts and present enough facts so someone else can duplicate the problem.
 
=== Developer comments ===
 
"What’s the hardest thing about a bug report?"  Most of the time fixing the problem is the easy part, the hard part is reproducing the bug.  The developer needs to see how it is broke to be able to fix it.  If they can't reproduce the error you can be sure they won't be able to fix it!
 
Good bug reports contain as much detail as possible and are specific.  Don't generalise or leap to conclusions.
 
For example, a bug report that only says "The RSS feed doesn’t support UTF-8" is not helpful. The developer knows that UTF-8 and RSS feeds are compatible.  The developer has no idea of what the person sees and why they reported this bug.  In this case more time and effort needs to be expended to determine the problem.
 
Consider a bug report which says that the descriptions for the specific RSS feed XYZ@abc shows unrecognisable characters rather than expected characters.
 
==See also==
 
*[http://www.atlassian.com/software/jira/ Jira] Tracker is a slightly customised version of Atlassian's product 
*Using Moodle [http://moodle.org/mod/forum/discuss.php?d=43952 How to manipulate Moodle developers] forum discussion
*Wikipedia [http://en.wikipedia.org/wiki/Software_bug Definition of a bug]
*[[Tracker development]]
*[[Getting Started with the Tracker]]
 
[[Category:Teacher]]
[[Category:Administrator]]
[[Category:Developer]]
[[Category:Developer tools]]
 
[[es:Sistema de bugs]]
[[fr:Traqueur de bogues]]

Latest revision as of 15:21, 22 March 2012