QA/Projects/Bug Triage Contest

    From The Document Foundation Wiki
    < QA‎ | Projects

    TDF LibreOffice Document Liberation Project Community Blogs Weblate Nextcloud Redmine Ask LibreOffice Donate

    Bug Triage Contest

    41triagebanner.png

    What is the Bug Triage Contest

    The bug triage contest is a 14 day event open to everyone aimed to encourage triaging (confirming & prioritizing) unconfirmed bugs. In general we encourage any triaging against UNCONFIRMED bugs but we hope to focus on bugs in the following order:

    1. Bugs Reported Against 4.1
    2. Unconfirmed bugs against 4.0 (regression)
    3. Unconfirmed bugs against 4.0 (not regression)
    4. All other unconfirmed bugs.

    Each triaged bug will count as a point for the triager. Prizes will be awarded approximately 1 month after the end of the contest - during which time the QA team will be analyzing the data to ensure that the right people get awarded prizes.

    How to Join

    While we try to avoid adding barriers, in order for us to accurately track the triage contest we have to have a list of individuals involved. To sign up you can do 1 of 2 things:

    1. Add name to table below
    2. Email QA mailing list with subject "Join Triage Contest" - info should include your name and FreeDesktop email address (List of LibreOffice Mailing Lists)
    Full Name Name on FDO if Different Current LibreOffice Status Shirt Status
    Joel Madero Joel Madero QA Volunteer
    Brenda Granados Brenda Granados QA Volunteer
    Joren De Cuyper JorenDC QA Volunteer
    Arnaud Versini Arnaud Versini Developer
    Florian Reisinger Florian Reisinger QA Volunteer
    Robinson Tryon qubit QA Volunteer
    Steve Bell SteveBell QA Volunteer
    Thomas v.d Meulen pje335_NL QA Volunteer
    Cor Nouws cornouws QA Volunteer
    Hannes Michalek Hannes ? User Free Shirt
    Jean-Baptiste Faure Jean-Baptiste Faure QA Volunteer
    Michael Münch michael at m06 org user Free Shirt
    Michael Chen Michael Chen user Free Shirt
    Joan G. Wilhelm user Free Shirt
    Ken Biondi Ken Biondi user Free Shirt
    Thomas Hackert thackert OLH/UI translater, sometimes QA ... ;)
    Joe Lee user Free Shirt
    Jan Koberstein Jan Koberstein user
    Tim Passingham Tim Passingham user
    Ahitagni Mandal Ahitagni Mandal user
    Zoltan Laszlo zrlaszlo at yahoo.com user
    Ralph Aichinger ralph at pangea.at user
    Example Example User

    Useful Things to Do Before Contest

    None of these are mandatory but they will be useful for you and help speed up the process.

    • Bugzilla - this is where all triaging will happen, the sooner you join, the sooner you can get comfortable with how it works.
    • Get Comfortable with FDO Searches - FreeDesktop is relatively easy to use but it's good to get used to the interface, we recommend clicking on this link and "practicing" with it. Remember we are only going to be looking at LibreOffice UNCONFIRMED bugs. In order to do this make sure to set Product to "LibreOffice" and Status to "UNCONFIRMED".
    • Triage Instructions - Review our wiki on how to triage and prioritize bugs. If you do not do this, there is a chance that your triaging efforts will be wasted.
    • Priotization Flowchart -- review flowchart to get an idea of how to prioritize, can be a useful reference when triaging bugs.
    • IRC QA Channel -- Join the QA channel and get comfortable using IRC. This is where we routinely meet and talk about quality assurance. Moderators will be available often to help new users get involved with contest.


    Bug Triage Contest Details

    Date

    The competition will last for 14 days between the dates:

    June 20th, 2013 (0000 UTC) - July 5th, 2013 (2359 UTC)


    This date range has been chosen to coincide with the first release candidate of Version 4.1 which will be available for download: Pre-Release Download Page

    Rules

    The rules are pretty straight forward, you will be rewarded apoint for every triaged bug that fulfill the below requirements, the top 5 individuals will receive some cool LibreOffice gear :)

    How Points are Counted

    TO GET A POINT YOU MUST PUT BUG#65765 IN THE SEE ALSO FIELD OF THE TRIAGED BUG

    1. A full triage is required in order for a point to be counted, a full triage consists of:
      1. Leaving a helpful comment either:
        1. Requesting More Information -- be as specific as possible or
        2. Acknowleging that bug has been confirmed or
        3. Stating that bug cannot be reproduced &
        4. EVERY COMMENT SHOULD LIST YOUR OPERATING SYSTEM & LIBREOFFICE VERSION: Version info of LibreOffice can be found under Help - About LibreOffice (example for a heading for every comment: "Operating System: Ubuntu 12.04, LibO Version: 4.0.1.2 release" or "OS: Windows 7, LibO Version: 4.0.0.1 rc, Last worked in: 3.6.4.1 rc")
      2. Set Status
        1. NEEDINFO (if more info is needed, make sure to comment!)
        2. NEW (confirmed)
        3. WORKSFORME (be very careful about this one, only set it if you're using same or newer version of LibreOffice plus are using same platform as reporter)
      3. Attempt to prioritize
        1. Do your best to prioritize the bug using the following flowchart: Bug Prioritization Flowchart
      4. Check additional information
        1. Check the additional information on the bug, including architecture, title of bug, etc... alter if needed
    2. Counting the Bug
      1. YOU MUST ADD BUG #65765 TO SEE ALSO FIELD FOR BUG TO COUNT!
      2. Again, this is the only way your triage will count as we are using this field to track our contest, if you forget to add it there is no way for us to accurately track the contest
    3. Cheating, etc... If you are caught cheating (not doing your part to triage but still adding relates to bug, purposely and innacurately triaging, etc...) you might be:
      1. Untrusted by the TDF community
      2. Banned from this contest as well as future contests
      3. Suspended from freedesktop.org

    Of course we don't think anyone will be in this situation but we wanted to be up front about the consequences.

    Announcing Winners, Tracking Progress

    The judges listed on this page will be responsible for monitoring progress during the contest. We will be keeping a daily record of points and will do our best to make these public either on a blog or through mailing lists (maybe even both). At the end of the contest the judges will carefully look at the records for the top 5 contestants, barring any complications, we should b eable to announce a winner within 14 days.

    You've Won, Now What?

    If you are in the top 5 you will receive an email requesting your mailing address and preferred size for gear :) After this point we will be ordering the gear direct and having it shipped to you.

    Questions/Concerns/Complaints

    Contact Joel Madero directly via email (you can find his email address on FDO) or on QA IRC Channel (#libreoffice-qa on freenode)

    Prizes

    1st Place - 5th Place: LibreOffice t-shirt

    Shirts will be ordered after winners announced to ensure sizes are right. Expect to receive t-shirt 4-8 weeks after end of contest.

    Here's what the shirts look like (sorry, the ray-gun mug doesn't come with):

    Front Back
    Libreoffice-qa-t-shirt front.jpg Libreoffice-qa-t-shirt back.jpg

    Judges

    Because there is a set standard for how we are counting points, in general judges will only confirm the result of the winners. We will be checking for any "foul play" (ie. cheating), throughout the contest. Judges will also certify the winners. In order to avoid the perception of judges cheating, any judges participating in the contest will be banned from certifying themselves if they end up in the top 5. List of judges can be found below:

    Name Experience Nick
    Joel Madero QA Volunteer, TDF Member jmadero
    Joren De Cuyper QA Volunteer, TDF Member jorendc
    Robinson Tyrone QA & Ask Volunteer colonolqubit

    Moderators

    Below is a list of moderators who will be available on IRC throughout the competition. Any contestant can ping these moderators at any time to ask a question. Moderators not be requested to reproduce a bug that you are working on, instead they should only be asked about policies or in some cases can be asked about priortization if there is a question after bug is confirmed. List of moderators and IRC name is below:

    Nam IRC Nick
    Joel Madero jmadero
    Joren De Cuyper Jorendc

    Useful Links

    LibreOffice 4.1.0 pre-release downloads

    Retrieved from "https://wiki.documentfoundation.org/index.php?title=QA/Projects/Bug_Triage_Contest&oldid=665628"