QA/Bugzilla/AutomatedTasks

From The Document Foundation Wiki
< QA‎ | Bugzilla
Jump to: navigation, search

This page is about the Automated tasks of Bugzilla using the bugzillaChecker script

Checks

Running the script

  1. Download bugzilla_dump.json from vm174.documentfoundation.org:/home/esc-mentoring/esc/dump/bugzilla_dump.json ( this script can be used: https://redmine.documentfoundation.org/attachments/download/1937/downloadBugzillaDump.sh )
  2. Run './bugzillaChecker.py' (https://cgit.freedesktop.org/libreoffice/contrib/dev-tools/tree/qa/bugzillaChecker.py)

The script will warn of the following problems:

movedToFixed

  • Problem: The reporter has moved the bug to RESOLVED FIXED.
  • Solution: The bug should be moved to RESOLVED WORKSFORME unless there's a commit fixing it.

autoConfirmed

  • Problem: The reporter has auto-confirmed his/her own bug.
  • Solution: The bug should be moved back to UNCONFIRMED unless the reporter intends to work on it.

newerVersion

  • Problem: Someone has changed the version field to a newer one.
  • Solution: Version field should be changed back to the previous version unless the previous version was incorrect. Check history to see the previous version.

crashSignature

  • Problem: In order to link Bugzilla with http://crashreport.libreoffice.org, the crashreport field should have the format ["-signature-"], otherwise it doesn't work.
  • Solution: Change the crashreport field to the correct format

addAssigned

  • Problem: Someone has changed the Assignee field and it's different to the default one ( libreoffice-bugs@lists.freedesktop.org ) but the status is not set to ASSIGNED.
  • Solution: Set the status field to ASSIGNED.

removeAssigned

  • Problem: Someone has changed the assignee field to the default one ( libreoffice-bugs@lists.freedesktop.org ) but the status is still ASSIGNED
  • Solution: Change the status back to NEW

addAssignee

  • Problem: Someone has changed the status field to ASSIGNED but the assigne is still the default one ( libreoffice-bugs@lists.freedesktop.org ).
  • Solution: Change the assignee field accordingly

removeAssignee

  • Problem: Someone has changed the status field from ASSIGNED to NEW but the assignee field is still different to the default one ( libreoffice-bugs@lists.freedesktop.org )
  • Solution: Assignee field should be changed to the default one ( libreoffice-bugs@lists.freedesktop.org )

backPortAdded

  • Problem: Someone has added the whiteboard 'backport' but the bug's status is still NEW
  • Solution: Status field should be changed to RESOLVED

fixBugPing

  • Problem: The last comment is from 'libreoffice-commits@lists.freedesktop.org' and it was done more than a month ago.
  • Solution: Leave the following comment:
A polite ping to <name>:
Is this bug fixed? if so, could you please close it as RESOLVED FIXED ? Otherwise, Could you please explain what's missing?
Thanks

inactiveAssigned

  • Problem: The bug has been in ASSIGNED status for more than 3 months without any activity.
  • Solution: Change the status to NEW and reset the assignee to default. Leave a comment like:
Dear [developer-name],
This bug has been in ASSIGNED status for more than 3 months without any activity. Resetting it to NEW.
Please assigned it back to yourself if you're still working on this.

emptyAlias

  • Problem: a metabug doesn't have an alias. Having an alias is always good because it makes things more easy visually speaking.
  • Solution: Add an alias describing the metabug

New Contributor

  • Problem: a new contributor has signed up in Bugzilla and he/she has interacted in 3 or more bugs.
  • Solution: Send a welcome email to the new contributor:

Subject:

Welcome to the LibreOffice community!!

Body:

Hello [name],

On behalf of the QA Team, I would like to give you a warm welcome to the LibreOffice project and express my sincere gratitude for your contributions in our bugtracker[1].
As you might know, LibreOffice depends on volunteers like you to keep the software alive & improving and any help is much appreciated.

In the QA team, we identify problems in our software, confirms problems reported by users, and validates proposed fixes and enhancements so each new version of LibreOffice is more reliable and robust.

You can find more information about QA in our wiki page[2] and the most 'bleeding edge' version of LibreOffice can be downloaded from here[3].
If you need to contact us, you can do it via IRC [4], Telegram [5] or the mailing list [6].

Keep up the good work.

Regards

[1]. https://bugs.documentfoundation.org/
[2]. https://wiki.documentfoundation.org/QA
[3]. https://dev-builds.libreoffice.org/daily/master/
[4]. https://wiki.documentfoundation.org/QA/IRC
[5]. https://t.me/LibreOffice_QA
[6]. https://wiki.documentfoundation.org/QA/Mailing_List

Inactive Contributor

  • Problem: an old contributor who interacted in more than 20 bugs in the past has been inactive for more than 6 months
  • Solution: Send them a 'we miss you' email

Subject:

LibreOffice: We miss you!

Body:

Hello [name],

I'm writing you this email on behalf of the LibreOffice QA Team to express my sincere gratitude for your past contributions to the project.
As you might know, LibreOffice depends on volunteers like you to keep the software alive & improving and we really appreciate your work.

We have noticed your activity in Bugzilla has stopped for some time now and we know volunteering is something most of us do in our spare time, so it is normal to have periods where you need to concentrate on other items, however, we would love to have you back whenever you have time again.
On the other hand, if there is anything we can do to help you with, we would love to hear it.

Thanks in advance

patchAdded

  • Problem: A patch has been attached to bugzilla along with the keyword 'patch'
  • Solution: Ask the user to submit the patch to gerrit instead. Message:
Dear [user-name],
Thanks for the patch.
Could you please submit it to gerrit as described here:
https://wiki.documentfoundation.org/Development/gerrit/SubmitPatch?

reopened6Months

  • Problem: A bug has been fixed for more than 6 months and it has been reopened
  • Solution: Close the bug as RESOLVED FIXED and ask the user to open a new issue. Message:
Dear [user-name],
This bug has been in RESOLVED FIXED status for more than 6 months.
If the issue is still reproducible with the latest version of LibreOffice from https://www.libreoffice.org/download/libreoffice-fresh/, please report a new issue in https://bugs.documentfoundation.org/enter_bug.cgi providing, if     needed, the steps and documents to reproduce it.
Thanks for your understanding and collaboration.
Closing as RESOLVED FIXED

movedToNeedInfo

  • Problem: A bug has been confirmed ( NEW ) and someone moves it to NEEDINFO. In general, NEEDINFO should only be used for UNCONFIRMED bugs.
  • Solution: Change the status accordingly. Normally, either change it back to NEW or change it to RESOLVED.

reopened

  • Problem: A bug has been moved to REOPENED but it was never set to RESOLVED FIXED before. In general, REOPENED, should be only used for FIXED bugs.
  • Solution: Change the status accordingly. Normally, change it to NEW

regressionAdded

  • Problem: regression keyword has been added to a bug without anything else ( bibisected, bisected, bibisectNotNeeded, bibisectRequest, notBibisectable, preBibisect ).
  • Solution: Add the needed keyword. In general it would be bibisectRequest but it might be other depending on the comments

Automated tasks

Running the script

  1. Download bugzilla_dump.json from vm174.documentfoundation.org:/home/esc-mentoring/esc/dump/bugzilla_dump.json ( this script can be used: https://redmine.documentfoundation.org/attachments/download/1937/downloadBugzillaDump.sh )
  2. Run './bugzillaAutomation.py' (https://cgit.freedesktop.org/libreoffice/contrib/dev-tools/tree/qa/bugzillaAutomation.py)

Obsolete comments

Automatically mark as obsolete the following type of comments when they are not the last comment in the bug:

  1. 'Untouched for a year' comments
  2. Cleaning-out needinfo comments
  3. Cleaning-out needinfo follow-up comments
  4. Comments starting with 'A polite ping, still working on this bug'

Bug untouched for a year

Ping bug reports with no update for one year or more. Exclude: Any [Meta], [Task] and [Super] bugs, EasyHacks, ux-advise bugs (with keyword needsUXEval) and enhancement requests

Stock Message

Dear [reporter's name],

To make sure we're focusing on the bugs that affect our users today, LibreOffice QA is asking bug reporters and confirmers to retest open, confirmed bugs which have not been touched for over a year.

There have been thousands of bug fixes and commits since anyone checked on this bug report. During that time, it's possible that the bug has been fixed, or the details of the problem have changed. We'd really appreciate your help in getting confirmation that the bug is still present.

If you have time, please do the following:

Test to see if the bug is still present with the latest version of LibreOffice from https://www.libreoffice.org/download/

If the bug is present, please leave a comment that includes the information from Help - About LibreOffice.
 
If the bug is NOT present, please set the bug's Status field to RESOLVED-WORKSFORME and leave a comment that includes the information from Help - About LibreOffice.

Please DO NOT

Update the version field
Reply via email (please reply directly on the bug tracker)
Set the bug's Status field to RESOLVED - FIXED (this status has a particular meaning that is not 
appropriate in this case)


If you want to do more to help you can test to see if your issue is a REGRESSION. To do so:
1. Download and install oldest version of LibreOffice (usually 3.3 unless your bug pertains to a feature added after 3.3) from http://downloadarchive.documentfoundation.org/libreoffice/old/

2. Test your bug
3. Leave a comment with your results.
4a. If the bug was present with 3.3 - set version to 'inherited from OOo';
4b. If the bug was not present in 3.3 - add 'regression' to keyword


Feel free to come ask questions or to say hello in our QA chat: https://irc.documentfoundation.org/?settings=#libreoffice-qa

Thank you for helping us make LibreOffice even better for everyone!

Warm Regards,
QA Team

MassPing-UntouchedBug

NEEDINFO: First notification

Find NEEDINFO bugs that haven't changed in 180 days and point users to the NEEDINFO page, request information again and let user know that if requested information is already there, to appropriately set the status of the bug so we move the bug forward

Stock Message

Dear [Reporter's Name],

This bug has been in NEEDINFO status with no change for at least
6 months. Please provide the requested information as soon as
possible and mark the bug as UNCONFIRMED. Due to regular bug
tracker maintenance, if the bug is still in NEEDINFO status with
no change in 30 days the QA team will close the bug as INSUFFICIENTDATA
due to lack of needed information.

For more information about our NEEDINFO policy please read the
wiki located here:
https://wiki.documentfoundation.org/QA/Bugzilla/Fields/Status/NEEDINFO

If you have already provided the requested information, please
mark the bug as UNCONFIRMED so that the QA team knows that the
bug is ready to be confirmed.
 
Thank you for helping us make LibreOffice even better for everyone!

Warm Regards,
QA Team

MassPing-NeedInfo-Ping

NEEDINFO: Follow-up Message 30 days later

30 Days after the first notification close the bug as INSUFFICIENTDATA because of lack of information and let user know that if they are still experiencing the bug they can open it back up as UNCONFIRMED if they provide requested information

Stock Message

Dear [Reporter's Name],

Please read this message in its entirety before proceeding.

Your bug report is being closed as INSUFFICIENTDATA due to inactivity and
a lack of information which is needed in order to accurately
reproduce and confirm the problem. We encourage you to retest
your bug against the latest release. If the issue is still
present in the latest stable release, we need the following
information (please ignore any that you've already provided):

a) Provide details of your system including your operating
   system and the latest version of LibreOffice that you have
   confirmed the bug to be present

b) Provide easy to reproduce steps – the simpler the better

c) Provide any test case(s) which will help us confirm the problem

d) Provide screenshots of the problem if you think it might help

e) Read all comments and provide any requested information

Once all of this is done, please set the bug back to UNCONFIRMED
and we will attempt to reproduce the issue. Please do not:

a) respond via email 

b) update the version field in the bug or any of the other details
   on the top section of our bug tracker

Warm Regards,
QA Team

MassPing-NeedInfo-FollowUp