Gitlab hero border pattern left svg Gitlab hero border pattern right svg

Guidelines

Child Pages

Debugging QA Test Failures
Tips and Tricks

Overview

Guidelines are high-level directives on how we carry out operations and solve challenges in the Quality Engineering department.

Submitting and Reviewing code

For test automation changes, it is crucial that every change is reviewed by at least one Senior Test Automation Engineer in the Quality team.

We are currently setting best practices and standards for Page Objects and REST API clients. Thus the first priority is to have test automation related changes reviewed and approved by the team. For test automation only changes, the quality team alone is adequate to review and merge the changes.

Test Automation & Planning

Test Failures

Debugging Test Failures

See Debugging QA Pipeline Test Failures

Priorities

Test failure priorities are defined as follow:

Building as part of GitLab

Quality Department pipeline triage rotation

This is a schedule to share the responsibility of debugging/analysing the failures in the various scheduled pipelines that run on multiple environments.

Please refer to the Debugging Failing tests guidelines for an exhaustive list of scheduled pipelines and for specific instructions on how to do an appropriate level of investigation and determine next steps for the failing test.

Responsibility

Schedule

**November 2019 December 2019 January 2020 February 2020 March 2020**
Start Date DRI Secondary
2019-11-04 Mark Lapierre Jennie Louie
2019-11-11 Jennie Louie Zeff Morgan
2019-11-18 Zeff Morgan Désirée Chevalier
2019-11-25 Désirée Chevalier Dan Davison
2019-12-02 Dan Davison Aleksandr Soborov
2019-12-09 Aleksandr Soborov Sanad Liaquat
2019-12-16 Sanad Liaquat Tomislav Nikić
2019-12-23 Tanya Pazitny Ramya Authappan
2019-12-30 Ramya Authappan Tanya Pazitny
2019-01-06 Tomislav Nikić Rémy Coutable
2020-01-13 Rémy Coutable Walmyr Lima e Silva Filho
2020-01-20 Walmyr Lima e Silva Filho Grant Young
2020-01-27 Grant Young Nailia Iskhakova
2019-02-03 Nailia Iskhakova Mark Fletcher
2020-02-10 Mark Fletcher Mark Lapierre
2020-02-17 Mark Lapierre Jennie Louie
2020-02-24 Jennie Louie Zeff Morgan
2020-03-02 Zeff Morgan Albert Salim
2020-03-09 Albert Salim Désirée Chevalier
2020-03-16 Désirée Chevalier Dan Davison
2020-03-23 Dan Davison Aleksandr Soborov
2020-03-30 Aleksandr Soborov Sanad Liaquat
2020-04-06 Sanad Liaquat Jen-Shin Lin
2020-04-13 Jen-Shin Lin Tomislav Nikić

Responsibilities of the DRI and Secondary for scheduled pipelines

Responsibilities of the DRI and Secondary for deployment pipelines

Engineering productivity team rotation and escalation

In order to provide better input during the planning phase of a release, the schedule will include a member of the Engineering Productivity team during the second week of the month.