Gitlab hero border pattern left svg Gitlab hero border pattern right svg

Category Direction - Quality Management

Quality Management

   
Stage Plan
Maturity Planned
Content Last Reviewed 2020-10-20

Overview

Many organizations manage quality through both manual and automated testing. This testing is organized by test cases. These test cases can be run in different combinations and against different environments to create test sessions. Our goal for Quality management in GitLab is to allow for uses to track performance of test cases against their different environments over time, allowing for analysis of trends and identifiying critical failures prior to releasing to production.

We have performed a Solution Validation for the Quality Management MVC.

What's next & why

The first step in building out Quality Management is a scaffolding framework for testing. In particular, we are calling these test cases, and test sessions. These will be first class native objects in GitLab, used to track the quality process of testing itself.

The MVC can be seen at https://gitlab.com/groups/gitlab-org/-/epics/3852. This work is currently ongoing, and we expect to have full support for test cases in GitLab 13.6, with additional support for test sessions in GitLab 13.7.

Competitive landscape

Competitors in this space include qTest, Test Rail, and HPQC (HP Quality Center). They are focused on managing test cases as part of the software development lifecycle. Our approach and response will be to have similar basic test case management features (i.e. test objects), and then quickly move horizontally to integrate with other places in GitLab, such as issues and epics and even requirements management. See https://gitlab.com/groups/gitlab-org/-/epics/670. With this strategy, we would not be necessarily competing directly with these existing incumbents, but helping users with the integration pains of multiple tools and leveraging other, more mature areas of GitLab as we iterate.

Analyst landscape

We have yet to engage more closely with analysts in this area. As this product category is prioritized for improvements as our Plan product and engineering headcount grows, we expect to engage more with analysts.

Top Customer Success/Sales issue(s)

Few GitLab customers or prospects have asked about Quality Management. But the few that have, are asking about best practices and how they can possibly use GitLab and not worry with another tool. We are considering https://gitlab.com/groups/gitlab-org/-/epics/617 for that very purpose.

Top user issue(s)

Issue 👍
GitLab Quality Center 36
Test case management and test tracking in a Native Continuous Delivery way 10
Test cases and test suites 8

Top internal customer issue(s)

We continue to work with GitLab's Quality Team to scope out the MVC of quality management. See https://gitlab.com/gitlab-org/gitlab/-/issues/216149.

Top Vision Item(s)

The top Vision Item for this category is to release the MVC. It is our goal that by performing careful solution validation, we will come out with an initial offering for this product category which matches well with our target customers.

Git is a trademark of Software Freedom Conservancy and our use of 'GitLab' is under license