Gitlab hero border pattern left svg Gitlab hero border pattern right svg

Category Direction - Usability Testing

Usability Testing

GitLab's testing focus is mainly around the functional testing of code in software. We are interested in expanding our testing capabilities to include user-centered interaction evaluation. With the vision of Usability Testing, GitLab is embedding direct input on how real users use the system within your testing practice.

Usability testing is slightly different from user acceptance testing (UAT) in that the primary purpose of a usability test is to improve a design, rather than a gate to approve a deployment. At GitLab, we're believers in user-focused design without manual interference. Usability Testing's vision is meant to celebrate the designer and product manager as first-class parties in the development lifecycle. By adding features with them in mind, we can help them to contribute their best.

A related category geared toward the readability of your applications is Accessibility Testing. As an end to end application, we offer other features involving the designer in the DevOps lifecycle, including Design Management in the Create stage.

Interested in joining the conversation for this category? Please join us in the category's issues where we discuss this topic and can answer any questions you may have. Your contributions are more than welcome.

This page is maintained by the Product Manager for Testing, James Heimbuck (E-mail)

What's Next & Why

The next thing we are working on for Usability Testing is &3085 which will bring the ability to take and attach screenshots to comments from the Visual Review tool. This will help users simplify their workflow and not have to take a screenshot and attach it to the comment after it is created in the MR. This also allows users without an account or an account without permissions to add those screenshots which they cannot do today.

Maturity Plan

This category is currently at the "Minimal" maturity level, and our next maturity target is Viable (see our definitions of maturity levels). Key deliverables to achieve this are:

We may find in research that only some of these issues are needed to move the vision for this category forward.

Competitive Landscape

Usability testing is a feature offered primarily through integrations by competitive products. Taking advantage of Review Apps, we're able to offer a much nicer experience with a manual review tool for Review Apps via gitlab-org&960 where feedback can be requested on a review environment. This brings feedback much earlier into the development process and integrates that automatically with GitLab Merge Requests.

Marker.io

Marker.io is a product that ships mostly as an extension to go into your browser and allows you to raise an issue with various issue providers (Trello, JIRA, GitHub and even GitLab). It provides a very intuitive user interface for screenshots, annotations and other discussions.

Top Customer Success/Sales Issue(s)

The top issues for CS/Sales teams are centered around uptier features in Premium and Ultimate. In this category, the top feature is building in a comparison view of screenshots.

Top Customer Issue(s)

The most popular issue for the category is gitlab#27228 which adds image annotations for the Visual Review tool.

An interesting use case we first heard about from a customer is designers wanting to see their previous comments for unresolved threads in the tool (gitlab#325454). We think this is an interesting and powerful way product designers and product managers can engage with the Usability Category and more quickly give feedback to the developers they work with to deliver customer value.

Top Internal Customer Issue(s)

For usability testing, our internal team has asked for built-in support for visual regression testing (gitlab#26489).

Top Vision Item(s)

When we think about the long term vision of the Usability category we see opportunities to build in support for visual regression testing to help developers see visual degradations before they merge.

Beyond this, we can look at offering the same for mobile via a solution like https://headspin.io/products.

Git is a trademark of Software Freedom Conservancy and our use of 'GitLab' is under license