Dev Section Performance Indicators

1. You are here:
2. Handbook
3. Product Handbook
4. Dev Section Performance Indicators

On this page

• Section PI Overview
• Regular Performance Indicators
  • Dev - Section TMAU - Reported Sum of Dev Section SMAU
  • Dev - Section Paid TMAU - Reported Paid Sum of Dev Section SMAU
  • Manage - SMAU - MAU Viewing Analytics Features
  • Manage:Access - GMAU - MAU Using Enhanced Authentication
  • Manage:Access - Paid GMAU - MAU Using Paid SAML
  • Manage:Compliance - Paid GMAU - MAU Viewing Compliance Features
  • Manage:Compliance - Other - Total Compliance Actions
  • Manage:Import - GMAU - MAU importing
  • Manage:Import - Other - Share of New Projects Imported
  • Manage:Analytics - GMAU - MAU Viewing Analytics Features
  • Plan - SMAU - MAU Interacting With Issues
  • Plan:Project Management - GMAU - MAU Interacting With Issues
  • Plan:Project Management - Paid GMAU - MAU Interacting With Issues
  • Plan:Portfolio Management - Paid GMAU - MAU creating Epics each Month
  • Plan:Certify - Paid GMAU - MAU Interacting with Requirements
  • Plan:Certify - Other - Number of Requirements Created Monthly
  • Create - SMAU - MAU Conducting Git Write Operations
  • Create:Gitaly - Other - Availability
  • Create:Source Code - GMAU - MAU Conducting Git Write Operations to project repository
  • Create:Source Code - Other - Percentage of users per instance using Merge Requests
  • Create:Knowledge - GMAU - MAU that viewed or uploaded designs
  • Create:Knowledge - Other - Design Management Git Write Operations
  • Create:Knowledge - Other - Wiki Git Write Operations
  • Create:Static Site Editor - GMAU - MAU that committed via the SSE
  • Create:Editor - GMAU - MAU Conducting Git Write Operations from web editors
  • Create:Editor - Other - Number of Commits per Month from the Web IDE
  • Create:Editor - Other - Number of new Snippets per Month
  • Create:Ecosystem - GMAU - MAU of any integration
  • Create:Ecosystem - Other - Total active project integrations
  • Create:Ecosystem - Other - Integrations managed at Group or Instance level
• Other PI Pages
• Legends
  • Health
  • Instrumentation
• How to work with pages like this
  • Pages
    • Helper Functions
  • Data
  • Guidelines

Note: This page is dynamically generated via the Dev Section performance indicators .yml file.

Section PI Overview

The section PI overview shows Primary PIs for each Product Section, Stage, and Group.

Stage/Group	PI Type	PI	Health	SaaS / SM	PI Workflow
Dev	Section TMAU	Reported Sum of Dev Section SMAU	Okay	Both
Dev	Section Paid TMAU	Reported Paid Sum of Dev Section SMAU	Okay	Both
Manage	SMAU	MAU Viewing Analytics Features	Attention	Both
Manage:Access	Paid GMAU	MAU Using Paid SAML	Unknown	Both
Manage:Compliance	Paid GMAU	MAU Viewing Compliance Features	Unknown	Both
Manage:Analytics	GMAU	MAU Viewing Analytics Features	Okay	Both
Plan	SMAU	MAU Interacting With Issues	Okay	Both
Plan:Project Management	GMAU	MAU Interacting With Issues	Okay	Both
Plan:Project Management	Paid GMAU	MAU Interacting With Issues	Attention	Both
Plan:Portfolio Management	Paid GMAU	MAU creating Epics each Month	Okay	Both
Plan:Certify	Paid GMAU	MAU Interacting with Requirements	Unknown	Both
Create	SMAU	MAU Conducting Git Write Operations	Unknown	Both
Create:Gitaly	Other	Availability	Unknown	Both
Create:Source Code	GMAU	MAU Conducting Git Write Operations to project repository	Attention	Both
Create:Knowledge	GMAU	MAU that viewed or uploaded designs	Attention	SaaS
Create:Static Site Editor	GMAU	MAU that committed via the SSE	Attention	Both
Create:Ecosystem	GMAU	MAU of any integration	Unknown	Both

Regular Performance Indicators

Dev - Section TMAU - Reported Sum of Dev Section SMAU

A sum of all SMAUs across the three stages in the Dev Section (Manage, Plan, and Create)

Free/Paid: Both

SaaS/SM: Both

Target: 1.254M by end of Q3. This number assumes us switching to the new Create SMAU and including self-managed instances.

Is Primary PI: true

Chart (Sisense↗)

Health: Okay

• Unique Analytics views are now instrumented but we have yet to see any of that data from self-managed (anticipated in mid-Sept)
• Create SMAU is now Git writes and we have data for GitLab.com, but not self-managed. Expect to see a large jump in the number when the usage ping data is returned.
• Plan SMAU needs to be updated to the new calculation. Tracking via this issue
• Improvements - Address the problem areas that emerged out of the Category Maturity Scorecard exercise for Issue Tracking and continue making progress on quality of life improvements for existing Plan features.
• Improvements - Merge Request usability improvements
• Improvements - MR reviewers will make us more competitive with GitHub and should help with the lovability of assigning merge requests
• Improvements - Iterations in GitLab will make plan more usable for many Agile development teams

Instrumentation: Okay

• Manage SMAU (Analytics Views) visualization is now complete but we are waiting on self-managed data
• Create SMAU (Git write operations) visualization is now complete but we are waiting on self-managed data

Dev - Section Paid TMAU - Reported Paid Sum of Dev Section SMAU

A sum of all SMAUs across the three stages in the Dev Section (Manage, Plan, and Create) for Paid users only

Free/Paid: Paid

SaaS/SM: Both

Target: 2.8% increase in users (amounts to 111K users in Sept 2020 which is based on historical growth rate)

Is Primary PI: true

Chart (Sisense↗)

Health: Okay

• Unique Analytics views are now instrumented but we have yet to see any of that data from self-managed.
• Create SMAU is now Git writes and we have data for GitLab.com, but not self-managed. Expect to see a large jump in the number when the usage ping data is returned.
• Plan SMAU needs to be updated to the new calculation. Tracking via this issue
• Improvements - Iterations in GitLab will make plan more usable for many Agile development teams
• Improvements - Epic Swimlanes will allow for much better portfolio management via boards
• Improvements - SSO Group Sync which is targeted for FY3-2020 will greatly help user permission management on GitLab.com

Instrumentation: Okay

• Manage SMAU (Analytics Views) visualization is now complete but we are waiting on self-managed data
• Create SMAU (Git write operations) visualization is now complete but we are waiting on self-managed data

Manage - SMAU - MAU Viewing Analytics Features

The number of unique users viewing any Analytics page.

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Is Primary PI: true

Chart (Sisense↗)

Health: Attention

• Classified as "Attention" since we're able to measure SMAU, but need to add additional instrumentation before we can set a stage goal
• Planned improvements in 13.4 for Analytics - instance-level overview, issues analytics improvements, and DevOps report
• Planned improvements in 13.5 for Analytics views - group-level DevOps Report

Instrumentation: Attention

• First iteration of SMAU (analytics views) merged into 13.3 for self-managed and GitLab.com
• Incorporating other groups into SMAU currently pending instrumentation updates in 13.4 (see https://gitlab.com/groups/gitlab-org/-/epics/3690)
• After instrumentation is verified, please see this issue to track dashboard updates

Manage:Access - GMAU - MAU Using Enhanced Authentication

The number of unique users logging into GitLab with LDAP, SAML, OAuth, or Smartcard strategies on any tier of GitLab.

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Health: Unknown

• No target defined yet
• The Manage:Access group's focus is Paid GMAU so GMAU won't be an area of focus in the short term

Instrumentation: Problem

• Defined, instrumentation in 13.4

Manage:Access - Paid GMAU - MAU Using Paid SAML

The number of unique users logging into GitLab using SAML SSO for Groups.

Free/Paid: Paid

SaaS/SM: Both

Target: TBD

Is Primary PI: true

Health: Unknown

• No target defined yet
• Launched the ability to configure the default role assigned for SSO linked users in 13.3
• The ability to configure SSO in Gitlab.com without giving users access to all groups is planned for 13.4
• We are refining SSO group sync and plan to start in 13.5

Instrumentation: Problem

• Defined, instrumentation in 13.4

Manage:Compliance - Paid GMAU - MAU Viewing Compliance Features

The number of unique users viewing Audit Events, Compliance Dashboard, or Credential Inventory.

Free/Paid: Paid

SaaS/SM: Both

Target: TBD

Is Primary PI: true

Health: Unknown

• Export audit events to CSV expected in 13.4
• Add a Projects view to the Compliance Dashboard. Planned for Q3 2020.
• Improve PAT & SSH credential management (epic). Ongoing with expected completion in 13.6
• Add additional credentials (epic) to the credential inventory. Planned for Q4 2020

Instrumentation: Attention

• Defined and instrumented in 13.3. Data availability anticipated in mid-Sept.

Manage:Compliance - Other - Total Compliance Actions

A monthly count of the number of compliance actions taken.

Free/Paid: Both

SaaS/SM: SaaS

Target: TBD

Health: Unknown

• No target defined yet

Instrumentation: Attention

• We are currently collecting several of the underlying metrics from GitLab SaaS (see https://app.periscopedata.com/app/gitlab/663045/WIP:-Manage:-Compliance-Dashboard)
• Additional instrumentation needed to fill in gaps for self-managed.
• Implementation of all 6 gaps expected to be completed by 13.6 with 3 gaps addressed by 13.4

Manage:Import - GMAU - MAU importing

A monthly count of the unique number of users performing an import.

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Health: Unknown

• No target defined yet
• Improvement - To enable users to self-service GitLab migrations, the Import group is currently focused on starting to iterate toward the Complete solution for GitLab-to-GitLab migrations.
• Improvement - Continue to enhance the GitHub Importer with emphasis on supporting larger migrations.

Instrumentation: Problem

• Defined, instrumentation in progress, targeted for 13.4

Manage:Import - Other - Share of New Projects Imported

Share of projects created via import within 90 days of the namespace's creation.

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Chart (Sisense↗)

Health: Unknown

• No target defined yet
• Insight - The share of imported projects has been slightly up in the last 6 months from 11% to 14%. This coincides with the targeted effort to increase the discoverability of the import feature and to significantly reduce the number of known bugs.
• Improvement - To enable users to self-service GitLab migrations, the Import group is currently focused on starting to iterate toward the Complete solution for GitLab-to-GitLab migrations.
• Improvement - Continue to enhance the GitHub Importer with emphasis on supporting larger migrations.

Instrumentation: Attention

• Instrumented for GitLab.com
• Not instrumented for self-managed (issue targeted for 13.5)

Manage:Analytics - GMAU - MAU Viewing Analytics Features

The number of unique users viewing any Analytics page (https://docs.gitlab.com/ee/user/analytics/).

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Is Primary PI: true

Chart (Sisense↗)

Health: Okay

• Classified as "Okay" - expect to see an increase with the introduction of new throughput analytics page)
• Planned improvements in 13.4 - instance-level overview, issues analytics improvements, and DevOps report
• Planned improvements in 13.5 - Instance statistics & Enterprise DevOps Reports

Instrumentation: Attention

• Dashboard issue pending development

Plan - SMAU - MAU Interacting With Issues

Number of unique users interacting with an issue (open, close, reopen, adjust label, adjust milestone, adjust weight, comment)

Free/Paid: Both

SaaS/SM: Both

Target: 196400

Is Primary PI: true

Chart (Sisense↗)

Health: Okay

• Insight - 9.5% MoM growth from July to August driven by 37% growth in self-managed Project Management GMAU.
• Driver - Iterations & Epic Swimlanes should drive wider adoption for Plan - especially Paid SMAU

Instrumentation: Okay

• Dashboarding Update - dashboard now includes UUs interacting with issues across .com and self-managed. Thanks to the data team for pulling this together.

Plan:Project Management - GMAU - MAU Interacting With Issues

The number of unique users interacting with Issues each month.

Free/Paid: Both

SaaS/SM: Both

Target: 196400

Is Primary PI: true

URL(s)

• https://app.periscopedata.com/app/gitlab/722212/Plan:-Project-Management-GMAU

Chart (Sisense↗)

Health: Okay

• Result - 9.5% MoM growth from July to August driven by 37% growth in self-managed GMAU.
• Improvement - Work towards addressing the problem areas that emerged out of the Category Maturity Scorecard exercise for Issue Tracking.
• Improvement - Continue making progress on quality of life improvements for existing features.

Instrumentation: Attention

• Implementation - Missing many interaction events from self-managed that cannot performantly be unioned until telemetry adds a new counter type so the target / current MAU is likely much lower than once full implementation is complete.

Plan:Project Management - Paid GMAU - MAU Interacting With Issues

The number of paid unique users interacting with Issues each month.

Free/Paid: Paid

SaaS/SM: Both

Target: 50400

Is Primary PI: true

URL(s)

• https://about.gitlab.com/direction/plan/issue_tracking/

Chart (Sisense↗)

Health: Attention

• Result - 0% MoM growth from July to August, with small increases in self-managed cancelling out small decreases in SaaS.
• Improvement - Continue high level efforts on simplifying groups/projects and making issues more extensible while also making incremental progress on iterations.
• Improvement - Continue making incremental, iterative progress towards Plan's core JTBD as outlined in the Issue Tracking direction.

Instrumentation: Attention

• Implementation - Lacking a standardized data model to generate a blended dashboard that accurately distinguishes between Paid and Free users.

Plan:Portfolio Management - Paid GMAU - MAU creating Epics each Month

The number of unique users creating Epics each month.

Free/Paid: Paid

SaaS/SM: Both

Target: 1,500 Unique Users for Self Managed and 1,200 Unique Users for SaaS

Is Primary PI: true

URL(s)

• https://gitlab.com/gitlab-data/analytics/-/issues/5280

Chart (Sisense↗)

Health: Okay

• Insight - GMAU dipped slightly, but this is in line with the 2-3mo cycle we consistently see as larger customers tend to heavily plan quarterly. Overall monthly epic creation hit an all time high of +6200
• Improvement - Swimlanes will be a significant driver of MAU growth for Portfolio Management in the nearterm (n2m) - giving visibility to the feature on boards and adding additional value to better visualize your in-flight issues through swimlanes. Epic Boards should continue the trend into the end of FY21 by enabling Portfolio-level planning.

Instrumentation: Okay

• Dashboarding - we've instrumented core metrics but are looking to expand the MAU definition to include all epic usage, not just creation, for a more accurate GMAU metric

  Issue. 2020-09 update - we are identifying the additional instrumentation needed to accomplish this.

Plan:Certify - Paid GMAU - MAU Interacting with Requirements

The number of unique users interacting (create, view, reference) each month

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Is Primary PI: true

Health: Unknown

• Dashboarding not implemented yet so health is a proxy of our Certify's "other" metric and adhnoc anlaysis. Tracking issue
• Improvement - UX improvements for Requirements Management based on completed research study, Requirement Import functionality, Upcoming Quality Management MVC

Instrumentation: Attention

• Dashboarding - Requirement Creation is instrumented and dashboarods are created. Work to track additional interactions is in progress. Tracking issue here

Plan:Certify - Other - Number of Requirements Created Monthly

A monthly count of the number of requirements created.

Free/Paid: Both

SaaS/SM: Both

Target: 5000 by end of December 2020

URL(s)

• https://gitlab.com/gitlab-data/analytics/-/issues/5270

Chart (Sisense↗)

Health: Okay

• Insight - still small as a proportion of Stage usage but growing consistently since 12.10 launch
• Insight - Self-managed instances creating requirements growing at greater than 25% monthly
• Insight - Hit goal of 2000 requirements created by August 2020, updated PI with new target.

Instrumentation: Attention

• Dashboarding - accurate instrumentation on Self Managed, still needs verification for SaaS - issue
• Dashboarding - update metrics collection to track interactions

Create - SMAU - MAU Conducting Git Write Operations

A rolling count of the number of unique users who performed any Git write operation within the last 28 days.

Free/Paid: Both

SaaS/SM: Both

Target: Our FY21 Q3 Target is to exceed 1m unique users performing Git write operations. As instances upgrade to GitLab 13.3 with improved instrumentation, we intend to switch to growth rate target aligned with user growth rates.

Is Primary PI: true

URL(s)

• https://gitlab.com/gitlab-org/gitlab/-/issues/230481
• https://gitlab.com/gitlab-org/gitlab/-/issues/234027
• https://gitlab.com/gitlab-data/analytics/-/issues/5629

Health: Unknown

• Insight - Git write operations are performed by a large number of users. On GitLab.com, approximately 10% of users perform a Git write operation every month. For licensed self-hosted instances, this number should be much higher.
• This is the Create SMAU and the Gitaly GMAU. Please note, the primary Gitaly metric is Availability.

Instrumentation: Attention

• Enabled on GitLab.com for testing, and is scheduled for self-hosted in GitLab 13.3. https://gitlab.com/gitlab-org/gitlab/-/issues/230481
• Dashboard under construction https://gitlab.com/gitlab-data/analytics/-/issues/5629
• AMAU is being tracked per repository type, and which means that we are under counting slightly by using project repositories at the moment. https://gitlab.com/gitlab-org/gitlab/-/issues/234027

Create:Gitaly - Other - Availability

Percentage of time during which Gitaly is fully operational and providing service to users within SLO parameters. Availability is measured according by Apdex (latency) and error rate. Gitaly is considered available when at least 50% of users are experiencing satisfactory latency, _and_ 50% of requests are completing successfully. If either of these conditions is not met, the service is experiencing an outage.

Free/Paid: Both

SaaS/SM: Both

Target: 99.95%, consistent with GitLab.com availability service level objectives

Is Primary PI: true

URL(s)

• https://dashboards.gitlab.net/d/gitaly-main/gitaly-overview
• https://gitlab.com/gitlab-org/gitlab/-/issues/216683

Health: Unknown

• Insight - Gitaly continues to be a reliable service for customers on GitLab.com and self hosted
• Improvement - Gitaly Cluster provides opportunity for higher availability, particularly to defend against resource exhaustion availability problems, and work is in early stages to develop a roadmap for a cost effective deployment on GitLab.com

Instrumentation: Attention

• Rolling 7 day metrics available in Grafana for GitLab.com.
• Self-hosted availability metrics are planned

Create:Source Code - GMAU - MAU Conducting Git Write Operations to project repository

A rolling count of the number of unique users who performed a Git write operation to a project repository within the last 28 days

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Is Primary PI: true

URL(s)

• https://app.periscopedata.com/app/gitlab/728380/WIP-Create-Stage-Dashboard?widget=9520571&udv=0
• https://gitlab.com/gitlab-org/gitlab/-/issues/230481
• https://gitlab.com/gitlab-org/gitlab/-/issues/230481
• https://gitlab.com/gitlab-data/analytics/-/issues/5629

Chart (Sisense↗)

Health: Attention

• No target defined
• Released in 13.3, not enough data
• Improvement - work towards providing users more insights while navigating their code with Code Intelligence
• Improvement - work towards providing more control over managing repository size

Instrumentation: Okay

• Enabled on GitLab.com for testing
• Released for self-hosted in GitLab 13.3

Create:Source Code - Other - Percentage of users per instance using Merge Requests

Proportion of users per each instance (self-managed) or userspace (GitLab.com) making use of Merge Requests. This is defined as users who perform one or more of the following actions in a merge request - create, merge, or close a Merge Request.

Free/Paid: Both

SaaS/SM: Both

Target: TBD

URL(s)

• https://app.periscopedata.com/app/gitlab/664109/Create:-Source-Code-Dashboard?widget=9681589&udv=1024001
• https://app.periscopedata.com/app/gitlab/664109/WIP-Create:-Source-Code-Dashboard?widget=9601815&udv=1024001
• https://gitlab.com/gitlab-data/analytics/-/issues/4633

Chart (Sisense↗)

Health: Okay

• Target 40%
• Improvement - work towards enhancing the UX of Merge Requests
• Improvement - work towards better coordination of cross-stage changes to the Merge Requests UX
• Improvement - work towards making suggested changes lovable

Instrumentation: Okay

• Enabled on GitLab.com 2020-07-04
• Enabled for self-managed on GitLab 13.2

Create:Knowledge - GMAU - MAU that viewed or uploaded designs

Monthly unique users that have viewed or uploaded designs.

Free/Paid: Both

SaaS/SM: SaaS

Target: TBD

Is Primary PI: true

URL(s)

• https://gitlab.com/gitlab-org/gitlab/-/issues/234041
• https://gitlab.com/gitlab-data/analytics/-/issues/4761

Chart (Sisense↗)

Health: Attention

• No target defined yet
• Recent improvements - Initially we want to drive usage and feature adoption. We moved the feature to core and moved designs up in the UI so they will be seen by users. The chart above just shows Design Views on .com
• Improvement - We plan to show designs in more places in the app to increase adoption

Instrumentation: Attention

• Have .com data for design views
• Instrumenting usage ping and updates/creates for 13.5 - this pushed back due to holidays/parental leave

Create:Knowledge - Other - Design Management Git Write Operations

A rolling count of the number of unique users who performed a Git write operation to a design repository within the last 28 days

Free/Paid: Free

SaaS/SM: Both

Target: TBD

URL(s)

• https://gitlab.com/gitlab-org/gitlab/-/issues/230481

Health: Unknown

• No target defined.

Instrumentation: Attention

• Enabled on GitLab.com for testing.
• Scheduled for self-hosted in GitLab 13.3.

Create:Knowledge - Other - Wiki Git Write Operations

A rolling count of the number of unique users who performed a Git write operation to a wiki repository within the last 28 days

Free/Paid: Free

SaaS/SM: Both

Target: TBD

URL(s)

• https://gitlab.com/gitlab-org/gitlab/-/issues/230481

Health: Unknown

• No target defined.

Instrumentation: Attention

• Enabled on GitLab.com for testing.
• Scheduled for self-hosted in GitLab 13.3.

Create:Static Site Editor - GMAU - MAU that committed via the SSE

Monthly unique users that have made at least one commit via the static site editor.

Free/Paid: Free

SaaS/SM: Both

Target: 110 MAU by September 30, 2020

Is Primary PI: true

URL(s)

• https://app.periscopedata.com/app/gitlab/684213/WIP-Static-Site-Editor-Usage-Metrics
• https://about.gitlab.com/direction/create/static_site_editor/

Chart (Sisense↗)

Health: Attention

• Goal - drive early adoption, with a focus on internal GitLab team members editing the Handbook
• Insight - Strong growth driven by making the Static Site Editor available for all Handbook pages
• Improvement - Add MR Title and Description when submitting changes from the Static Site Editor
• Improvement - Address issues reported from Handbook editors that block full-time adoption

Instrumentation: Attention

• Usage Ping data is missing so the data doesn't reflect self-hosted users
• Improvement - Instrumenting for Usage Ping in 13.5

Create:Editor - GMAU - MAU Conducting Git Write Operations from web editors

A rolling count of the number of unique users who performed a Git write operation to any respository using the Web IDE, Web Editor or Snippet within a stage in the last 28 days

Free/Paid: Free

SaaS/SM: Both

Target: TBD

URL(s)

• https://gitlab.com/groups/gitlab-org/-/epics/4014

Health: Unknown

• Data is not reporting yet for this metric, will continue to watch as data collection begins.

Instrumentation: Attention

• The metric has been instrumented and turned on for GitLab.com (as of 8 Sept. 2020). It is expected to be turned on in the GitLab 13.4 release to start collecting data from self-managed.

Create:Editor - Other - Number of Commits per Month from the Web IDE

The total number of commits made via the Web IDE.

Free/Paid: Free

SaaS/SM: Both

Target: Unknown until we reach maturity level 2

URL(s)

• https://gitlab.com/gitlab-data/analytics/-/issues/4398
• https://gitlab.com/gitlab-data/analytics/-/issues/6149

Chart (Sisense↗)

Health: Unknown

• No target defined.
• Insight - Commit count remains steady with a general trend upward.
• Improvement - Investment in driving users toward the Web IDE through more focused editing paths.
• Improvement - CI Editor group continuing investment in improving .gitlab-ci.yml editing through the Web IDE.

Instrumentation: Okay

• Instrumentation working and charts updated to include both self-managed and SaaS data.

Create:Editor - Other - Number of new Snippets per Month

The number of new Snippets created each month.

Free/Paid: Free

SaaS/SM: Both

Target: Unknown until we reach maturity level 2

URL(s)

• https://gitlab.com/gitlab-data/analytics/-/issues/4400

Chart (Sisense↗)

Health: Unknown

• No target defined.
• Inisght - Overall decline in Snippets for August compared to July, but usage remains consistent.
• Improvement - Snippets with Multiple Files will be released in GitLab 13.5 which should continue to drive adoption and value.

Instrumentation: Okay

• Instrumentation for number of snippets is complete for self-managed and SaaS.

Create:Ecosystem - GMAU - MAU of any integration

Monthly Unique Users of any GitLab integration.

Free/Paid: Both

SaaS/SM: Both

Target: TBD

Is Primary PI: true

URL(s)

• https://gitlab.com/gitlab-org/gitlab/-/issues/225678
• https://gitlab.com/gitlab-data/analytics/-/issues/5850

Health: Unknown

• No target defined
• Improvement - Adding Group and Instance integration will allow larger sets of projects to be integrated easily
• Improvement - Improvements and new functionality in the Jira integration should increase adoption, expanding on the success of our most popular integration

Instrumentation: Problem

• Awaiting implementation of data in Usage Ping
• Awaiting implementation of Sisense dashboard (blocked by Usage Ping implementation)

Create:Ecosystem - Other - Total active project integrations

The total number of active project service integrations across all usage ping data (which includes GitLab.com)

Free/Paid: Both

SaaS/SM: Both

Target: Maintain flat adoption rate relative to overall GitLab growth

Chart (Sisense↗)

Health: Okay

• Observation - Growth tracks fairly evenly against overall usage growth (total number of projects created), demonstrating flat relative adoption rate of integrations
• Observation - GitLab.com users integrate at ~1/3 the rate that self-hosted users do

Instrumentation: Okay

• Good overall tracking of project integrations, detailed breakdown available per-integration

Create:Ecosystem - Other - Integrations managed at Group or Instance level

The total number of active project integrations that are being defined by a Group or Instance integration

Free/Paid: Both

SaaS/SM: Both

Target: Not defined

URL(s)

• https://gitlab.com/gitlab-org/gitlab/-/issues/204802#note_392267011
• https://gitlab.com/gitlab-data/analytics/-/issues/5849

Health: Unknown

• No data so far

Instrumentation: Unknown

• Usage ping recently implemented, no Dashboard yet

Other PI Pages

• Performance Indicator Maturity Table
• Engineering Function Performance Indicators
  • Customer Support Department Performance Indicators
  • Development Department Performance Indicators
    • Dev Sub-Department Performance Indicators
    • Ops Sub-Department Performance Indicators
    • Secure Sub-Department Performance Indicators
    • Threat Management Sub-Department Performance Indicators
    • Growth Sub-Department Performance Indicators
    • Enablement Sub-Department Performance Indicators
  • Infrastructure Department Performance Indicators
  • Quality Department Performance Indicators
  • Security Department Performance Indicators
  • UX Department Performance Indicators
• Product Performance Indicators
  • Dev Section Performance Indicators
  • Ops Section Performance Indicators
  • Secure & Defend Section Performance Indicators
  • Enablement Section Performance Indicators
  • Stage and Group Performance Indicators
• Corporate Finance Performance Indicators
• Recruiting Performance Indicators
• People Success Indicators
• Data Team KPI Index

Legends

Health

Value	Level	Meaning
3	Okay	The KPI is at an acceptable level compared to the threshold
2	Attention	This is a blip, or we’re going to watch it, or we just need to enact a proven intervention
1	Problem	We'll prioritize our efforts here
0	Unknown	Unknown

Instrumentation

Value	Level	Meaning
3	Okay	We are correctly capturing and measuring data for GitLab.com and self-managed instances.
2	Attention	Missing one of: GitLab.com or self-managed data.
1	Problem	Missing both: GitLab.com and self-managed data.
0	Unknown	Unknown

How to work with pages like this

Pages

Pages, such as the Engineering Function Performance Indicators page are rendered by an ERB template that contains HTML code.

• Any changes to the Performance Indicator (PI) ERB template will cascade to all links under the Other PI Pages section
• To add, delete, or update (K)PI information (including title, description, etc), make changes to the corresponding Performance Indicators data file. See more details in the Data section below.
• To update the way each individual (K)PI displays:
  • make changes to the Performance Indicators List ERB file for how the (K)PI is displayed on the KPI Index page
  • make changes to the Performance Indicators ERB file for any other properties and its format
• When adding a new PI page,
  • create the new PI page in the business division's handbook section (like the Engineering Division page)
  • include the relative link to the PI page in the Performance Indicators List ERB file
  • add all the (K)PI information into the corresponding Performance Indicators data file

Helper Functions

These ERB templates calls custom helper functions that extract and transform data from the Performance Indicators data file.

• The kpi_list_by_org(org) helper function takes a required string argument named org (deparment or division level) that returns all the KPIs (pi.is_key == true) for a specific organization grouping (pi.org == org) from the Performance Indicators data file.
• The pi_maturity_level(performance_indicator) helper function automatically assigns a maturity level based on the availability of certain data properties for a particular PI.
• The pi_maturity_reasons(performance_indicator) helper function returns a reason for a PI maturity based on other data properties.
• The performance_indicators(org) takes a required string argument named org (deparment or division level) that returns two lists - a list of all KPIs and a list of all PIs for a specific organization grouping (department/division).
• The signed_periscope_url(data) takes in the sisense_data property information from Performance Indicators data files and returns a signed chart URL for embedding a Sisense chart into the handbook.

Data

The heart of pages like this are Performance Indicators data files which are YAML files. Each - denotes a dictionary of values for a new (K)PI. The current elements (or data properties) are:

Property	Type	Description
name	Required	String value of the name of the (K)PI. For Product PIs, product hierarchy should be separate from name by " - " (Ex. {Stage Name}:{Group Name} - {PI Type} - {PI Name}
base_path	Required	Relative path to the performance indicator page that this (K)PI should live on
definition	Required	refer to Parts of a KPI
parent	Optional	should be used when a (K)PI is a subset of another PI. For example, we might care about Hiring vs Plan at the company level. The child would be the division and department levels, which would have the parent flag.
target	Required	The target or cap for the (K)PI. Please use Unknown until we reach maturity level 2 if this is not yet defined. For GMAU, the target should be quarterly.
org	Required	the organizational grouping (Ex: Engineering Function or Development Department). For Product Sections, ensure you have the word section (Ex : Dev Section)
stage	Optional	the product stage (Ex: release) as defined in stages.yml
group	Optional	the product group (Ex: progressive_delivery) as defined in stages.yml
category	Optional	the product group (Ex: feature_flags) as defined in categories.yml
is_key	Required	boolean value (true/false) that indicates if it is a (key) performance indicator
health	Required	has two additional elements/property - level (inclusive value between 0-3) and reasons. This should be updated monthly before Key Meetings by the DRI.
urls	Optional	list of urls associated with the (K)PI
sisense_data	Optional	contains elements/properties related to Sisense, including chart (numeric Sisense widget ID), dashboard (numeric Sisense dashboard ID), shared_dashboard (Sisense shared dashboard ID), embed (v2)
sisense_data_secondary	Optional	same as sisense_data. Allows a second sisense chart to be included.
public	Optional	boolean flag that can be set to false where a (K)PI does not meet the public guidelines.
pi_type	Optional	indicates the Product PI type (Ex: AMAU, GMAU, SMAU)
plan_type	Optional	indicates if the metric is Free, Paid, or Both.
telemetry_type	Optional	indicates if the metric is available on SaaS, SM (self-managed), or Both.
is_primary	Optional	boolean flag that indicates if this is the Primary PI for the Product Group.
instrumentation	Optional	has two additional elements/property - level (inclusive value between 0-3) and reasons. This should be updated monthly before Key Meetings by the DRI.
pi_workflow	Optional	indicates the PI Workflow status

Guidelines

• Each KPI chart should be a timeseries chart.
  • Use Purple bars to denote values.
  • Use a single Green bar for the current month (in progress).
  • Use a Red stepped-line for timeseries target.
  • Directional targets will be used:
    • Above ...
    • Below ...
    • At ...
    • At or above ...
    • At or below ...
  • Optional: Use a Black dashed-line for rolling average.
• Each KPI should have a standalone dashboard with a single chart representing the KPI and a text box with a link back to the handbook definition.
  • In Sisense, create a shared dashboard link to get the shared dashboard ID.
  • In Sisense, use the Share Link action of the chart to get the chart (widget_id) and the dashboard ID.
  • Add the shared_dashboard, chart , and the dashboard key-value pairs to the corresponding Performance Indicators data file under the sisense_data property
• Avoid : in strings as it's an important character in YAML and will confuse the data parsing process. Put the string in "quotes" if you really need to use a :
• urls: should be an array (indented lines starting with dashes) even if you only have one url
• Both maturity.level and health.level display a value between 0 and 3 (inclusive).