The Product Analysis group consists of a team of product analysts. This group reports to the Senior Director, Product Monetization and serves as a specialized analytics team to support the product organization and product data-related analysis across GitLab.
Read more about what we do at GitLab on our Direction page.
As part of the Research & Development (R&D) Data Fusion Team, the product analysts also work closely with members from the central Data team. In addition, the Product Analysis team is part of the Functional Analytics Center of Excellence (FACE), along with other functional analytics groups across the GitLab Data Program.
The Product Analysis group works in two-week iterations, which dictate how and when we plan and prioritize work. Iterations start on Thursdays and end on Wednesdays.
You can see our current iteration here.
For all product analysis requests, please create an issue in the GitLab Data Product Analytics project,
Team::Product Analysis and
product analysis labels, and follow the guidelines below.
All data issues with the
Team::Product Analysis label will appear on the Product Analysis board.
Please select the appropriate template based on your type of request and answer as many of the questions as you can. The more information and context we have up front, the faster we are able to triage and begin work on the issue.
|Ad hoc / Default request||Ad Hoc Request|
|Experimentation analysis||Experiment Analysis Request|
In order to be considered for the upcoming iteration, please open all issues by EOD Monday before the next iteration begins. We understand that urgent matters come up, but please try to adhere to the submission deadline for any planned work.
Please indicate the relative priority of the new issue compared to any other issues you have open in the backlog (if applicable). In general, the issues that are more immediately actionable and impactful to the company KPIs should be higher in priority.
We ask that PMs apply a
pm-priority:: label to issues to indicate relative priority of the ask.
||High and/or urgent|
Final commitment and prioritization will occur during the iteration planning meeting, which takes place the day before an iteration begins (every other Wednesday). The team will consider new and existing issues, along with issues in progress. When selecting issues for the next iteration, the team considers the following:
The Manager, Product Data Analysis will help prioritize work based on importance and capacity, and will work with the Senior Director, Product Monetization and VP, Product on trade-offs (if needed).
Prioritization labels will be added by the Product Analysis team as a part of triage and planning.
||High and/or urgent|
Most issues will fall under
Each issue is assigned a weight based on estimated time commitment. If a partially-completed issue rolls over from one iteration to another, the weight will be adjusted to reflect the time commitment of the outstanding work.
If a single issue has a weight greater than the length of the iteration (2 weeks), it should be broken into smaller units of work. (This could also be an indicator that the issue should be converted to an epic).
|Weight Value||Estimated time to complete|
|1||< 1 hour|
Product Analysis defines velocity as the amount of work (measured in issue weight) completed by the team within a given iteration. While we recognize that this is an imperfect measurement (partially-completed issues and undocumented work are not accounted for), it is a rough gauge of team output.
We aim to only commit to work we believe can be completed within the 2-week iteration. As such, we will commit to less than our recent velocity and leave a buffer to account for urgent issues and interruptions. To start, each analyst will leave a buffer of ~2 days worth of work (an estimate based on the recent volume of unplanned work). High-priority issues exceeding the allotted buffer will have a material impact on our ability to complete planned work, so please plan ahead if you know that you will need assistance from the Product Analysis team.
As GitLab team members, we are encouraged to take PTO and observe public holidays in order to maintain a healthy work-life balance. Analyst capacity should be adjusted based on the number of days they are working in the iteration.
If an urgent matter comes up, please open an issue and tag your analyst contact (and/or
Please include why the issue is urgent, when it is needed by, what it will inform or how it will
be used, and who is the intended audience.
If you have not heard from the tagged analyst within 1 business day* (or earlier if the issue
requires a faster turn-around), please send a message in #s_growth_data
and feel free to tag
*Please keep in mind that we work across different time zones
Please keep the following in mind when working with the Product Analysis team:
Scope creep is a problem everyone faces. Please keep in mind that team capacity is a zero-sum game, so scope creep in one issue can mean that we are unable to complete other work planned for that iteration.
Additional scope (change in requirements, additional follow-ups, etc) that adds a material amount of work* to an issue will need to be captured as net-new work in a new issue. The new issue will then go through the normal prioritization and planning process. The best way to avoid scope creep is to have thorough, complete requirements in the issue when you initially open it. The issue templates should help guide you to include all relevant information.
*The threshold for a "material amount of work" is to be determined by the analyst working on the issue.
If an issue is blocked and it requires additional work* to diagnose or troubleshoot (ex: a data issue is uncovered), a new issue should be opened, assigned a weight and priority, and linked to the original blocked issue. The new issue can be added to the current iteration without going through the formal planning process at the analyst's discretion, but this can impact our ability to complete all issues in the iteration.
*The threshold for "additional work" is to be determined by the analyst working on the issue.
Experimentation analysis issues are naturally blocked by the experiment actually running (we have to wait until we have sufficient data in order to perform the analysis). In order to enable a more accurate measure of velocity, we will divide the work into 2 separate issues*:
*At this time, PMs should continue to open a single issue and analysts will separate accordingly.
Please open an issue for all Product Analysis requests. Requests made via comments in Google Drive are extremely difficult to track, and Slack history is gone after 90 days. In addition, these requests are not planned or accounted for in team velocity. Your informal request might mean that we are unable to complete work we committed to for another stakeholder.
By keeping a formal record of requests (via issues), we are able to identify frequently asked questions (which could lead to building a self-service solution) and quickly replicate past work.
The Product Analysis team is tasked with supporting the entire product organization, in addition to other product-related data needs across GitLab. As such, team capacity can be limited as we grow towards our target gearing ratio. However, limited capacity should not stop GitLab team members from opening issues for Product Analysis, it simply means that lower-priority requests will have to wait until resources are available. As the group grows, so will our ability to turn around requests in a shorter period of time.
In order to support more PMs across GitLab, the Product Analysis team offers office hours. Office hours are held every other Wednesday, alternating between and . While our primary stakeholders are PMs across the organization, all GitLab team members are welcome to join.
The intent of office hours is to give PMs faster access to the team and get support for smaller tasks, brainstorming, and data self-service. More formal requests that answer more complex questions are captured in issues and go through a more rigorous, structured prioritization process.
The agenda is first-come, first-served. Walk-ins/drop-ins are always welcome, but if possible, please add your name and topic (or question) by EOD Monday before the next office hours. This allows the team time to review new agenda items ahead of time.
If there are multiple items on the agenda, topics will be time-boxed to 30 minutes in order to ensure that, at minimum, we are able to help 2 stakeholders. If topics are too large to be covered in 30 minutes, a team member will reach out to the stakeholder to either reduce the scope or to open an issue for the team instead. Stakeholders are welcome to leverage office hours to discuss and define the new issue, which can help reduce async back-and-forth communication in the issue itself. If we are unable to cover a topic on the agenda, it will be pushed to the following meeting.
Office hours are intended for smaller bodies of work, brainstorming, and assistance with data self-service. Since topics are limited to 30 minutes, we ask that stakeholders be mindful of the types of items they add to the agenda. When in doubt, add the topic and we can help scope it. Here are some examples of topics for office hours:
Here are some examples of topics not suited for office hours. These topics are too broad to be addressed during office hours and should be captured in an issue. Please note that stakeholders are welcome to come to office hours to discuss the scope and details of the subsequent issue (see example topic 6 above).
What is the difference between topics for office hours and formal data requests?
Office Hours is intended to help PMs with smaller tasks, provide a venue for brainstorming, and help folks looking to learn more about data self-service. The benefit is that the agenda is first-come, first-served, the prioritization process is bypassed, and the wait time is minimal.
Formal data requests and larger bodies of work are captured in issues in the Product Analytics project. They can help answer more complex questions, but go through more robust intake and planning processes. As such, there is a longer turn-around time given team size and capacity.
What if I don't know if my topic is best suited for office hours or whether I need to open an issue?
Feel free to ask your analyst partner (if applicable) or in #s_growth_data. When in doubt, come to office hours and the team can discuss there. We review agenda items added in advance of office hours, and will flag any topics that are too broad to be covered during office hours.
@product-analysts- Notifies the entire Product Analysis team
@randdanalyticstriage- Notifies the entire Product Analysis team and the Data team's R&D Fusion group, per the Enterprise Data Triage Program
@functional-data-analysts- Notifies the entire Product Analysis team and other functional analysts across the GitLab Data Program
@gitlab-org/growth/data-analysts- Notifies the entire Product Analysis team