CMO: Identify CE installations within strategic organizations with installations with over 500 users and launch demand generation campaigns. => Achieved. 50 SQOs generated.
CMO: More demand coming from inbound marketing activities. 50% of sales pipeline quota. => Achieved on SQL $, miss on #
CMO: Increase EE Trials. 21% Quarter over Quarter (QoQ) => Miss
CMO: Increase EE Trial SQL $ pipeline contribution 43% QoQ => Achieved over 2x goal
CFO: Forecast accuracy and delivery of relevant information
Controller: Zuora to Salesforce reconciliation complete and tested. DONE
CFO: Forecasting model projects forecast +/- 10% normalized for big deals. DONE
Controller: Zuora to Salesforce to Zendesk data synch completed. DONE
CFO: Deliver 10 SQLs > $10k during quarter through investor outreach 50% ACHIEVED
VP Prod: Salesforce shows usage. Version check, usage ping, and ConvDev index are available in SFDC. => All shipped
VP Prod: Import documentation for all major platforms. Five new import docs shipped. => 5/5 shipped. 10 in total now.
CRO: 100% of quota-carrying reps at 3x pipeline of quarterly IACV goal MISSED
SDR lead: Generate 25% of sales pipeline quota => 36% of SCLAU was SDR sourced in Q3. Up from 12% in Q2.
SDR lead: Get an SQL from Fortune 1000 companies identified using CE. 50% of identified companies using CE. => 50 SQOs generated.
SDR lead: Double Win Rate. 10% => 5% of Q3 SDR sourced SCLAU have been won so far. Given sales cycle expect increase over time in the Q3 opportunities.
CRO: Increase new business sales velocity. Grow 200% YoY (Q3 2016 to Q3 2017) in new business deals closed won. ACHIEVED
CRO: Decrease age of non-web direct deals by 10% ACHIEVED
CEO: Understand and improve existing account growth. 200% YoY
VP Eng: Geo DR successful deployments. Test fail-over with GitLab.com => 20% done. Some customers running Geo in alpha now. Failover targeted for Q1 2018.
Platform: Get Geo reliable with a testing framework. => 10% done, moved to Q4 with GitLab QA
Distribution: Deliver PostgreSQL High Availability (HA) in omnibus and Terraform to enable HA
Technical Writing: CE docs link to EE wherever relevant. Increased visits to EE docs. => Done. Defaults to EE docs now (i.e. over 100% increase)
VP Prod: Ship paid subscriptions for GitLab.com. All EE features are behind subscription. Ability to buy higher storage limits. => Done. Storage limits deprioritized.
Data and Analytics Architect: Data and Analytics vision and plan signed off by executive team NOT STARTED
Data and Analytics Architect: Create a user journey funnel NOT STARTED
CMO: Educational Email campaign series to educate users on full solution capabilities and how to get started. TODO # of campaign conversions => Issue board anniversary awareness campaign on blog and social. Initiated CI webcast series.
CMO: 3 minute video product demo targeted at buyer audience. Published => Not completed
PMM: Sales Demo easy to give. At least one Account Executive can do it in 10 minutes.=> Not completed
CRO: Sales Pitch Deck and Messaging trained. 75% of customer facing team passes test. ACHIEVED
VP Prod: Conversational Development Index in product and SFDC. => Done
VP Prod: Improve JIRA support. Better than Bitbucket. Support transitions, references and development panel. => Done: dev panel, references. Not possible yet: transitions.
Technical writing: Create a page on our JIRA integration and how to move to Issues. 100% increased usage of JIRA integration. => Done. % TODO
Objective 2: Popular next generation product.
CEO: GitLab.com ready for mission-critical tasks. 99% of user requests have first byte < 1s
Production: Scalable and HA setup for cache and background jobs storage.
Persistence of cache (Redis) and background job storage (Sidekiq) split and
HA is set up for persistent storage. => Done.
Production: Robust backups with automatic periodic restores. Counter on
dashboards.gitlab.com shows days since last automatic restore of database and file
system. => Backups are tested but restores are not automatic, and counter is missing.
Production: Multi-canary deployments enabled. PoC of two canaries via kubernetes with Distribution team's Helm charts. => One canary available, not via kubernetes.
Production: Enable GitLab.com search using ElasticSearch. Provide a cluster that is 99% available for > 2 months in Q3. => Infrastructure available but application requires further work.
Database: Run pgbouncer from Omnibus. Shipped. => Done
Database: Use Omnibus provided software for HA / failover instead of using a GitLab.com specific setup. Shipped and In Use. => Not yet in use.
VP Eng: Enable High Availability
Platform: Enable graceful degradation when file servers are down. => Circuitbreakers built but not yet fully deployed.
Platform: Support multiple Redis clusters for persistent and cache stores. => Done.
Platform: Use Geo DR to move between clouds and Area Zones => 10% done, begin testing with Geo testbed, pushing to Q4.
Support: Improve GitLab provided debugging tools. We'll log all times we need terminal access and create an issue for each to improve GitLab tools. => 50% done, see https://gitlab.com/gitlab-com/support/issues/754
Prometheus: Reach parity with Prometheus metrics for Unicorn, Sidekiq, and gitlab-shell. Deprecate InfluxDB. => 30% done with Prometheus metrics for Unicorn. Sidekiq and gitlab-shell remain for Q4.
Gitaly: Gitaly service active on file-servers. => Done.
Gitaly: Roll out Gitaly migrations. 24 additional endpoints migrated to Gitaly and in acceptance testing. => Done.
Gitaly: Reduce “idea to production” time of migrations. 80% of all migrations started in Q3 are enabled on GitLab.com within two GitLab releases. => Done by changing process.
Database: Reduce the p99 of SQL timings across the board to 200 ms (100-200 ms less than what we have now). => Significant progress, but not all p99 < 200 ms. See gitlab-ce#34535 for more context.
Production: Provide reliable internal & external
baseline monitoring of overall service health. Implement baseline end to end
monitoring for GitLab.com (api/web/git(ssh/https)) and define
SLO’s
based on this baseline. => Baseline not defined.
Production: Solve performance issues. Implement CDN for GitLab.com. => CDN was implemented but had to be rolled back.
VP Eng: Lower latency in application
Discussion: Solve performance issues. Reduce p95 of discussion-related actions with over 10 hits/day to < 1 s. Reduce p99 to < 3 s. => 25% done. 10% (~150 of 1476 endpoints) still exceed thresholds. http://stats.gitlab.com/1902794 is at 1.2 s.
Platform: Solve performance issues. Reduce p95 of platform-related actions with over 10 hits/day to < 1 s. Reduce p99 to < 3 s. 25% done. 10% (~150 of 1476 endpoints) still exceed thresholds.
Frontend: Do a Manual performance audit and deploy improvements. Implement Top 3 actions => Done
Edge: Enable Bullet by default on the CI. => May not be practical given https://gitlab.com/gitlab-org/gitlab-ce/issues/30129#note_35800389
VP Eng: Eliminate critical stability issues
Discussion: Merge requests get merged 100% without ever getting into stuck locked state => 20% done. Improvements made in https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/13207, but still occurring. We need to measure rate.
Platform: Project authorizations fast (< 1 s) and consistent (requires no manual refreshes). DONE
Platform: Project imports and forks complete 100% without ever getting stuck => 10% done. Import issues need to be broken out separately.
Platform: Namespace and project renames work 100% of the time => 30% done. Requires hashed storage support
Platform: Repository cache state eventually consistent within minutes (no manual expiration needed) => In progress with https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/14980
Security: Improve security practices through people and processes. Backlog of security issues reduced by 50% (currently 148 issues in gitlab-ce, 9 in gitlab-ee, 69 on infrastructure). => Not done, backlog is larger.
CEO: Increased usage of idea to production. 100% growth
CMO: Better explain our solution, features and value proposition. Flow page that links to feature pages. => New home page with new content for 7 steps launched.
Propose optimizations of critical user flows based on results found in research.
Implement optimization and re-measure to ensure the user experience has improved.
Frontend: Optimize Frontend Code to support speed. For larger projects and ones with thousands of comments. => Done a lot of Performance related optimisations, ongoing task
Distribution: Simplify HTTPS configuration. In Omnibus and Helm. For Rails app, container registry, and pages. Consider Let's Encrypt.
Dir Partnerships: First team of OSS projects starts using GitLab for proof-of-concept/testing at Drupal, Gnome and Kubernetes.
Dir Partnerships: Get major partner to use it for CI.
CMO: More contributors from the wider community each month. Unique contributors grow 10% QoQ => Missed.
CMO: Initiate AR engagement with key analysts and achieve Leader in the Forrester Wave CI research report. => Leader in Forrester CI Wave. Account engagement with Forrester/Gartner. Analyst day and multiple briefings.
VP Eng: Make sure existing features are used by GitLab.com. Cycle time analytics working.
Support: GitLab.com uses Service Desk. In use for one process. => Set up for Security, but not in use. Legal is using Service Desk.
Distribution: Deliver service specific Docker images and Helm charts usable for GitLab.com and our users. Rails, Workhorse, Pages, Registry, Gitaly, Shell.
CI/CD: Help GitLab.com use our deployment features. CD/Kubernetes/Helm/Canary deploys/Review Apps/Service Desk
UX: Make it easier to find and use advanced GitLab features => 25% Implemented https://gitlab.com/gitlab-org/gitlab-ee/issues/3054 which was then reverted. Successfully implemented https://gitlab.com/gitlab-org/gitlab-ee/issues/3049
Frontend: Support > 2000 comments/code changes on issues, diffs, and merge requests. With speed and without jank. => 60% done. Needs work on MR discussion.
Frontend: Reduce frontend render times of comments and diffs with a goal of %70 faster. => https://gitlab.com/gitlab-org/gitlab-ce/issues/4058 Speed Index Before 8081, Now 2757 (65% faster)
Frontend: Repo as editor => PoC Done, move to Beta as a stable feature in progress
Frontend: Get a moonshot (e.g. VSCode/Monaco editor, Team dashboards) from PoC to Feature - Image Comments released + Multi file editor Beta in 10.3
Objective 3: Great team.
CEO: Effective leadership. NPS of leaders as rated by their reports 10% improvement. Update: This will be pushed back until 360 reviews are established in 2018.