GitLab World Tour - London, Oct 19th - Register here!   

Even the sharpest teams face minor setbacks when their code falls flat, or their team is just not in tune. O-boe-y, nobody wants that. Luckily, GitLab is here to pitch you an idea to help you boost your act.

We're kicking off the GitLab World Tour to help harmonize your development process because code is our forte. At this free event, we will explore how teams are using Git and other modern software development practices to work together and build amazing products. Software development is changing and with it, the way developers work. Today’s rapid pace of communication and innovation fosters creativity, collaboration, and information sharing; bringing ideas to life—faster. The GitLab World Tour is an interactive discussion on what's next for software development.

As Infrastructure Lead, my job is to make GitLab.com fast and highly available.

Lately, it's been a challenge. Why? We are hitting our threshold where scale starts to matter. For example, over 2,000 new repos are being created during peak hours, and CI runners are requesting new builds 3,000,000 times per hour. It's an interesting problem to have. We have to store this information somewhere and make sure that while we're gaining data and users, GitLab.com keeps working fine.

A large part of the issue we're running into as we scale is that there is little or no documentation on how to tackle this kind of problem. While there are companies that have written high-level posts, almost none of them have shared how they arrived at their solutions.

One of our main issues in the past six months has been around storage. We built a CephFS cluster to tackle both the capacity and performance issues of using NFS appliances. Another more recent issue is around PostgreSQL vacuuming and how it affects performance locking up the database given the right kind of load.

As outlined in our values, we believe we have a responsibility to document this so other companies know what to do when they reach this point. Last Thursday, I gave a GitLab.com infrastructure status report during our daily team call. Watch the recording or download the slides to see how we're working through our challenges with scaling.

Today we are releasing version 8.12.1 for GitLab Community Edition (CE) and Enterprise Edition (EE).

This version resolves a number of regressions and bugs in the recent 8.12 release.

Please read on for more details.