Source OpenAI · Published · Open the original ↗
Lab notes
Scaling Git at OpenAI
How OpenAI built Pando, a Git-compatible backend designed for the scale of development that Codex makes possible.
By Aaron Friel, Taylor Blau, and Ted Nyman, Members of Technical Staff
Over the past year, the size and demands on our monorepo have increased at a staggering pace. It was clear that we needed to revamp our source control system to scale to the level of concurrent work that Codex makes possible.
We built Pando, a new backend for Git repositories, without interrupting any engineering work or changing how our team uses Git. Pando now powers all development in OpenAI’s monorepo. Pando is designed to meet two ambitious goals: first, horizontally scalable writes, optimized for concurrent pushes to many branches. And second, maximize read throughput, so clients can download data fast enough to fully saturate their available network bandwidth.
The opening of the post, quoted unchanged from OpenAI. The full text continues at the source.