Piper

Piper is a centralized version-control system developed and used inside Google to support software engineering at the scale of the company's monolithic source repository. It is not a consumer-facing commercial brand or an independently marketed software product. Instead, it is an internal engineering platform closely associated with Google's long-running practice of keeping much of its source code in one centrally managed repository. Google initially operated a central codebase using Perforce and developed proprietary caching techniques to make that arrangement workable. As the repository and engineering organization expanded, the scale of the system created requirements that could not be addressed adequately by a conventional single-server deployment. Piper emerged as Google's internally developed response to those requirements. Its purpose was to provide a source-control layer that could support a huge repository, many simultaneous developers, automated systems, code review, builds, testing, and geographically distributed infrastructure. The system is designed around a central repository rather than the fully distributed model associated with Git. Developers work with local views or working copies of files, retrieve changes made by colleagues, and submit modifications to the central system. Changes are subject to code review through Google's Critique tool before they can be committed. This workflow supports Google's preference for trunk-based development, in which most developers work against a shared mainline and branches are used primarily for release management rather than as the default personal workspace. Piper's scale has been described as exceptional. Material published about Google's repository reported that, by 2016, it contained approximately 86 terabytes of data, around two billion lines of code, and about nine million files. Approximately 25,000 developers contributed roughly 16,000 changes per day, while automated systems performed a further 24,000 commit operations. Read activity was measured in the billions of requests per day. These figures illustrate that Piper is primarily an infrastructure system for coordination and scale, rather than a conventional end-user development tool. The platform uses Google's distributed storage infrastructure. Its architecture originally relied on Bigtable and later incorporated Spanner, with data distributed across ten data centers and replicated using the Paxos consensus protocol. This design is intended to provide availability and consistency while allowing the repository to serve Google's globally distributed engineering organization. A major part of the Piper experience is Clients in the Cloud, or CitC. CitC combines a cloud-backed repository with a local FUSE-based filesystem. To a developer, it presents an ordinary working environment in which standard Unix tools can be used, while keeping the local material exceptionally small; published descriptions reported that an average local view could contain fewer than ten local files. File changes are represented through snapshots, making it possible to restore earlier states without requiring developers to create explicit snapshots. The cloud-oriented design also makes it easier to move between computers, share changes, and use Google's automated build and testing systems. Security is managed through broad internal visibility combined with targeted access controls. Most of the codebase was described as visible to Google's developers, while sensitive files were restricted; in 2016, such files were reported to account for less than one percent of the repository. Piper operations are logged, and mechanisms exist to remove accidentally committed files. The system therefore combines centralized control, extensive auditing, code review, and large-scale distributed storage. Public information does not establish Piper as an independently sold product, a standalone company, or a separately listed business.

Google has used a central source repository since its early development period. For more than a decade, the company relied on a Perforce installation supplemented by proprietary caching. That arrangement allowed Google to maintain a shared codebase, but the growth of the repository, the number of developers, and the volume of automated operations eventually required a purpose-built architecture. Piper was developed as Google's internal centralized version-control system to address those scaling constraints. The system's design reflects Google's preference for a single, shared repository and a tightly integrated development process. Rather than requiring each developer to maintain a complete independent clone, Piper provides access to a central repository through local working views. Developers can retrieve updates, modify files, and submit changes for review. Commits are gated by Google's Critique review system, connecting source control directly to the organization's engineering governance and quality-control practices. Piper's architecture uses standard Google distributed-storage technologies. The repository was originally associated with Bigtable and later with Spanner, with data replicated across ten data centers through the Paxos protocol. This infrastructure allows the system to operate across Google's global engineering footprint while maintaining a centrally coordinated view of source code. The developer experience was extended through Clients in the Cloud, commonly abbreviated as CitC. CitC presents a cloud-backed filesystem through a local FUSE layer, allowing developers to use familiar tools while avoiding the need to keep a complete repository copy on an individual workstation. Changes are represented as snapshots, which supports restoration and facilitates movement between machines. CitC also connects source access with automated build and test infrastructure. By 2016, public descriptions of Google's repository reported approximately 86 terabytes of data, two billion lines of code, and nine million files. The same account described roughly 25,000 contributing developers, 16,000 daily human changes, 24,000 daily bot commit operations, and billions of daily read requests. These figures positioned Piper as an extreme example of monorepo infrastructure and helped make Google's internal development model a subject of wider software-engineering discussion. Piper supports a security model in which broad internal access is combined with restrictions for sensitive material. Most source code was reported to be visible to developers, while less than one percent of files were access-controlled in the cited 2016 description. Operations are logged, and accidentally committed files can be purged. Public sources describe Piper primarily through Google's engineering publications and books; they do not document a separate commercial business, public customer base, independent corporate ownership, or a standalone product-marketing organization.

• 2020

  Piper and Critique discussed in Software Engineering at Google

  [3]Software Engineering at Google: Lessons Learned from Programming Over Timeoreilly.com

  The book Software Engineering at Google presented Critique and related development practices, providing further public context for the review-controlled workflow surrounding Google's internal source management.

• 2016

  Repository scale documented publicly

  [2]Why Google Stores Billions of Lines of Code in a Single Repositorycacm.acm.org

  A published account described Google's repository as containing approximately 86 terabytes of data, two billion lines of code, and nine million files, with tens of thousands of daily human and automated changes.

• 2012

  Windows and macOS support reported

  [1]Piper (source control system)en.wikipedia.org

  Public descriptions state that Piper, originally designed for Linux, supported Microsoft Windows and macOS from October 2012.

• Google's central-repository model predates Piper

  [1]Piper (source control system)en.wikipedia.org

  Google used a central codebase before Piper and relied for more than a decade on a Perforce installation supplemented by proprietary caching. The increasing scale of the repository led to the development of Piper.

An internal, centralized source-control and developer-infrastructure platform optimized for Google's exceptionally large monolithic repository, high concurrency, continuous code review, and trunk-based development.

• Centralized version-control system

  Piper

  Google's internal source-control platform for a very large centralized repository. Developers work against centrally managed files, retrieve updates, submit changes for review, and commit through an integrated engineering workflow. Piper is designed to handle high request volumes, large numbers of contributors, automated changes, access controls, audit logging, and geographically distributed storage. It is an internal system rather than a generally available commercial product.

• Cloud-backed developer workspace

  Clients in the Cloud (CitC)

  CitC provides a developer-facing view of Google's repository through a cloud backend and a local FUSE filesystem. It creates the appearance of a normal local workspace while keeping the local copy very small. File writes are mapped to snapshots, enabling restoration, computer-to-computer mobility, code sharing, and integration with automated builds and tests without requiring explicit synchronization of a full repository.

• Code-review workflow

  Critique integration

  Piper's development workflow requires changes to pass code review through Google's Critique tool before they can be committed. This integration makes review a required control in the source-management process and supports Google's predominantly trunk-based development model.

• 2020

  Piper sues Archer over trademark violation

  According to the article headline, Piper filed a lawsuit against the eVTOL startup Archer over an alleged trademark violation. The report, dated September 3, 2020, identifies Archer as an electric vertical takeoff and landing startup and characterizes the dispute as a trademark matter brought by Piper. The available headline does not specify the claims, the relief sought, or the outcome of the case.

  Source

Read more

• 2012

  Expand client-platform supportOther

  Background

  Piper was originally designed for Linux, while Google's engineering environment also included developers using other operating systems.

  Action taken

  Public documentation states that support for Microsoft Windows and macOS was available from October 2012.

  Aftermath

  The system could support a broader range of internal developer workstations, although public sources do not provide detailed adoption figures.

  Source

• Maintain a centralized monolithic repositoryStrategy

  Background

  Google's source repository and engineering organization grew beyond the practical limits of the company's earlier Perforce-based deployment and caching approach.

  Action taken

  Google developed and operated Piper as a purpose-built centralized source-control system, retaining a shared repository while adding distributed storage, review controls, and cloud-oriented developer access.

  Aftermath

  The approach enabled Google to continue trunk-based development at exceptional repository and contributor scale, while making Piper a widely discussed example of monorepo infrastructure.

  Source

• 2020.09.09

  Reported2020.09.09

  Wattbike receives £11.5 million investment from Piper[5]Wattbike获得Piper 1,150万英镑投资bikebiz.com

  Wattbike received an £11.5 million investment from Piper to support its forward growth plans. The investment was subject to FCA approval.

• 2020.09.03

  Reported2020.09.03

  Piper sues Archer over trademark violation[4]Piper sues Archer over trademark violationainonline.com

  Piper sued eVTOL startup Archer over an alleged trademark violation, according to the article headline.

Read more

1. 1Piper (source control system)en.wikipedia.org
2. 2Why Google Stores Billions of Lines of Code in a Single Repositorycacm.acm.org
3. 3Software Engineering at Google: Lessons Learned from Programming Over Timeoreilly.com
4. 4Piper sues Archer over trademark violationainonline.com
5. 5Wattbike获得Piper 1,150万英镑投资bikebiz.com