March 2021 Summaries

Buildkite, a Rails-based application, faced the challenge of migrating its large PostgreSQL database from integer primary keys to bigint to prevent integer overflow, particularly in a critical table with over 2 billion rows. The team implemented a zero-downtime strategy by adding a new bigint column, writing to both the old and new columns simultaneously, and backfilling the bigint column in batches to minimize impact on production. This process involved creating triggers, using statement timeouts, and building indexes concurrently to avoid long transactions. After ensuring the new column's integrity with CHECK constraints, the final step involved swapping the columns and updating the primary key constraints, all while maintaining application functionality. With the primary table successfully migrated, attention turned to foreign keys and remaining tables, with plans to address these in future efforts.

Buildkite has recently been active with a blog relaunch, integration additions, and numerous feature updates. To keep their busy community informed about the latest news without overwhelming them with daily updates, Buildkite is launching a newsletter. The newsletter will provide information on what's happening at Buildkite, along with favorite blog posts, changelog updates, tutorials, and occasional amusing anecdotes. Subscribers can expect concise updates delivered to their inbox soon.

The text explores common mistakes experienced by engineers, such as deploying broken code or deleting databases, emphasizing the importance of vigilance and securing systems as one advances in their career. It highlights Buildkite's features designed to enhance security and access control, such as Human Gates (Block Step), which pauses execution until authorization is given, and the blocked_state attribute, which prevents merging pull requests without approval. Additionally, the text discusses the importance of a robust permission structure to manage access within organizations, noting that Buildkite offers Member and Team permissions to ensure only authorized personnel can make critical changes. The narrative underscores the significance of security and access control in engineering, suggesting future discussions on structuring permissions within Buildkite for different team needs.