GitHub Availability Report: November 2022
Blog post from GitHub
In November, GitHub experienced two performance incidents impacting various services, including Packages, Pages, and Actions, with an additional incident affecting Codespaces in October. The first November incident on the 25th affected GitHub Packages and Pages, and further details on its causes will be provided in a January report. The October 26 incident was due to an outage in the East US region that impaired Codespaces' functionality, caused by a third-party database outage. GitHub is enhancing its database resilience by implementing regional replication and failover strategies to mitigate future disruptions. On November 3, GitHub Actions experienced delays due to a backup in the webhooks queue caused by an inefficient database query linked to high-volume API calls. GitHub has since optimized the query, reviewed endpoint rate limits, and increased throttling to prevent future issues, alongside conducting training for better incident response. For ongoing updates and insights into their improvements, GitHub encourages users to follow their status page and engineering blog.