GitHub Availability Report: July 2022
Blog post from GitHub
In July, GitHub experienced a significant incident affecting Codespaces' performance for nearly six hours, with ongoing investigations to determine the underlying causes. Additionally, two incidents in June impacted multiple GitHub.com services, including a DNS record migration issue on June 28 that temporarily made Codespaces unavailable due to a failed load balancer update, and excessive load on a proxy server on June 29 caused by a data migration service's retry logic bug, which overwhelmed the database with requeue requests. The June incidents were mitigated by reconfiguring DNS settings and pausing customer migrations, while improvements were made to exception handling and retry logic to prevent future occurrences. GitHub is also exploring safer testing methods and investigating potential rate limit changes to enhance service reliability.