Today's Outage

A configuration error during an upgrade of GitHub's continuous integration setup inadvertently caused the production database to be erased and re-created, resulting in temporary data loss and inaccessible user dashboards and profiles. Although most of GitHub's data was restored from a backup, the large size of the "events" table delayed the process, and some recent data, such as pull request changes, might be irretrievable. The company plans to prevent future incidents by isolating test and production environments, reducing the size of the "events" table, and storing binlogs for better recovery options. GitHub acknowledges the inconvenience caused and offers support for users experiencing ongoing issues.