The PagerDuty team integrated automated metric checks into their deployment process using Datadog, a cloud-based monitoring and analytics platform. The team initially used canary releases to limit the risk of introducing bugs and performance issues into production, but later adopted continuous deployment to automate the process. However, this shift led to a pivotal incident where a developer's change caused an issue that wasn't caught in time to halt the canary release. To mitigate this risk, the team automated the process of evaluating their canary releases by creating scripts to check key metrics using Datadog's Ruby client library. The team integrated these checks into their build and deploy pipeline and encouraged others to adopt a similar discipline by writing their own check scripts and integrating them into continuous deployment.