July 2021 Summaries

The report "The State of Digital Operations" analyzes PagerDuty customer data from January 2019 to April 2021, highlighting the increasing complexity and volume of digital operations in 2020 compared to 2019, and the resulting pressure on technical teams to maintain real-time incident response. It reveals a 19% rise in critical incidents, particularly affecting large enterprises and small businesses, and underscores the importance of digital operations maturity in managing these challenges. Improved metrics such as mean time to acknowledge and rate of acknowledgment suggest that continued use of PagerDuty enhances incident response capabilities. However, the report also highlights the risk of burnout and attrition due to increased off-hour interruptions, with a significant correlation between high off-hour incident loads and users leaving the platform. As businesses navigate the complexities of digital operations amidst rising customer expectations, investing in robust operational processes and intelligent platforms becomes crucial for managing incident response, protecting employee morale, and ensuring a strong digital presence.

The next-generation PagerDuty for Slack integration introduces several new features aimed at enhancing real-time operations and team collaboration. By enabling the creation of Slack channel connections via API, it allows users to connect Slack channels to PagerDuty services and teams, facilitating easier management of incident actions within Slack. The integration also simplifies the process for admins and account owners by centralizing management of Slack connections on a single page. New functionalities include filtering incident notifications by urgency, managing workspace connections, and creating team-to-channel connections to improve incident visibility and streamline remediation processes. Additionally, the integration supports many-to-many connections between Slack workspaces and PagerDuty accounts, ensuring all Slack users in an organization have access to incident information. The ability to create and view stakeholder updates directly from Slack further minimizes context switching and enhances incident communication. With the impending sunset of Slack V1, users are encouraged to migrate to the new webhooks to continue leveraging these advanced features.

The COVID-19 pandemic severely impacted the travel and hospitality industry, leading to a significant decline in global air passenger demand and millions of job losses, but as vaccination programs advance and restrictions ease, there is a noticeable revival in travel demand. Despite the downturn, digital transformation projects in the sector accelerated, with companies focusing on investing in technology to provide contactless and socially distanced experiences, such as app-led services for hotel check-ins. To manage the anticipated surge in travel demand, companies need to implement hypercare strategies—proactive measures to ensure system stability during peak traffic periods. Key aspects of hypercare include implementing a code freeze, practicing incident management, ensuring proper observability, and conducting load and chaos testing. These measures help businesses maintain system performance and customer satisfaction during high-demand periods, with digital operations platforms like PagerDuty offering support for real-time incident management and preparedness through their Hypercare Readiness Checklist.

PagerDuty's July Release introduces a range of updates and enhancements aimed at improving response times, communication, and cognitive load management through automation, machine learning, and AIOps. Key features include Runbook Automation for reducing manual tasks, Event Intelligence for better noise management, and new capabilities such as Outlier Incident detection and Change Correlation to quickly identify incident causes. The release also updates ChatOps integrations with Slack and Microsoft Teams for streamlined collaboration, introduces a new service setup flow, and upgrades the service profile for enhanced incident response. Additionally, the Webhooks V3 update offers improved delivery and security, while mobile app enhancements allow users to view past incidents for better triage. These improvements are designed to help teams act swiftly and efficiently during incidents, enhancing visibility and coordination.

CloudOps is experiencing growth, partly due to the accelerated shift to cloud computing driven by the pandemic, which enabled companies to innovate rapidly and optimize costs. A study commissioned by PagerDuty and conducted by IDC surveyed 802 global enterprises to assess CloudOps and incident management, identifying four maturity phases: Beginner, Intermediate, Advanced, and Expert. The study emphasizes that people are central to successful digital transformation and CloudOps adoption, requiring a cultural shift beyond the implementation of new tools. Strong leadership and collaborative skills are necessary to navigate the complexities of CloudOps maturity, with a focus on building specialized skills, training, and evolving team dynamics. Key accelerators for CloudOps maturity include hybrid approaches combining automation and AI, top-down cultural change, and adopting full-service ownership (FSO) to enhance reliability and efficiency. Organizations reaching Expert-level maturity see significant benefits, such as improved downtime avoidance, increased employee productivity, and faster time to market for new products. The study highlights that achieving such maturity levels is challenging and requires investment in people and organizational change.

PagerDuty Summit 2021 offered a range of virtual sessions focused on enhancing incident response and automation, with all sessions available on demand until July 25th. Key presentations included Marcelo LaRosa from Hudson's Bay Company discussing how alert noise suppression through effective alert management can free up teams to focus on critical tasks, and David Jambor from Vodafone highlighting the company's transition to a tech-oriented approach with Immutable Telemetry 2.0 to minimize customer impact through automation. Additional sessions provided insights into strengthening communication with PagerDuty Business Response and managing integrations, while new features such as Incident Context in MS Teams and Insights Previews in Slack were introduced to facilitate faster incident triage and collaboration. Attendees were also encouraged to explore new service profiles, participate in community challenges, and access a variety of resources through the PagerDuty Community.

Technical teams are facing increasing pressure to improve efficiency and reduce mean time to resolve issues, which is often hindered by complex and manual tasks. PagerDuty Runbook Automation aims to address these challenges by automating repetitive tasks to enhance productivity and service availability. The latest release, Rundeck 3.4.1, introduces a revamped user interface and new enterprise features designed to streamline configuration management, enhance security controls, and improve user experience. Key updates include a more intuitive interface, improved project management tools, enhanced security through PagerDuty V3 Webhook Signatures, streamlined configuration management, job queuing capabilities, and more granular access control lists for key storage. Additionally, new plugins with Thycotic and CyberArk have been introduced to bolster password management and protect privileged accounts. Rundeck has also transitioned its package repositories to a new hosting service following the end of Bintray Distribution support. These enhancements aim to assist organizations in accelerating digital operations and incident resolution while reducing dependency on experts.

PagerDuty has launched a $1 million funding initiative to support global COVID-19 vaccine distribution, particularly in underserved communities, by providing funding, product credits, and technical volunteer support to eight organizations. This effort aims to address vaccine accessibility and hesitancy in economically or socially marginalized populations, leveraging PagerDuty's digital operations platform to enhance real-time supply chain management and outreach. The funding is divided into two main pathways: Vaccine Access and Distribution, which supports tech-centric nonprofits like CareMessage, Turn.io, and WeRobotics to enhance communication and logistical capabilities; and Vaccine Equity, which aids community-led organizations such as Code Tenderloin, Code The Dream, and Doctors Without Borders to promote equitable vaccine dissemination through localized approaches. Additionally, PagerDuty co-launched the Go Give One Coalition campaign to further global vaccine equity, aiming to distribute vaccines to the most challenging regions through the COVAX Advance Market Commitment. This collaborative initiative seeks to mobilize resources and ensure that all individuals, regardless of location or socioeconomic status, have access to life-saving vaccines.

Digital transformation is crucial for various industries, including financial services, which face heightened demands for security and uptime due to their critical role in handling large-scale transactions and customer trust. PagerDuty, in partnership with AWS, offers solutions to enhance digital operations through effective alerting, automated incident responses, and secure DevOps practices. By integrating tools like Amazon's DevOpsGuru and EventBridge, PagerDuty streamlines incident management, ensuring rapid response and resolution times. This approach not only helps manage infrastructure or application errors but also addresses security breaches by automating responses and providing crucial diagnostic information to the right teams. The system also supports stakeholder communication during incidents, enabling seamless updates while allowing responders to focus on resolving issues. Through these integrations, PagerDuty and AWS empower financial organizations to adopt cloud technologies securely, maintain high service availability, and foster continuous improvement with blameless postmortems.

PagerDuty Summit 2021 highlighted the importance of automation in managing increasingly complex operational environments, with sessions available on-demand for further exploration. The summit showcased how integrating Rundeck with PagerDuty can streamline response processes by automating tasks, ensuring that human intervention is minimized to only necessary situations. Notable presentations included success stories from companies like Parsons and Trimble, which have utilized automation to enhance efficiency, reduce task completion time, and prevent burnout. The summit also introduced new features in Rundeck 3.4, emphasizing security and compliance improvements, and announced the upcoming availability of PagerDuty Runbook Actions, an advancement designed to enhance automation in response workflows. Participants can access the summit content online until July 25th and engage with the PagerDuty community for ongoing updates and challenges.

Emergency responders faced immense pressure during the COVID-19 pandemic, especially in low- and middle-income countries, where traditional communication methods like messaging services proved inefficient. Trek Medics, a non-profit organization, addresses this issue through its Beacon platform, which allows responders to coordinate and track emergency responses using mobile phones, regardless of internet availability. The platform is operational in 25 countries, including Puerto Rico, England, and Tanzania, and has managed over 100,000 calls in 2020. To enhance its digital operations, Trek Medics relies on PagerDuty, which centralizes and prioritizes alerts, enabling quick identification and resolution of issues. This integration ensures the uninterrupted functionality of the Beacon system, crucial for timely emergency responses. PagerDuty's partnership with Trek Medics not only streamlines their alert management but also supports their mission by providing cost-effective solutions, allowing them to maintain full operational capacity without financial strain. Looking forward, Trek Medics aims to further integrate PagerDuty with partner services to enhance proactive responses across the entire emergency response ecosystem.

In the complex landscape of cloud security, integrating context into security strategies is essential to effectively manage risk and prioritize security alerts. Security teams often struggle to provide comprehensive coverage across vast cloud environments, resulting in inefficiencies and developer frustration. Various tools like agents, network scanners, Cloud Security Posture Managers (CSPMs), and Cloud Workload Protection Platforms (CWPPs) offer visibility but lack the contextual depth needed to prioritize alerts effectively. Contextualizing risk involves assessing the severity, exposure, and potential impact of vulnerabilities to better allocate resources and address threats. Orca Security's platform enhances this approach by utilizing contextual factors such as cloud network accessibility and exploitation paths to refine risk scoring, reducing alert fatigue and enabling more targeted responses. By integrating with PagerDuty, Orca Security facilitates seamless communication and incident resolution, empowering DevOps teams to maintain robust security without hindering their workflow.