September 2016 Summaries

PagerDuty's technical integration community is expanding with the addition of MxToolbox, a tool designed to address email issues and block spam, as a new partner. MxToolbox integrates with PagerDuty to manage web infrastructure incidents by providing capabilities such as triggering, acknowledging, and resolving alerts. The integration enhances the alert management process by offering features like instant notifications for security concerns and streamlined routing of alerts. MxToolbox's monitoring solution, MxWatch, plays a crucial role in maintaining server uptime and online reputation by continuously monitoring DNS, blacklists, and mail servers, thereby ensuring systems remain accessible and functional. This collaboration aims to provide businesses with improved control and efficiency in handling infrastructure alerts and maintaining system integrity.

PagerDuty's recent updates have introduced several enhancements designed to improve incident management and workflow customization. Key features include the Response Mobilizer, Response Bridge, and Response Notes, which streamline the process of managing major incidents by facilitating collaboration and ensuring comprehensive documentation. The platform's Workflow Extensions now allow for easier configuration of third-party integrations, including a Slack Extension for improved communication and Add-Ons for embedding tools like Datadog dashboards directly within PagerDuty. Additionally, Live Call Routing and Persistent Conference Bridge features enhance the real-time response capabilities. The PagerDuty App for ServiceNow v3.1 has also been updated to support the Helsinki and Geneva versions, allowing for seamless incident resolution across both platforms. These updates, demonstrated in the "What's New" webinar, highlight PagerDuty's commitment to delivering a more efficient and integrated user experience.

PagerDuty, as a strategic partner of Microsoft, offers an integration that enhances incident management workflows within Microsoft environments, particularly for enterprises transitioning to hybrid cloud models using Azure and other Microsoft tools. This integration allows seamless connectivity between systems like Systems Center Operations Manager, Operations Management Suite, and Azure, enabling a comprehensive view of hybrid infrastructures. Through webhooks, alerts from Azure, OMS, and Visual Studio Team Foundation Server can trigger incident responses in PagerDuty, which notifies the appropriate team members via various communication channels. Additionally, users can incorporate Skype for real-time collaboration and embed PagerDuty information in SharePoint for easy access to on-call schedules and contact details. PagerDuty's platform supports customization and quick setup with existing Microsoft credentials, and its capabilities are showcased at Microsoft Ignite, where attendees can explore its features and integrations in more depth.

Managing an ITOps team effectively requires establishing Key Performance Indicators (KPIs) based on actionable data, especially as teams expand with evolving responsibilities and resources. Utilizing an incident management platform like PagerDuty can transition incident response from reactive to proactive by providing valuable analytics for measuring team performance and effectiveness. This platform allows for identifying top contributors and setting up incentive programs to motivate engineers, such as rewarding those who acknowledge and resolve the most incidents, thereby boosting productivity and maintaining service level agreements (SLAs). By opening data to the team, self-policing becomes possible, encouraging accountability and transparency, and preventing issues like engineer turnover due to lack of recognition. Leveraging these analytics can address operational and management challenges, ensuring both efficiency and satisfaction within the team.

On-call engineers play a vital role in incident management by serving as first responders who can significantly influence the outcome of critical incidents. Whether part of a small or large organization, having a clear and structured process for selecting and equipping on-call engineers is crucial. These engineers need to quickly assess the severity of incidents and mobilize appropriate resources, requiring a solid understanding of system functions and the ability to distinguish between normal and malfunctioning states. In smaller teams, the on-call role is often rotated to distribute the load and maintain skills, while larger teams may have dedicated incident managers. It's important to have a secondary on-call engineer for escalation, using tools like PagerDuty to manage role rotations and ensure backup response. On-call engineers must be well-trained, capable of following protocols, and prepared with tools such as checklists to efficiently handle incidents. The process involves identifying and logging incidents, categorizing and prioritizing them based on impact, notifying relevant personnel, and troubleshooting as needed. This structured approach helps minimize downtime and allows teams to focus more on development rather than firefighting.

PagerDuty has prioritized simplifying incident lifecycle management through seamless integration with diverse infrastructure stacks, emphasizing an open platform that works with various tools to enhance digital transformation for DevOps and ITOps teams. With over 175 native integrations, PagerDuty's platform supports operational reliability and agility by providing easy-to-configure and manageable solutions. At the PagerDuty Summit 2016, Amazon Web Services (AWS) and Datadog were recognized for their exemplary integration partnerships. AWS Cloudwatch, awarded the Partner of the Year Silver Award, is popular among customers for enabling quick resolution of IT incidents by delivering extensive metrics and ensuring strong alignment between product development teams. Datadog, the Gold Award recipient, excels in aggregating data across distributed and cloud environments, allowing seamless incident management and real-time alerts, thus continuing to deliver significant value and investment in enhancing integration for PagerDuty users.

PagerDuty has enhanced its Slack integration by introducing Workflow Extensions, a feature that allows seamless real-time collaboration and incident management within Slack without needing to manually configure webhooks. This update not only elevates the ChatOps experience by integrating PagerDuty updates directly into Slack discussions but also introduces user association between Slack and PagerDuty, enabling users to link their accounts and manage incidents as if using PagerDuty's native apps. The integration respects user permissions and provides comprehensive analytics, reflecting actions taken from Slack, thus improving response times and maintaining operational metrics. This refined integration is designed to streamline workflows and improve mean time to resolution (MTTR) by allowing teams to collaborate more efficiently. To explore these new capabilities, users are encouraged to reconfigure their Slack extensions using the updated guide and instructional video provided by PagerDuty.

PagerDuty has introduced Workflow Extensions to enhance its platform's extensibility, allowing both developers and non-developers to easily configure and customize incident response workflows by integrating existing tools. This development aims to shift the focus from merely ingesting data to optimizing the entire incident management process by embedding functionalities such as live service metrics from Datadog and integrating discussions on Slack or HipChat. The long-term vision for these extensions is to position PagerDuty as a central hub for discovering and adding new functionalities, enabling users to enrich their incident management workflows without additional costs across all plans. The initiative reflects PagerDuty's continuous commitment to developer success and platform extensibility, encouraging feedback from users to refine and enhance the feature further.

In the digital era, maintaining competitiveness and a customer-centric approach places significant pressure on ITOps and DevOps teams, which was highlighted at the PagerDuty Summit 2016 through the PagerDuty Operational Excellence and Innovation Awards. The awards recognized organizations like Yelp and Dropbox for their operational maturity and innovative use of PagerDuty's platform, with Yelp improving global site availability and incident response, and Dropbox enhancing incident management and team efficiency. Similarly, Etsy and GitHub were commended for their inventive incident management strategies, with Etsy leveraging real-time collaboration and actionable data to improve incident response, and GitHub using custom dashboards and integrations to maintain high uptime and operational health. These awards celebrated companies that excel in digital transformation by effectively managing complex technology stacks and ensuring seamless customer experiences.

In the fast-paced environment of incident response, effectively communicating the current state of an incident is crucial for quick resolution, especially as more responders join in. While chat platforms are commonly used to facilitate collaboration, they often fail to efficiently establish common ground for new responders, prolonging the time to resolution. In response to this challenge, organizations like PagerDuty are introducing new capabilities to streamline communication during incidents by implementing dedicated roles such as an Incident Scribe, who captures essential actions and decisions in real-time. This approach allows for a more efficient onboarding of new responders and aids in creating a concise, curated timeline for post-mortem analysis, moving away from the ineffective and noisy chat timelines traditionally used.

The PagerDuty Summit was a dynamic event featuring 12 sessions and 20 speakers, drawing significant interest from attendees who were eager to engage with the industry-based content and enjoy social interactions. The event was highlighted by keynotes from Jennifer Tejada on digital transformation, Gene Kim on DevOps learnings, and a fireside chat with Maynard Webb on industry trends. Attendees were also treated to various breakout sessions from tech giants like Google, Twilio, and IBM, discussing topics ranging from chaos engineering to agile transformation. New product features were unveiled, including Workflow Extensions and Live Call Routing, enhancing operational efficiency and incident management. The event concluded with a lively panel featuring representatives from companies like Slack and Airbnb, discussing ops transformation and the importance of team happiness as a business metric. Additionally, PagerDuty acknowledged customer and partner achievements through awards, celebrating innovation and operational excellence. The summit underscored the significance of digital experiences and the critical role of DevOps in maintaining system reliability, ensuring that new features and insights gained during the event would be instrumental for attendees moving forward.

PagerDuty's introduction of Live Call Routing enhances its incident management capabilities by allowing calls and voicemails to be efficiently routed to the appropriate responders based on existing schedules, escalation policies, and customized contact methods. This new feature ensures that callers, whether internal users or customers, can connect directly with on-call responders or leave messages that automatically generate incidents, integrating seamlessly with existing tools like Slack and ServiceNow. Live Call Routing reduces mean time to acknowledge and resolve incidents by providing a direct line for high-value customers and supporting international communication with local numbers. As the first pure platform extension, it enables users and partners to develop sophisticated workflow extensions, positioning PagerDuty at the core of operations and incident response optimization. The feature's successful launch was supported by feedback from a beta testing phase, reinforcing PagerDuty's commitment to rapid incident resolution.

PagerDuty Summit, held in San Francisco, was conceived as a free, innovative conference aimed at providing valuable insights and guidance for organizations looking to enhance their digital transformation efforts without focusing solely on vendor pitches. The event featured prominent speakers such as Jennifer Tejada, Gene Kim, and Maynard Webb, who shared key insights on DevOps and IT operations, aiming to equip attendees with knowledge to improve their operational environments. In addition to the rich content from industry leaders, the summit introduced new PagerDuty features like Live Call Routing, Response Notes, and Workflow Extensions, designed to enhance incident management and resolution for organizations. The event also highlighted the contributions of partners like Amazon Web Services, Evident.io, Datadog, and Threat Stack, emphasizing the collaborative effort in delivering world-class solutions. Attendees were encouraged to engage in live discussions and follow updates on social media, with promises of more in-depth content to be shared throughout the week.

A decade ago, challenges in IT operations, particularly in forecasting and cost allocation, were often referred to as a "black hole" due to their complexity and opacity, a problem that persists despite advancements in DevOps and agile methodologies. This difficulty is rooted in human biases, as described by Frederic Bastiat, where visible features are overestimated and unseen operational factors are undervalued, leading to planning and measurement challenges. PagerDuty addresses these issues by focusing on three key areas: people, data, and tools. By optimizing personnel engagement, improving information quality through data, and ensuring seamless integration with existing tools, PagerDuty aims to prevent and resolve IT incidents efficiently. The company's approach is designed to enhance the operational resilience and effectiveness of IT teams, ensuring that both visible and unseen aspects of operations are adequately managed.

Amid the excitement of space exploration, such as the Juno spacecraft's mission around Jupiter, parallels are drawn to the challenges faced in IT Operations, which also require robust planning and tools to manage intense environments. The article highlights the evolution of PagerDuty after acquiring Event Enrichment HQ, focusing on enhancing incident response capabilities with event management improvements. A significant advancement is the creation of the PagerDuty common event format (PD-CEF) to structure and normalize alerts, enabling the development of new tools like an event rules engine for alert classification and suppression. This approach aims to transform non-actionable alerts, previously considered "noise," into valuable indicators of potential issues, allowing for a deeper understanding of IT infrastructure. As PagerDuty prepares for its upcoming summit, the company emphasizes its commitment to lean and agile methodologies, integrating event and incident management to provide more context and understanding of business impacts.

PagerDuty Summit is an upcoming event that promises to bring together industry leaders and technology partners to address the challenges of digital transformation and modern operations environments. Scheduled for September 13th, the summit will feature renowned speakers such as Gene Kim, author of The Phoenix Project, and Maynard Webb, Chairman of Yahoo!, along with experts from major companies like Google, Twilio, and IBM. Attendees will have the opportunity to learn transformative business strategies, participate in sessions to earn exclusive PagerDuty swag, and access a limited number of copies of Gene Kim’s forthcoming book, The DevOps Handbook, with a chance for a book signing. With registration still open, the event aims to equip participants with valuable insights and tools to navigate the evolving digital landscape.

VMworld 2016 was a bustling event with over 20,000 attendees, showcasing groundbreaking innovations in technology, notably VMware's "Cross-Cloud Architecture" which facilitates application management across multiple public clouds like AWS, Azure, and IBM Cloud. PagerDuty's presence highlighted its ability to integrate various tools into a central hub for efficient incident management, greatly benefiting ITOps and DevOps teams by swiftly routing critical issues to the appropriate responders. Demonstrations included integrating with the VMware stack, showcasing live incidents from vCenter, and configuring email integrations with components like ESXi and AirWatch to maintain uptime for essential applications. Many attendees recognized the potential value in adopting PagerDuty to streamline their operations and enhance business agility, marking the event as an opportunity for sharing insights and fostering partnerships to drive digital transformation.

Modern business operations increasingly demand agility and self-service, prompting a shift from traditional IT operations to a more hybrid and agile infrastructure framework. While legacy IT systems have historically ensured business continuity, evolving customer and partner demands necessitate a reimagining of IT operations to maintain competitiveness. The process begins with understanding current technology impacts through assessment and personnel interviews, potentially revealing transformative insights. Asset discovery tools, like Remote Monitoring & Management and cloud resources such as UpGuard, aid in identifying which legacy infrastructures can transition to a modern stack. A crucial component is the creation of a services layer, abstracting static systems to an API layer, allowing better resource consumption and avoiding the need for specialized support. Implementing new tools, such as incident management platforms and public cloud resources, enhances management and visibility, supporting the transition to a modern IT environment. Effective implementation requires robust methodologies and security measures to handle hybrid environments while maintaining control and service standards. As organizations strive for greater speed and responsiveness, ITOps must ensure seamless service delivery, performance, and security, even as they integrate new systems alongside critical legacy components. With a well-structured framework of discovery, tools, methodologies, and security, legacy ITOps can successfully adapt to the demands of modern IT operations.