April 2015 Summaries

PagerDuty participated in the Knowledge 15 conference in Las Vegas, showcasing its integration with ServiceNow, a platform-as-a-service for IT teams focused on Everything-as-a-Service. The event highlighted the advantages of using PagerDuty alongside ServiceNow, where users can leverage robust on-call scheduling, notifications, and escalations to enhance ServiceNow's workflow and ticketing capabilities. Through a bi-directional integration, incidents can be managed in both systems, allowing users to customize alert preferences via SMS, phone, or email to ensure no tickets are overlooked. The flexibility of PagerDuty's alerting system was praised by users who appreciated its persistence and ability to integrate with various tools. Additionally, PagerDuty announced upcoming events and sessions, inviting attendees to explore further insights into their services and expertise.

Effective communication during critical incidents, such as system outages, is crucial for maintaining organizational efficiency and stakeholder satisfaction. The text emphasizes the importance of keeping internal stakeholders informed with concise updates on the severity and likely duration of the outage, as well as the efforts being made to resolve it. To manage this communication effectively, appointing an Incident Commander is recommended, who would issue regular situation reports company-wide. Being proactive in setting up communication channels, such as dashboards or status pages, before incidents occur can prevent communication breakdowns. Additionally, it's important to have a clear communication plan and to be responsive to further queries while balancing the need to focus on resolving the issue. By enabling stakeholders to access information independently, the entire company can align efforts towards resolving the incident efficiently.

Threat Stack has announced its integration with PagerDuty, allowing users to streamline their alerting process by connecting their Threat Stack and PagerDuty accounts through PD Connect and Integration API. This integration enables Threat Stack to provide enhanced monitoring, auditing, and alerting of cloud infrastructure by collecting data directly from the host kernel and enriching it with environment-specific metadata. Users can set a minimum alert severity to manage notifications and dismiss alerts from Threat Stack, which will then clear them from PagerDuty. The integration aims to offer flexibility in alert management, catering to different user preferences and needs, and reflects Threat Stack's commitment to enhancing its alert options.

PagerDuty's recent participation in AWS Summit London and Puppet Camp UK provided an opportunity to connect with international customers and showcase its global alerting capabilities. The company met with satisfied clients from both the UK, such as The Trainline, and US-based firms with international operations like Yelp and Jive. Attendees frequently praised PagerDuty's dependable multi-provider SMS, phone, push, and email alert system, which operates in over 175 countries and uses local numbers to avoid international fees. The service's UTF-8 support ensures accurate message rendering across diverse languages. At Puppet Camp, the focus was on how IT configuration can enhance operational efficiency, minimize errors, and boost company performance, with PagerDuty playing a crucial role in notifying the right responders during incidents to expedite recovery and enhance future prevention. PagerDuty is continuing its European outreach with upcoming appearances at Scala Days EU in June and Velocity Europe in October.

Application Performance Monitoring (APM) systems like AppDynamics provide detailed insights into IT infrastructure and can identify potential performance issues early on, but effective response is crucial to leveraging this information. PagerDuty enhances AppDynamics' capabilities by ensuring incidents are promptly noticed and addressed, helping businesses improve reliability and speed in resolving critical incidents. PagerDuty offers features such as custom on-call schedules, automatic alert escalation, and various notification options, along with smart alerting to minimize alert fatigue and collaboration tools to facilitate team resolutions. The integration allows AppDynamics to send incident details to PagerDuty, which then routes alerts to the current on-call personnel and escalates as needed, including incident details to help users quickly isolate root causes. AppDynamics, a user and partner of PagerDuty, has successfully utilized it for over four years to ensure incident management and accountability, expanding its use across Engineering and Customer Success teams. For further details and setup, users can download the PagerDuty plug-in and access resources like integration guides and live webinars.

PagerDuty's introduction of Multi-User Alerting in 2014 allowed incidents to notify and assign multiple users, necessitating changes in their data model and SQL queries to maintain performance. The migration involved shifting from a 1:1 to a 1:many relationship in their Rails app, impacting how incidents with different states—triggered, acknowledged, or resolved—were queried. While resolved incidents were unaffected by the change, triggered and acknowledged incidents required sophisticated SQL techniques to ensure efficiency. For triggered incidents, a LEFT JOIN was used to identify those with no acknowledgements, whereas acknowledged incidents initially faced performance issues with the DISTINCT keyword, leading to the adoption of a more efficient LEFT JOIN technique. This method, inspired by advanced SQL querying strategies, allowed for handling duplicates without performance degradation and preserved the correct behavior of aggregate functions like COUNT in Rails. The process highlighted the importance of profiling SQL queries and understanding query optimizers, showcasing the innovative solutions needed to enhance database performance for complex alerting systems.

PagerDuty recently attended the AWS Summit in San Francisco, an event that felt like a natural fit given the company's strong ties to Amazon Web Services, where their founders initially conceived the platform. The summit provided an opportunity for PagerDuty to engage with current users and discuss how the on-call performance platform aids in quickly resolving outages, with many conversations focusing on integrating their tools with monitoring partners like CloudWatch and Nagios. Attendees were also interested in exploring new features such as the Teams feature, Rich Events, Single Sign-On, and Analytics. The diverse range of participants, from small startups to large corporations like Nike, underscores the broad appeal and necessity of PagerDuty's solutions. The event also allowed PagerDuty to distribute popular swag, including emoji stickers and shirts, and the company expressed enthusiasm for future interactions at upcoming events like ServiceNow in Las Vegas and DevOps Days in Denver.

PagerDuty enhances incident management across organizations by enabling teams to resolve issues more efficiently through improved collaboration. Its new team organization feature simplifies cooperation among different groups such as Operations, Development, and Customer Support by reducing noise and preventing alert fatigue, allowing users to filter incidents, schedules, and services relevant to them. This feature also provides real-time insights into which teams are managing urgent incidents, enhancing communication and resource allocation, and offering internal stakeholders clarity on ongoing issues. By organizing services according to teams, companies can keep track of responsibilities and escalation policies, facilitating better team management and operational clarity.

The integration of PagerDuty with Webmon enhances website monitoring and incident management by allowing users to be promptly informed when online services experience downtime. Webmon offers a straightforward interface for monitoring websites, DNS servers, online transactions, and REST APIs, and it ensures zero false positives through real-time cumulative data analysis from multiple regions. Users can create custom rules to receive notifications about specific performance issues and utilize customizable dashboards to compare service metrics over time. The collaboration with PagerDuty allows Webmon users to enable seamless notifications and escalations, enhancing the accuracy and reliability of uptime and availability information. This integration can be easily set up through Webmon's account settings, providing a streamlined experience for managing website performance and incident response.

PagerDuty is excited to announce its participation in its first international conferences in London, including sponsoring the AWS Summit on April 15, 2015, and Puppet Camp on April 13, 2015. With a presence in over 110 countries and more than 350 UK customers, PagerDuty is eager to connect with its community alongside partners like Logentries, Chef, Datadog, and others. The company plans to engage with users and discuss incident response best practices and DevOps during these events. To celebrate the overseas visit, PagerDuty is hosting a gathering at the Fox ExCel on April 15, inviting attendees to RSVP to Melanie Salman for a casual networking opportunity.

Effective communication during critical incidents is crucial for operational success, particularly in a collaborative DevOps environment, as highlighted in this series on best practices for outage communication. The initial step involves ensuring that the right people are involved through clear processes for identifying and contacting subject matter experts, with tools like PagerDuty aiding in managing on-call schedules and contact methods. Documentation is emphasized as vital for capturing real-time decisions and information during incidents, with ChatOps being recommended for its ability to provide searchable, timestamped records of discussions that enhance accountability and post-resolution learning. Integrating tools and services into chat clients further streamlines incident response, allowing for real-time server updates and analytics contributions while recording chat logs for future training and post-mortem analyses. This approach not only improves the quality of communication but also facilitates the preparation of training materials and action plans, thus simplifying the onboarding of new team members.

PagerDuty recently hosted its first user group event at its headquarters, gathering a diverse range of customers to share best practices and engage in discussions about operational models and incident resolution strategies. The event highlighted the importance of quickly assembling the right team to address issues and tackled topics such as alert fatigue and improving alert quality. Notable contributions included Etsy's Ops Weekly tool, which enhances the on-call experience using the PagerDuty API, and Weebly's two-way integration between PagerDuty and Nagios. The event emphasized the value of user feedback in product development and encouraged attendees to share their innovations with the PagerDuty API. The company expressed eagerness to host similar user groups in other locations, inviting interested parties to reach out for future events.

PagerDuty introduces OkCats, a whimsical feature that embeds calming cat photos into incident alerts, aiming to soothe users during stressful moments like late-night alerts or when dealing with FOMO. The service integrates with PagerDuty-enabled platforms by extending the events API to include images and links to cat photos, which can be set up through the Add Service page. This playful addition is designed to make the experience of receiving alerts more pleasant by leveraging the comforting presence of cats, promising a fuzzier wake-up call at any hour.