June 2018 Summaries

PagerDuty's engineering team is highlighted for its distinct practices and values that set it apart from other organizations, as illustrated through the experiences of Dileshni Jayasinghe, an Engineering Manager. The company emphasizes a "People First" approach, which includes fostering diversity, supporting personal development, and encouraging remote work. Engineers at PagerDuty have full autonomy over their projects, from inception to deployment, embodying a true DevOps culture. They practice continuous delivery without dedicated testers, relying on automation and tools like Canary Deployments to maintain high quality and reliability. Chaos Engineering is actively practiced in production to ensure platform resilience, with initiatives like Failure Fridays and Failure Anyday to test and improve systems. The incident response system is noted for its organized and calm approach, led by incident commanders, offering training that is open-sourced for anyone to access. Support among co-workers is strong, facilitated by agile teams, product owners, and specialized guilds, creating a culture of empathy and continuous learning. The company encourages engagement with the broader engineering community through events and personal interactions.

In the dynamic realm of entertainment applications, integrating DevOps practices and robust incident management has become crucial for overcoming challenges such as compatibility across diverse devices, managing large media files, and ensuring seamless streaming to millions of users. Notable industry players like Netflix, SoundCloud, and Spotify exemplify this approach by adopting microservices architecture, innovative authentication processes, and container orchestration, respectively. Netflix leverages microservices for greater velocity and reliability, tackling its inherent complexities with strategies like the monorepo model to maintain consistency while enabling team innovation. SoundCloud enhances user experience on devices like Xbox One by implementing secure token-based authentication, akin to two-factor authentication, to address cumbersome sign-in processes. Meanwhile, Spotify employs a phased rollout strategy using their tool Tsunami to manage Docker container upgrades, minimizing disruptions during updates. These companies highlight the importance of proactive quality assurance and incident management, utilizing tools like Netflix's Simone for device-specific testing and ensuring early bug detection. By embracing continuous delivery and phased releases, they mitigate potential issues and secure a high-quality user experience, illustrating how a modern approach to software delivery can transform the entertainment app landscape.

In a world where rapid response to digital incidents is crucial, PagerDuty offers a comprehensive digital operations management platform designed to not only address operational challenges but also to seize opportunities for innovation and customer satisfaction. The platform emphasizes the importance of adopting DevOps practices for collaboration, continuous delivery, and enhanced security while ensuring scalability through real-time work orchestration across complex teams. With over 300 integrations, PagerDuty's open architecture allows seamless interoperability with various technologies, supporting a cloud-native approach for faster innovation and data sharing. Furthermore, PagerDuty's Event Intelligence leverages machine learning and extensive data to significantly reduce digital noise and enhance incident resolution, proving beneficial for organizations including Fortune 500 companies.

At a PagerDuty Connect event in Toronto, DevOps expert Arthur Maltson highlighted how operations teams can learn from emergency responders' ability to manage noise and respond swiftly to alerts, drawing parallels to a firehouse incident he experienced. As enterprises grapple with increasing digital signals, there's a push to control this "noise" to prioritize critical alerts effectively, akin to creating phone-free spaces at events to enhance focus. Celebrities like Jack White have adopted this approach, collaborating with Yondr to foster distraction-free environments. In parallel, PagerDuty's Event Intelligence product aids IT and DevOps teams by using machine learning to filter essential alerts, improving response times and operational efficiency. This strategy not only enhances employee well-being and productivity but also drives innovation and reduces business disruptions. The broader enterprise can adopt these practices to focus on significant signals, fostering better real-time responses and healthier work environments across various departments.

PagerDuty initially relied on Ruby on Rails for development speed but faced scalability challenges, prompting a shift to Scala, which proved difficult due to its complex codebase and a stark contrast in culture compared to Ruby. The quest for a more suitable language led to the exploration of Elixir, built on Erlang's Virtual Machine, which offered modern, user-friendly features and exceeded expectations in performance and development speed. Implementing Elixir began with a pilot project involving Kafka integration, deemed successful due to its high value and manageable scope, encouraging further adoption across the company. Elixir's ease of use, robust platform, and supportive community, led by its creator José Valim, contributed to its growing popularity within PagerDuty, with many teams fully adopting it and others gradually integrating it into their workflows. Enthusiasm for Elixir is evident as PagerDuty continues to transition major functionalities to the language, anticipating its capacity to handle their traffic demands, and the company actively engages with the Elixir community through meetups and recruitment efforts.

In the evolving landscape of cybersecurity, companies like Datadog are adapting by integrating security into development and operations teams, highlighting the shift towards a DevSecOps model. This approach emphasizes shared responsibility for security, moving away from the traditional perimeter-focused strategy due to the rise of cloud, mobile, and web applications. As cyber threats increase, the need for rapid response and remediation becomes critical, with tools like PagerDuty being utilized for efficient alerting and incident response. The DevSecOps framework encourages organizations to adopt modern tools and processes, ensuring security decisions are made swiftly and at scale, which can lead to cost savings and reduced risks. By embracing DevSecOps, teams can enhance their incident response capabilities, providing faster feedback on security practices and fostering continuous improvement.

PagerDuty has introduced a new product called Event Intelligence, aimed at addressing the challenges organizations face in managing the overwhelming volume of data and alerts. As systems grow increasingly complex and headcounts fail to keep pace, enterprises struggle to sift through the noise of thousands or even millions of daily events. Event Intelligence tackles these issues by automating and improving the way alerts are managed, using advanced techniques like intelligent alert grouping and data science to correlate alerts and suppress unnecessary notifications. This approach not only reduces noise by 98 percent but also enhances responders' efficiency by providing them with relevant context and historical insights, ultimately saving time and improving incident response quality. The platform has received positive feedback from early-access users, who report that it has replaced manual triage processes and significantly improved their operational workflows. Now available to all customers, PagerDuty's Event Intelligence empowers teams to handle the increasing torrent of signals with greater focus and effectiveness.

Joshua Carnide, a fourth-year Software Engineering student at the University of Waterloo, shares his enriching internship experience at PagerDuty's Toronto office, highlighting the growth and learning opportunities he encountered. As part of the Mobile team responsible for enhancing PagerDuty’s Android and iOS applications, Joshua witnessed significant team expansion and participated in impactful projects that honed his skills in both iOS and Android development. He emphasizes the company's inclusive and diverse culture, which fosters an environment where interns are treated as full-time employees and encourages collaboration and mentorship. Joshua recounts his involvement in proposing a new architecture for the Android app, demonstrating the trust and responsibility placed upon him, and details the autonomy and decision-making power within the small Mobile team. He appreciates the opportunities for personal and professional growth, including learning Agile methodologies and engaging in co-working sessions, all of which contributed to his increased productivity and confidence in future engineering pursuits.