May 2023 Summaries

In today's digital landscape, applications are integral to various business processes, and the seamless exchange of real-time data between them is essential for efficiency and accuracy. Traditional API methods enable application communication, but Webhooks provide a more immediate solution by acting as event-driven triggers that facilitate real-time data updates without constant polling. The integration of Webhooks with Orkes Conductor, a platform built upon the robust Conductor OSS, allows for faster development of distributed applications by enabling seamless connectivity with third-party systems. Webhooks in Conductor can initiate workflows or tasks based on events from external applications, as demonstrated through a workflow example using Postman. Security mechanisms such as header, signature, and challenge verification ensure secure Webhook endpoints. Furthermore, Conductor offers out-of-the-box integrations with various third-party applications, providing Webhook as a Service to streamline communication and automation across systems. This integration supports diverse use cases, including automated alerts, chatbot creation, and deployment notifications in platforms like GitHub, Slack, and Microsoft Teams, ultimately enhancing business efficiency and productivity.

In April 2023, the "Orkes Dev Meetup" series kicked off with an in-person event at Google RMZ Infinity in Bengaluru, India, focusing on microservices and distributed applications. Collaborating with Google Developers, this meetup attracted 90 participants, including professionals from top tech firms like Intel, Cisco, and Microsoft, who gathered to exchange ideas and enhance their understanding of distributed systems. Notable speakers included Joinal Ahmed from Google, who discussed microservices architecture and Google Cloud functionalities, Manan Bhatt from Orkes, who spoke on building distributed applications with Orkes Conductor, and Bimal Gupta from Cimpress, who highlighted the practical benefits of Conductor in workflow optimization. The event also featured networking activities to foster community engagement, and due to its success, Orkes plans more such meetups in various cities.

Microservices architecture, while offering scalability and independent deployment, introduces challenges such as managing distributed transactions across multiple services, each with its own database. Solutions like the rollback mechanism and compensation patterns are crucial in ensuring application reliability during failures. Orkes Conductor, enhancing the Netflix Conductor platform, facilitates these processes by providing a robust framework for managing distributed transactions, such as implementing the Saga pattern. This pattern allows for compensating transactions to maintain consistency and integrity across services. The Two-Phase Commit (2PC) protocol and the Saga pattern are explored as methods to handle distributed transactions, with the Saga pattern offering advantages like a centralized coordinator to manage transaction states and compensate in case of failures. Orkes Conductor's workflow orchestration capabilities, including failure workflows, enable efficient management of these compensation mechanisms, ensuring seamless recovery and application resilience.

Orkes Netflix Conductor, an open-source orchestration platform, was utilized to automate the upgrade process of multiple AWS-based EKS clusters, which was initially a complex and time-consuming task. By employing Conductor, Orkes was able to streamline the process, minimizing manual errors and enhancing efficiency, while ensuring the compatibility of dependencies and adhering to AWS's upgrade guidelines. The implementation involved designing workflows to oversee each upgrade step, conducting health checks, and notifying stakeholders, which was facilitated by Conductor's integration with communication channels like Slack and email. This automation saved hundreds of hours of manual work and provided a robust error-handling mechanism that automatically retried transient errors, ensuring a smooth and error-free upgrade process. The orchestration tool allowed Orkes to focus on strategic tasks by providing visibility and reliability throughout the upgrade, demonstrating its capability as an enterprise-grade solution for process automation and orchestration.

In April, Orkes shared significant updates in their monthly highlights blog, including a major revamp of their documentation site aimed at enhancing user understanding of Orkes Conductor. They introduced new UI enhancements for creating task definitions and actively participated in several events to engage with the community. Notably, Orkes took part in Microsoft Reactor, where their CTOs discussed building resilient distributed applications in the cloud, and they were involved in the Pune FOSS and GDSC WOW Pune events. The team also hosted their first in-person meetup in Bengaluru, focusing on event-driven distributed applications. Upcoming events include a virtual Conductor meetup with Netflix and presentations at the Gartner Application Innovation Summit and Microsoft Build. Orkes was featured in various industry spotlights, including Microsoft for Startups and the Andreessen Horowitz blog, highlighting Orkes Conductor's role in modern transactional stacks and VMware's use of Conductor for automation platforms.