March 2022 Summaries

Conductor is a workflow orchestration engine designed to integrate microservices into scalable workflows, where each workflow consists of tasks executed by external workers, or microservices, which can be developed in any programming language. Previously, Java, Go, and Python SDKs facilitated app connections to Conductor, but now the platform has announced major enhancements to the Golang and Python SDKs and introduced new SDKs for C# and Clojure, with these SDKs relocating to a dedicated GitHub repository for faster development. The platform aims to simplify the process of connecting workers to tasks and polling for work through straightforward configurations, allowing developers to focus on business logic. Future plans include improving documentation, enhancing sample applications, and developing a JavaScript SDK, while Conductor continues to serve as an enterprise-grade platform for process automation, API orchestration, and more, with offerings like a Developer Edition sandbox and Orkes Cloud.

Microservices architecture is a popular strategy for building scalable and modular software applications by breaking down complex products into autonomous services, each responsible for specific business functions. This approach necessitates interaction between services to complete business processes, managed through workflows known as choreography or orchestration. Orchestration involves a central service that directs the execution of tasks among microservices, offering benefits such as centralized observability, error tracing, and scalable orchestration on cloud-native platforms. However, it has limitations, such as potential delays and dependency issues in synchronous workflows. The text highlights the importance of orchestration in modern software architecture, using Netflix's transition from choreography to orchestration as a case study, demonstrating how it enhanced process management and scalability. Despite its complexities, orchestration offers improved coordination and visibility for businesses managing numerous microservices, making it a valuable solution for ensuring seamless service interaction and adapting to growing business needs.

The author reflects on their experience with a project at AT&T called Video Optimizer, an open-source tool designed to improve mobile app efficiency and reduce network costs. Initially, the project struggled with a monolithic Java application that was difficult to manage and test, prompting a desire for automated analysis. In 2017, AT&T's initiative to transition large apps into microservices presented an opportunity for the team to restructure Video Optimizer into a more agile, cloud-based version with automated testing. Despite receiving funding and planning a microservices architecture, the project ultimately faced challenges due to inadequate workflow orchestration and reliance on proprietary infrastructure, leading to its eventual failure. The author suggests that using Netflix Conductor, which they learned about after joining Orkes, could have improved the project's success by effectively managing microservice communication and workflow orchestration.

The Conductor Playground is a new, fully managed, browser-based sandbox environment designed for developers to explore the Conductor microservices and workflow orchestration platform without the need for installations or configurations. Originally developed at Netflix, Conductor has been widely adopted for building applications across various scales and use cases. The playground allows users to create and execute their workflows within a dedicated namespace, offering a hands-on approach to learning and experimentation. It features pre-built workflows, such as the PopulationMaxMin workflow, which demonstrates the use of HTTP system tasks and JQ_TRANSFORM tasks to process data. Although the playground is not intended for production use, it serves as an introduction to Conductor's capabilities, with additional resources available for deeper exploration, including building workflows with external workers. Feedback from users is encouraged to help improve the platform, and developers can access further support through community channels and documentation.

Conductor, an enterprise-grade orchestration platform, is being utilized by banks like JP Morgan Chase and American Express to automate the complex lending processes inherent in the shift from traditional to digital banking. The platform facilitates the automation of lending workflows by evaluating customer details, credit scores, and other parameters to provide a streamlined decision-making process for loan approvals or rejections. In the outlined use case, Conductor manages tasks such as fetching customer details, verifying educational or employment information based on the loan type, assessing credit risk, and calculating loan specifics like principal and interest. The workflow dynamically adapts depending on the outcomes of these tasks, ultimately culminating in either the approval and transfer of funds to the customer's account or the termination of the process due to rejection by the bank or customer. Through its capabilities, Conductor addresses the need for enhanced security and efficiency in banking operations while accommodating the varied lending criteria across different financial institutions.