Designing A Workflow Engine from First Principles

The talk discusses the requirements for a workflow engine, including task queues, timers, consistency, scalability, sharding and routing, system workflows, and external workflow and activity implementations. It introduces Temporal, an open-source implementation of these concepts, which aims to provide a simple, scalable, and consistent workflow engine. The talk covers the history of Temporal, its programming model, and how it solves common problems such as consistency, scalability, and sharding. It also discusses the importance of transactions, the transactional "Outbox" pattern, and the use of indexing components like Elasticsearch for workflow visibility. Additionally, the talk touches on system workflows, Temporal's architecture, multi-cluster deployment, and high availability. The presentation concludes that Temporal provides a highly scalable and consistent workflow engine with flexibility, making it an attractive option for developers.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.