How Trigger.dev is using ClickHouse to scale observability for long-running AI workflows

Trigger.dev, founded in London in 2022, transitioned from using Postgres to ClickHouse to address scaling challenges and enhance observability of serverless asynchronous workflows as AI-driven processes became more complex. ClickHouse was selected for its performance, scalability, and open-source model, which aligned well with Trigger.dev's needs, providing real-time analysis capabilities and major storage efficiency gains. This move allowed Trigger.dev to separate analytical workloads from operational systems, thus improving reliability and visibility. The seamless migration allowed for continuous operation, enabling users to experience enhanced features without any disruption. By leveraging ClickHouse, Trigger.dev gained the ability to offer more detailed insights into workflow usage and performance, supporting its vision of creating an unrestricted dashboard experience for developers to explore task executions freely. This foundation is crucial as the company aims to cater to increasingly complex AI workflows, ensuring that developers maintain visibility and control over their applications' operations.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.