/plushcap/analysis/clickhouse/didi-migrates-from-elasticsearch-to-clickhouse-for-a-new-generation-log-storage-system

Didi Migrates from Elasticsearch to ClickHouse for a new Generation Log Storage System

What's this blog post about?

Didi, a globally distributed mobile transportation platform, has successfully migrated its log retrieval from Elasticsearch to ClickHouse, reducing hardware costs by over 30%. The company generates petabyte-level log data daily and needed a storage solution that could handle large data volumes, diverse query scenarios, and high QPS requirements. ClickHouse's distributed architecture, write performance, query performance, and storage cost made it the ideal choice for this migration. After the successful transition, Didi's ClickHouse logging cluster now has over 400 physical nodes, supporting approximately 15 million queries per day with a peak QPS of about 200. The new architecture involves only a single writing pipeline and simplifies operational processes.

Company
ClickHouse

Date published
April 19, 2024

Author(s)
Yuankai Zhong

Word count
2494

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.