Company
Date Published
Author
The ClickHouse Team
Word count
2010
Language
English
Hacker News points
None

Summary

As a company rooted in open-source, Goldsky leverages Redpanda, Apache Flink, and ClickHouse to deliver a first-in-class blockchain analytics service. By transforming their data into the Avro format, they utilize Redpanda's tiered storage architecture to efficiently stream data to downstream destinations like ClickHouse. Apache Flink is used for processing, providing complex stream processing capabilities such as instream joins and TopN counts, while maintaining high insertion performance to ClickHouse. ClickHouse is chosen for its unrivaled query performance, cost efficiency, and enhanced SQL capabilities, making it ideal for analytics on large datasets. The architecture allows Goldsky to efficiently process and deliver any crypto dataset to potentially thousands of ClickHouse clusters, abstracting complexity through a simple interface or API. By utilizing this technology combination, Goldsky aims to provide a valuable illustration of the efficiency achieved when leveraging ClickHouse and their platform for blockchain analytics.