Company
Date Published
Author
Akshay Gupta, Lead Data Engineer, and Priyanshu Sehgal, Sr. Data Engineer
Word count
1126
Language
English
Hacker News points
None

Summary

Merkle Science, an AI-powered blockchain analytics and predictive risk platform, helps various entities combat illicit activity in the expanding Web3 ecosystem by effectively managing vast amounts of on-chain data. Initially, they relied on a self-hosted ClickHouse setup to handle both OLAP and OLTP functions but found it cumbersome due to infrastructure demands and scaling challenges. In March 2024, the team transitioned to ClickHouse Cloud, alleviating the operational overhead and enhancing performance without compromising speed, which allowed them to focus on feature development and quickly adapt to evolving threats. The migration resulted in significant improvements in data ingestion processes, developer productivity, and system monitoring, enabling the team to innovate and scale seamlessly as blockchain adoption grows. With the cloud infrastructure in place, Merkle Science is positioned to manage up to 130 TB of compressed data, running over 18 million queries weekly, and is prepared to handle further increases in data volume without concern.