Behind the music: How Chartmetric is scaling music analytics with ClickHouse

Chartmetric, a platform for music analytics, successfully transitioned from Postgres and Snowflake to ClickHouse Cloud to improve its data processing capabilities, achieving significant enhancements in query speed and storage efficiency. This migration was driven by the need to handle an ever-increasing volume of data from streaming services and social media, which had outpaced the scalability of their previous systems. By leveraging ClickHouse, Chartmetric reduced storage needs by 10 TB and accelerated query processing, allowing them to efficiently manage a 5.5 billion-row playlist cache that ingests over 15 million new records daily. The transition involved innovative approaches like using projections for efficient data retrieval and WHERE + IN filters to optimize memory usage. These changes have enabled Chartmetric to handle around 300,000 requests per hour and maintain a robust real-time analytics infrastructure. The move has not only improved operational efficiency but also reduced costs, with ClickHouse proving to be an ideal solution for their time-series data needs. Chartmetric's experience underscores the platform's scalability and flexibility, which have become integral to their data stack, complementing other tools like Postgres and Snowflake.