Company
Date Published
Author
Dieter Plaetinck
Word count
1242
Language
English
Hacker News points
None

Summary

Metrictank is developing a new feature called meta tags, sponsored by Bloomberg, to enhance the scalability and efficiency of their large-scale Graphite solution. This feature aims to address the challenge of adding numerous redundant tags to metrics without overwhelming system resources, by storing tags separately and associating them with metrics in a way that appears seamless to users. Unlike Prometheus, which requires explicit series joining for additional tags, Metrictank's meta tags offer a more transparent solution, allowing for native-feeling tags that facilitate filtering, grouping, and auto-completion without the need for explicit joins. The implementation involves using postings lists to link meta tag key/values to "metarecords," with an enrichment step to ensure the user experience remains smooth by adding meta tags as regular tags to returned series. The system is API-based, supporting operations like adding, removing, and managing tags across cluster nodes, and employs an eventually-consistent model for propagating tag rules. This development is seen as a significant advancement in providing a scalable and cost-effective way to enrich metrics with tags in Metrictank, aligning with customer demand and enhancing data querying capabilities in Grafana/Metrictank.