The Cost Crisis in Metrics Tooling

Charity Majors' whitepaper, "The Cost Crisis in Metrics Tooling," delves into the escalating costs and diminishing returns of metrics-based observability tools, which are becoming increasingly detached from the value they provide. The discussion highlights the complexities of managing costs associated with metrics, especially when considering the high volume of custom metrics generated by factors such as the number of hosts, endpoints, status codes, and aggregation methods. The paper argues that while metrics are a mature and widely used technology for monitoring systems, their reliance on time-series databases limits their contextual value, leading to unpredictable and often exorbitant costs. Majors suggests that a shift towards relational data storage is necessary to align costs more closely with value, as current practices can lead to significant expense increases without corresponding improvements in system understanding or debugging capabilities. The full whitepaper further explores how experienced teams manage these costs and the potential of observability 2.0 models, advocating for a more structured approach to logging and metrics usage.