Observability: A Manifesto

Observability, as distinct from traditional monitoring, is the capability to ask new questions of a system without modifying code or gathering new data, focusing on unknown-unknowns rather than known-unknowns. It involves understanding system internals by querying external data, which is crucial in managing complex systems. True observability requires access to raw, unaggregated data, support for high-cardinality dimensions, structured logs, and incorporating observability directly into the development process. It empowers engineers to take ownership of their systems by providing timely, relevant information needed for informed decision-making. Observability is about mastering and comprehending the systems engineers build, ensuring they can make informed decisions based on real data rather than assumptions.