Observability Is About Confidence

Observability in production environments is crucial for understanding system behavior, yet it is often neglected or added retrospectively, which can result in a loss of context. The text proposes integrating observability into the development process similarly to how tests are treated, ensuring that instrumentation is added as features are developed, thereby maintaining context and enabling real-time monitoring. OpenTelemetry is recommended as a standard for tracing applications, which can enhance logging by showing correlations and relationships between operations. The concept of automatic instrumentation is introduced, allowing developers to instrument code without altering it, while manual or custom instrumentation can provide more detailed insights by adding specific attributes or creating new spans within the code. The combination of these approaches helps developers gain confidence in their systems by confirming expected changes and predicting production behavior, ultimately facilitating easier debugging. Emphasizing observability as part of the development workflow can transform it from a “nice to have” into a standard practice, akin to writing tests.