Unpacking Events: All the Better to Observe
Blog post from Honeycomb
Honeycomb emphasizes the importance of events as fundamental components for achieving observability in systems, defining an event as a "unit of work" that can vary in scope but generally manifests as either a trace span or a log event. For logs, the process of identifying events is straightforward, whereas for spans, Honeycomb equates one span to one event, enhancing system visibility through trace-aware instrumentation. Service owners can estimate Honeycomb usage based on their traffic patterns and the number of spans per service event, allowing a more precise calculation of observability needs. The process of instrumenting for high granularity initially is encouraged as it can reveal hidden bugs and inefficiencies, guiding further adjustments in instrumentation practices. Ultimately, the goal is to discern which traces are most valuable for ongoing monitoring and optimization, with Honeycomb providing support and resources for users to fine-tune their observability approaches.