Observe Opaque Services With OpenTelemetry eBPF + proxymock
Blog post from Speedscale
The guide presents a Kubernetes lab for investigating opaque services without modifying source code, combining OpenTelemetry eBPF Instrumentation (OBI) for kernel-level HTTP endpoint discovery, RED metrics, and distributed tracing with proxymock for recording and replaying real inbound and outbound traffic. Using a Go application with an undocumented-looking `/api/stats` route that calls `/v1/projects`, the lab shows how to capture request boundaries, preserve machine-generated query time windows, query Prometheus and Tempo through MCP tools, and determine that most observed request latency is spent in the downstream dependency. It emphasizes that telemetry attributes where time is spent, while recorded traffic establishes the concrete request-response contract and enables functional and load replay independently of telemetry. The workflow uses functional replay as a correctness gate before a 100-request load replay, clarifies that faster mocked replay reflects dependency isolation rather than application optimization, and recommends adding targeted source instrumentation only when boundary-level evidence cannot explain internal delays. It also outlines required tooling, pinned component versions, security and platform constraints for eBPF, and limitations involving kernels, encrypted or non-HTTP/1.1 traffic, Prometheus counter interpretation, and replay performance measurements.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| MCP | 20 | 8,729 | 854 | 211 | -20% |
| OpenTelemetry | 10 | 757 | 153 | 55 | -30% |
| Kubernetes | 5 | 3,490 | 385 | 112 | +26% |
| Observability | 3 | 3,175 | 737 | 186 | -24% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.