When the slow thing is not the model
Blog post from Pydantic
During a Black Friday scenario, a LangGraph workflow experiences timeouts on 8% of requests due to a slow service among 14 being called, with Redis identified as the culprit. The Pydantic Logfire platform, equipped with a Services view and a topology graph, efficiently navigates through service traces to pinpoint issues, illustrating how Redis calls took 11 seconds and caused delays. The platform enables users to seamlessly trace requests, errors, and latencies across services, offering a unified interface that integrates service maps into the live view for effective troubleshooting. This approach allows teams to quickly identify and resolve bottlenecks, like a Redis cache warming failure, restoring normal operations with just a few clicks.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 1 | 5,172 | 1,006 | 220 | -43% |
| OpenTelemetry | 1 | 701 | 153 | 53 | -26% |
| Vector Search | 1 | 2,091 | 556 | 118 | -8% |