Home / Companies / Pydantic / Blog / Post Details
Content Deep Dive

Focus on evals with Logfire

Blog post from Pydantic

Post Details
Company
Date Published
Author
-
Word Count
801
Company Posts That Month
4
Language
English
Hacker News Points
-
Post removed?
No
Summary

Braintrust Pro and Logfire Growth are two pricing models for evaluation work that differ mainly in how they charge for score recordings. Braintrust Pro starts at $249 per month, including 5 GB of processed data, 50,000 scores, and thirty days of retention, with additional charges for scores, processed data, and retention once the allowances are exceeded. In contrast, Logfire Growth includes ten million observations and up to ninety days of retention without a separate score-specific fee, charging $2 per million observations after the first ten million each month. Online evaluators in both models can score every production trace, impacting costs with traffic increases, while offline suites run on a schedule with Braintrust imposing score charges beyond the included monthly scores. The Logfire Evals workspace aids in identifying changes by linking experiment summaries to specific cases and traces, offering tools for detailed analysis and comparison of evaluation results.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 1 1,189 251 109 -83%
OpenTelemetry 1 158 34 25 -85%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.