Introducing Scoring: Attach a verdict to any run
Blog post from Inngest
Inngest has introduced a new scoring API that allows developers to attach verdicts to any run or step in their applications, enhancing the ability to measure outcomes rather than just completion. This feature, step.score(), integrates directly into existing codebases, enabling real-time scoring of every run without the need for external observability tools or manual processes. By embedding the scoring mechanism within the execution layer, Inngest allows users to evaluate real data flows, ensuring that the scoring reflects actual outcomes rather than proxy indicators. The API supports deferred scoring, which can wait for external events to occur before assigning a score, and integrates with the new group.experiment() feature to evaluate different strategies in live production environments. This approach contrasts with traditional evaluation tools by eliminating the need to reconcile data across separate systems and reducing the cost and complexity associated with sampling and storing data externally. Scoring is available in beta with version 4.8 of the TS SDK, offering a seamless way for developers to implement outcome-based evaluations directly within their workflows.
No tracked trend matches for this post yet.