August at Portkey: 2 BILLION Requests, Guardrails, Tracing, and More
Blog post from Portkey
Portkey has achieved significant milestones, processing over 2 billion requests since its inception just a year ago, and has released three major updates to enhance its platform. The first release, AI Guardrails, addresses unpredictable behavior in AI applications by introducing over 50 state-of-the-art guardrails for synchronous request routing. The second release, Conditional Routing, allows users to route requests based on specific conditions, such as data residency requirements or model preferences. The third release, Tracing, offers a chronological view of agent pipelines with Open Telemetry support for improved instrumentation. Additional updates include Single Sign-On, enhanced routing capabilities, and support for new AI models and integrations, such as Codestral Mamba, GPT-4o-mini, and Vercel. Portkey has also expanded its community engagement through meetups and webinars, while teasing upcoming features like advanced tracing and new tools.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Observability | 5 | 1,798 | 331 | 106 | +34% |
| AI Guardrails | 1 | 151 | 73 | 36 | -8% |
| LLM | 1 | 4,030 | 486 | 147 | +1% |
| OpenTelemetry | 1 | 580 | 57 | 26 | +101% |
| RAG | 1 | 1,966 | 260 | 82 | -21% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.