Portkey & Patronus - Bringing Responsible LLMs in Production
Blog post from Portkey
Patronus AI, recognized as a leading platform for evaluations and guardrails in AI applications, has partnered with Portkey to integrate its advanced AI evaluators into the Portkey Gateway. This collaboration enables real-time monitoring of large language model (LLM) outputs for issues such as topic relevance, bias, and toxicity, while also evaluating parameters like conciseness and politeness. By simply adding a Patronus API key and setting up Guardrail Checks, users can seamlessly enforce LLM behavior checks and log results for each request. The Portkey Gateway, an open-source platform, allows users to create custom Guardrails, enhancing the scalability and reliability of AI applications by addressing unpredictable LLM behaviors. This partnership underscores a shared commitment to leveraging AI safely and efficiently, inspired by the positive symbolism of the Patronus from the Harry Potter universe.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 11 | 3,996 | 453 | 162 | -12% |
| Real-time | 2 | 2,938 | 776 | 217 | +27% |
| Observability | 1 | 1,340 | 245 | 91 | -23% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.