April Cool: 154 PR Merges
Blog post from Portkey
Portkey has been actively updating and expanding its features over the past month, with 154 pull requests resulting in 30 distinct updates, including new features like distinct IDs for feedback updates, saved filters for frequently used combinations, a "Do Not Track" option, a templating engine using MustacheJS, and Okta SSO support for enterprises. They hosted their first "LLMs in Prod" meetup in NYC, offering engaging conversations and attracting attendees from as far as Spain. A significant highlight is the partnership with F5 to integrate Portkey's observability suite and AI gateway with the F5 Distributed Cloud. Additionally, Portkey claims a potential 98% cost saving on LLMs with their FrugalGPT implementation guide and has expanded their documentation and feature set, which now includes support for custom LLMs and the latest Llama 3. They invite users to join their community to prioritize new features and engage with leading LLM practitioners.