New in October 2023
Blog post from Baseten
This week, we overhauled the model management experience on Baseten, improving several core workflows to clarify the model lifecycle. We also shipped a new text embedding model that matches OpenAI's ada-002 in both context window size and benchmark performance. The new model management experience features improved deployability, scalability, and cost-effectiveness, including workspace API keys with more granular permissions and separate measurements for end-to-end response time and inference time. Additionally, the team at Baseten has refreshed their documentation with guides on various topics such as model inference, autoscaling, monitoring, and instance types. The company is also hosting a fireside panel on the state of open source ML in San Francisco and will be attending AWS re:Invent in NVIDIA's generative AI pavilion.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Vector Search | 9 | 1,707 | 204 | 87 | +14% |
| LLM | 2 | 2,873 | 275 | 108 | +35% |
| AI Model Fine-tuning | 1 | 534 | 112 | 64 | +7% |
| RAG | 1 | 749 | 104 | 39 | +61% |
| Real-time | 1 | 2,496 | 566 | 185 | +13% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.