Announcing function calling and JSON mode

JSON mode and function calling are two new features introduced in the Together Inference API, designed to provide developers with more flexibility and control over their interactions with LLMs. JSON mode allows specifying a JSON schema for the output of the model, resulting in structured and predictable responses, while function calling enables intelligent output of JSON objects containing arguments for external functions defined by the developer. This feature is particularly useful when real-time data access or custom logic is required. The API supports these features in Mixtral, Mistral, and CodeLlama models with more coming soon. The introduction of these features aims to enhance the versatility and functionality of AI applications built on the Together AI platform.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.