JSON mode and function calling are two new features introduced in the Together Inference API, designed to provide developers with more flexibility and control over their interactions with LLMs. JSON mode allows specifying a JSON schema for the output of the model, resulting in structured and predictable responses, while function calling enables intelligent output of JSON objects containing arguments for external functions defined by the developer. This feature is particularly useful when real-time data access or custom logic is required. The API supports these features in Mixtral, Mistral, and CodeLlama models with more coming soon. The introduction of these features aims to enhance the versatility and functionality of AI applications built on the Together AI platform.