July 2024 Summaries

Ollama has introduced tool calling support for popular models like Llama 3.1, enabling these models to answer prompts using various tools, which enhances their ability to perform complex tasks and interact with the outside world. Users can provide a list of available tools through the tools field in Ollama’s API, allowing models to execute functions such as checking the weather or interpreting code. Supported models will respond with a tool_calls response, and tool interactions are facilitated through messages with a tool role. Additionally, Ollama offers OpenAI compatibility, allowing seamless integration with models such as Llama 3.1 via an endpoint. Future improvements include the ability to stream tool calls for faster action and to force models to use specific tools. The company invites feedback from users through Discord or email to refine and expand these capabilities.