Home / Companies / DigitalOcean / Blog / Post Details
Content Deep Dive

Server-Side Tools Are Now Available for DigitalOcean Inference Engine

Blog post from DigitalOcean

Post Details
Company
Date Published
Author
Musa Malik
Word Count
783
Company Posts That Month
10
Language
English
Hacker News Points
-
Summary

DigitalOcean has introduced Server-Side Tools in Public Preview for its Inference Engine, allowing AI models to access real-time information and perform actions directly from within inference requests without requiring additional infrastructure. These tools enable functionalities like web search and web fetch, powered by Exa, providing live data access and retrieval from URLs or documents, which is beneficial for applications needing current information. They also support integration with existing Anthropic and OpenAI tool conventions, allowing for seamless operation within the DigitalOcean ecosystem. Additionally, Server-Side Tools facilitate grounding AI responses in user-specific data through DigitalOcean Knowledge Bases and MCP Servers, connecting models to internal systems and databases. The tools are available via the DigitalOcean Model Access Key, with no need for new credentials, and are supported across various inference services like Serverless Inference and Dedicated Inference, aiming to simplify the deployment and scaling of intelligent applications.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
MCP 4 6,026 689 188 -15%
Kubernetes 1 1,993 294 100 +1%
Real-time 1 5,457 1,338 238 -5%
Serverless 1 1,011 235 82 -44%