LLMs belong in your backend

Neon has introduced AI Gateway in beta, positioning large language model access as a core backend service alongside its Lakebase Postgres database, Object Storage, Functions, and Managed Better Auth. Hosted on Databricks Foundation Model APIs infrastructure, the gateway provides a single Neon credential and OpenAI-compatible endpoint for accessing a catalog of proprietary and open-weight models, while retaining native provider routes for features such as OpenAI Responses, Gemini, and Anthropic Messages. Neon says usage is consolidated onto its invoice at providers’ published token prices without markup, with additional observability and spend controls planned. The service extends Neon’s branch-based development model by giving each database branch its own gateway host and lineage-scoped credentials, allowing preview, feature, and CI environments to isolate model calls alongside their data, files, functions, and authentication. Developers can enable the gateway through Neon configuration or the console and adapt existing SDK integrations primarily by replacing the API key and base URL; the company also offers templates for Vercel AI SDK and Mastra applications.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.