Introducing Custom Servers: Deploy production-ready model servers from Docker images

Baseten introduces Custom Servers, a feature that allows developers to deploy production-ready model servers directly from any Docker image using just a YAML file. This new capability complements Truss Server, which is ideal for Python-based serving without writing server code. Custom Servers are best suited for pre-configured images like vLLM or proprietary Docker images. With full support for Baseten's suite of infrastructure optimizations, developers can easily convert any existing Dockerized model server into an elastic autoscaling service.