Serverless servers: Efficient serverless Node.js with in-function concurrency

Vercel has introduced a new version of its serverless functions with support for in-function concurrency, offering significant efficiency improvements and cost reductions. The product is optimized specifically for interactive workloads such as server-rendering of web pages, APIs, and AI applications. In-function concurrency allows a single function instance to handle multiple calls simultaneously, potentially cutting costs by up to 50%. Vercel's private beta customers have reported efficiency improvements with some seeing up to a 50% reduction in compute usage. The new architecture enables automatic scaling, maintenance handling, and transparent security updates for operating system and runtime without any downtime or work for users.