Product updates: memory snapshotting, OIDC, async job queues & more

Modal announced upgrades and upcoming features aimed at improving AI and batch-computing workflows, including faster and more consistent beta memory snapshotting that can halve cold-start times for models such as Stable Diffusion, and planned async job queues supporting up to one million inputs. The platform now supports OpenID Connect for short-lived authentication tokens to access external services without long-lived credentials, as well as eStargz image compression to accelerate builds from registries such as ECR and Docker Hub. Recent client updates add detached app launches and expanded sandbox execution controls, while partnerships with Genmo and Chai Discovery simplify use and fine-tuning of open-source video-generation and molecular-prediction models. Modal also announced a multiyear AWS partnership enabling use of AWS Marketplace committed spend for GPUs, launched a YouTube channel with vLLM tutorials, and reported processing more than 40 billion inputs across over seven million apps in 2024.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.