Modal Blog - Plushcap

Blog URL

modal.com/blog

Posts YTD

49 ↑ vs 45 last year

Avg Posts/Month

3.8 since 2023

Monthly Post Volume

Start year: 2023 2024 2025 2026

Post Details

Search:

Title	Author	Published	Words	HN Pts
What is Flux Dev?	Kenny Ning	2024-10-17	469	--
Top open-source text-to-speech libraries in 2025	Yiren Lu	2025-03-10	876	--
How Modal speeds up container launches in the cloud	Yiren Lu	2024-08-16	1,082	--
Top embedding models for RAG	Yiren Lu	2024-10-30	557	--
A1111 vs ComfyUI	Kenny Ning	2024-08-23	640	--
RabbitMQ vs. Kafka: choosing the right messaging system	Yiren Lu	2024-09-25	920	--
How Contextual AI automated CI with Modal GPUs	-	2024-09-18	740	--
Google Cloud Run vs. Cloud Run Functions: understanding Google's serverless offerings	Yiren Lu	2024-09-25	757	--
How OpenArt scaled their Gen AI art platform on hundreds of GPUs	-	2024-11-20	620	--
A10 vs. A100 vs. H100 - Which one should you choose?	Yiren Lu	2025-01-27	844	--
Why Substack moved their AI and ML pipelines to Modal	-	2024-05-20	453	--
Best open-source LLMs in 2025	Yiren Lu	2025-03-10	1,344	--
Fast, lazy container loading in Modal.com	Jonathan Belotti	2024-09-08	2,582	--
How Suno shaved 4 months off their launch timeline with Modal	-	2024-02-21	509	--
Open-source AI agents	Kenny Ning	2024-09-23	692	--
Build interactive workflows using Kestra and Modal	Anna Geller	2024-10-15	1,883	--
Introducing: Region selection	-	2024-05-13	481	--
Inside the Modal Code Playground	Rachel Park	2024-08-16	672	--
How Ramp automated receipt processing with fine-tuned LLMs	-	2024-03-26	517	2
Google Cloud Run functions pricing: understanding costs and optimization	Yiren Lu	2024-09-25	742	--
Batch processing vs. stream processing by example	Yiren Lu	2024-09-04	615	--
Dogfooding Modal: What we learned at our internal hackathon	-	2024-12-09	611	--
WireGuard at Modal: Static IPs for Serverless Containers	Eric Zhang	2024-12-02	3,035	125
How to get GPUs with a Jupyter notebook on Modal	Yiren Lu	2024-09-15	261	--
Introducing: L40S GPUs on Modal	-	2024-12-19	466	--
Beating Proprietary Models with a Quick Fine-Tune	Jason Liu	2024-04-26	2,384	6
Stable Diffusion 3.5 vs. Flux	Yiren Lu	2024-11-02	643	--
How to deploy code in AWS Lambda: the easy way for beginners	Yiren Lu	2024-09-14	752	--
How to deploy a Gradio app	Yiren Lu	2024-09-15	632	--
Run GPU jobs from Airflow with Modal	Kenny Ning	2024-06-20	1,664	2
Best practices for serverless inference	Yiren Lu	2024-09-25	636	--
How to run Ollama	Yiren Lu	2024-09-15	537	--
How to run XTTS	Yiren Lu	2024-09-15	460	--
How to run Llama 3.1 as an API	Kenny Ning	2024-09-18	396	--
What is Flash Attention?	Yiren Lu	2024-10-16	627	--
Glossary: LLM fine-tuning hyperparameters	Yiren Lu	2024-10-15	681	--
All the open-source Whisper variations	Yiren Lu	2024-08-15	703	--
How much VRAM do I need for LLM model fine-tuning?	Yiren Lu	2024-09-01	393	--
vLLM vs. TGI	Yiren Lu	2024-10-15	541	--
ChatTTS: Running an open source text-to-speech model	Yiren Lu	2024-09-15	498	--
Llama3-405B: How to run an extra large open source LLM on Modal	Yiren Lu	2024-09-15	515	--
Upload files to S3 with AWS Lambda and AWS API Gateway in …	Yiren Lu	2024-09-04	640	--
How a top tier European soccer team sped up their data processing …	-	2024-12-04	525	--
Fine-tuning vs. RAG	Yiren Lu	2024-10-15	1,523	--
How much VRAM do I need for LLM inference?	Yiren Lu	2024-09-01	261	--
Top ComfyUI custom node packs	Kenny Ning	2024-11-12	874	--
Embedding English Wikipedia in under 15 minutes	Jason Liu	2024-01-23	2,433	7
Top embedding models on the MTEB leaderboard	Yiren Lu	2025-01-27	701	--
Top 5 serverless GPU providers	Yiren Lu	2024-09-27	857	--
How much is an Nvidia H100?	Yiren Lu	2024-08-15	531	--
AWS Lambda vs. Google Cloud functions: a comprehensive comparison	Yiren Lu	2024-09-25	853	--
How much is an Nvidia A100?	-	2024-10-31	794	--
Top open-source text-to-video AI models	Yiren Lu	2024-10-30	563	--
Best frameworks for fine-tuning LLMs in 2025	Yiren Lu	2025-01-27	614	--
Create an infinite icon library by fine-tuning Stable Diffusion	Yiren Lu	2024-05-21	2,435	--
How to run cron jobs	Kenny Ning	2024-04-30	681	--
Create a custom video generator by fine-tuning a Mochi LoRA on Modal	-	2024-11-26	640	--
Building a cost-effective analytics stack with Modal, dlt, and dbt	Kenny Ning	2024-09-10	2,487	--
Modal is SOC 2 Type II Compliant	-	2025-01-02	216	--
Top image segmentation models	Yiren Lu	2024-10-30	648	--
Dagster vs. Airflow: a comprehensive comparison	Yiren Lu	2024-09-25	767	--
LoRA vs. QLoRA: Efficient fine-tuning techniques for LLMs	Yiren Lu	2024-08-22	757	--
Product Updates: Directory Snapshots, GLM-5, billing updates and more	--	2026-03-04	583	--
Directory Snapshots: Resumable project state for Sandboxes	--	2026-02-24	994	--
Seamless computational bio at Chai Discovery	--	2026-01-15	942	--
Introducing: Modal 1.0	--	2025-06-09	913	--
How Hunch supercharged AI workflows with Modal Sandboxes	--	2024-05-23	762	--
Product updates: WebSocket support, interactive commands & more	--	2024-02-15	219	--
Press release: Modal Labs announces Series A financing round	--	2023-10-10	798	--
How Reducto improved enterprise-scale document processing latency by 3x	--	2025-11-19	803	--
Host overhead is killing your inference efficiency	Charles Frye, Nathan Wang, Timothy Feng	2025-11-18	1,605	3
Product Updates: Updates to Volumes, JS and Go SDKs, and more	--	2025-10-31	546	--
One-Second Voice-to-Voice Latency with Modal, Pipecat, and Open Models	Ben Shababo	2025-11-04	2,683	3
How Decagon shipped real-time voice AI on Modal	Richard Gong, Timothy Feng, Cyrus Asgari	2025-11-13	890	--
How Zencastr transcribed hundreds of years worth of audio in just a …	--	2025-08-28	916	--
Modal + Datalab: Deploy high-throughput document intelligence in <5 minutes	--	2025-10-29	811	--
Modal + Mistral 3: 10x faster cold starts with GPU snapshotting	--	2025-12-02	521	--
Agents need good developer experience too	Michael Waskom, Rebecka Storm	2025-11-20	104	3
Modal's Series C: Raising $355M at a $4.65B valuation	--	2026-05-21	1,015	2
Introducing Modal Auto Endpoints: Optimized inference you actually own	--	2026-06-23	1,524	19
Inkling by Thinking Machines now available on Modal	--	2026-07-15	647	--
Kimi K3 by Moonshot now available on Modal	--	2026-07-27	558	4
Butter is joining Modal	--	2026-04-10	207	--
Justin Dignelli joins Modal as VP of Sales	--	2025-09-22	643	--
Product updates: Modal Notebooks, sandbox idle timeouts, and more	--	2025-09-19	530	--
Product Updates: RTX Pro 6000 Blackwell, Command K, Sandbox FS API and …	--	2026-04-07	791	--
How to achieve truly serverless GPUs	Charles Frye, Jonathan Belotti, Erik Bernhardsson, Akshat Bubna	2026-05-12	4,960	4
Jamsocket is joining Modal	--	2025-07-10	295	--
How we used evals and inference-time compute scaling to generate beautiful QR …	--	2025-07-02	2,706	5
Product updates: Logs v2, live container profiling, and region selection on all …	--	2025-02-14	385	--
Achieve state-of-the-art inference latencies with speculative decoding	--	2026-06-24	2,040	--
Product updates: GPU memory snapshots, notebooks, service tokens, and more	--	2025-08-11	560	--
Unpacking sandbox startup latency: why started ≠ ready	--	2026-06-22	1,481	4
Beat GPT-4o at Python by searching with 100 dumb LLaMAs	--	2024-08-05	1,575	4
Press release: Modal signs strategic collaboration agreement with AWS to deliver accelerated …	--	2024-11-24	453	--
Modal Sandboxes are generally available	--	2025-01-21	1,070	2
Our first brand campaign	--	2025-04-15	271	--
Runway chooses Modal to power real-time inference for Runway Characters	--	2026-03-26	411	--
Modal is expanding in Europe with our new London office	--	2026-09-02	628	--
Accelerating AI research that accelerates AI research	--	2026-02-25	1,896	3
Build an AI coding platform that scales to millions of monthly sessions	--	2025-09-22	840	1
Scaling reinforcement learning at Applied Compute	--	2026-05-20	895	--
Tidbyt is joining Modal	--	2024-11-07	276	1
Product updates: VM Sandboxes, Lower latency routing, RBAC, and more	--	2026-06-15	876	--
Building with Modal and the OpenAI Agents SDK	--	2026-04-15	2,756	--
Dollars per token considered harmful	--	2025-07-16	1,187	4
Modal is now generally available	--	2023-10-10	1,100	11
Modal is SOC2 compliant	--	2023-06-15	193	--
Product updates: L40Ss, proxy auth tokens, and sandbox disk snapshotting	--	2025-01-21	545	--
Twirl is joining Modal	--	2025-05-28	327	--
Boost your throughput with dynamic batching	--	2024-09-16	857	--
Autoscaling Autoresearch: Give your agents elastic GPUs on Modal	--	2026-04-14	1,680	--
Transcribe speech 100x faster and 100x cheaper with open models	--	2025-07-23	2,301	4
Building an RL theorem-proving workflow on Modal	--	2026-04-29	2,237	--
Product updates: Rollbacks, batching, sandbox tunnels & more	--	2024-09-06	291	--
Product updates: Static IP proxies, Slack integration, live usage dashboard & more	--	2024-11-08	408	--
Qwen3.8-2.4T-A95B now available on Modal	--	2026-08-12	188	--
Multi-token Residual Prediction	--	2026-07-01	2,790	--
Why you should move your ETL stack to Modal	--	2024-04-18	1,297	--
Introducing Claude Managed Agents with Modal Sandboxes	--	2026-05-19	1,027	--
Modal named to 2024 Enterprise Tech 30 list by Wing	--	2024-04-10	383	--
Product updates: Running batch jobs with 1M inputs, ephemeral apps, and a …	--	2025-04-17	411	--
Introducing Notebooks	--	2025-09-09	1,000	4
Product updates: Multi-node training clusters, B200 and H200s, and Client 1.0 release	--	2025-07-11	473	--
A note on the Hugging Face agent incident	--	2026-07-29	168	--
Product updates: Price drops, brand refresh, and image-to-video example	--	2025-03-17	263	--
Real-time inference for robots at Physical Intelligence	--	2026-04-08	657	--
Product updates: Cloud buckets, Okta SSO & more	--	2024-05-07	341	--
Modal supports HIPAA compliance	--	2024-09-04	485	--
Introducing: H100s on Modal	--	2024-02-06	312	--
We open sourced the GPU Glossary	--	2025-02-21	338	--
Quail: Speeding up AI-SQL by jointly optimizing query planner and inference engine	--	2026-09-24	4,194	7
How to serve trillions of tokens for trillion-parameter coding agents	--	2026-09-23	7,266	4
Product updates: Sandbox Sidecars, new models, a refreshed dashboard, and more	--	2026-09-14	1,335	--
How Botika runs full-stack generative AI on Modal	--	2026-09-02	1,102	--
Anthropic integration with Modal brings scalable compute to Claude Science	--	2026-06-30	1,028	--
Bringing serverless functions closer to the speed of wire	--	2026-08-04	1,180	--
Devin Outposts on Modal	--	2026-07-21	582	--
Scaling to 1 million concurrent sandboxes in seconds	--	2026-07-16	1,954	76
Modal is a computer	--	2026-07-09	1,469	--
How to price serverless GPUs	--	2026-07-06	1,613	--
Making FlashAttention-4 faster for inference	--	2026-06-11	3,284	4
Reinforcement learning is an infrastructure problem	--	2026-06-01	2,186	--
Role-Based Access Control for humans and agents	--	2026-05-27	535	--
Boosting multimodal inference performance by >10% with a single Python dictionary	--	2026-05-04	1,362	16
How Doppel eliminated ML infrastructure tax with Modal	--	2026-03-25	1,133	--
How Ramp built a full context background coding agent on Modal	--	2026-02-19	1,264	--
Try GLM-5.1, the new frontier of open intelligence, on Modal	--	2026-02-11	1,364	--
Product Updates: Modal in AWS & GCP marketplaces, Sandbox improvements, and more	--	2026-01-28	443	--
Announcing our $87M Series B	--	2025-09-29	788	3
Keeping 20,000 GPUs healthy	--	2025-12-28	1,977	134
Inside Modal Notebooks: How we built a cloud GPU notebook that boots …	--	2025-09-16	1,766	91
What is an AI code sandbox?	--	2025-07-24	1,990	--
How Modal powered 250,000 Lovable app creations in a weekend	--	2025-07-07	651	--
How Quora uses Modal to run thousands of Python sandboxes simultaneously	--	2025-06-30	619	--
Run FLUX.1-dev three times faster	--	2025-06-18	1,972	--
Modal SDKs for JavaScript and Go (alpha)	--	2025-04-30	640	2
Introducing: B200s and H200s on Modal	--	2025-05-30	695	1
Introducing Modal Batch: Process 1 million jobs with 1 line of code	--	2025-05-22	1,042	--
Modal's serverless KV store gets its limit raised to infinity	--	2025-05-20	852	2
How Lemon Slice built real-time generative video with Modal and Daily	--	2025-04-24	638	--
How sync. uses Modal to lipsync 100 hours of video a day	--	2025-04-18	625	--
Memory snapshots: Checkpoint/restore for sub-second startup	--	2025-01-28	2,020	9
Product updates: memory snapshotting, OIDC, async job queues & more	--	2024-12-28	367	--
What is LLM fine-tuning?	--	2024-12-10	2,845	3
The future of AI needs more flexible GPU capacity	--	2024-10-25	1,528	6
Hybrid search over California embeddings with Modal, MongoDB, and Clay	--	2024-09-24	699	--
GPU prices are falling...	--	2024-08-06	430	--
Product updates: Datadog integration, lower function latency & more	--	2024-07-09	323	--
Competitive prompt engineering	--	2024-07-03	585	--
Introducing: WebSockets on Modal	--	2024-02-27	562	--
Speculation Is All You Need	--	2026-06-19	3,830	4
How to catch crypto miners using syscall signatures	--	2024-06-06	1,504	7
Modal Clusters are generally available	--	2026-10-01	1,643	--
Runtime Roundup: VM Sandboxes, Multi-node clusters, and more	--	2026-10-03	372	--
Sidecars: A low-latency trust boundary for Sandboxes	--	2026-10-03	1,380	--
VM Sandboxes: Full computers for agents	--	2026-10-03	1,021	--
Modal's serverless Servers	--	2026-06-25	2,361	4
Linear programming for fun and profit	--	2025-05-07	1,681	11
GPU Memory Snapshots: Supercharging sub-second startup	--	2025-07-30	1,269	9
Lambda on hard mode: Inside Modal's web infrastructure	--	2024-03-14	3,883	11
We reverse-engineered Flash Attention 4	--	2025-09-26	4,193	5
'I paid for the whole GPU, I am going to use the …	--	2025-02-24	3,021	5

Plushcap, by Matt Makai. 2021-2026.