Company
Date Published
Author
Carlota Soto
Word count
902
Language
English
Hacker News points
None

Summary

Zap.xyz, a crypto aggregation platform currently in beta, has developed a serverless change data capture (CDC) pipeline using Neon and Inngest to efficiently process millions of messages from platforms like Telegram and soon Twitter. Initially, Zap attempted to use AWS for their CDC needs, but found the process cumbersome and time-consuming due to the lack of native support for database change streams in Aurora Serverless. Seeking a more streamlined solution, they transitioned to Neon, a serverless Postgres database that offers automatic scaling and connection pooling, and Inngest, an eventing framework that integrates directly with Neon's logical replication to trigger workflows without additional overhead. This setup enables Zap to focus on rapid development and product iteration, deploying serverless functions via Vercel for lightweight tasks, while dedicated servers handle high-volume events. This architecture allows Zap to scale effectively and maintain a lean infrastructure, aligning with their core philosophy of building fast and iterating often.