How Zap.xyz Built a Serverless CDC Pipeline with Neon and Inngest

Zap.xyz is a new crypto aggregation platform that processes millions of messages from community channels like Telegram, and by tracking social sentiment and correlating it with on-chain trades, Zap tells you what’s trending in the crypto space and how that’s translating into market movement. To deliver real-time insights to crypto traders, Zap has to reliably capture and act on a huge stream of incoming messages. This all has to be done with a small team hyper-focused on shipping. Initially, Zap attempted to build their CDC pipeline on AWS, but they soon discovered the first hiccup - Aurora Serverless didn't natively support database change streams, forcing them to try to implement this on provisioned Aurora with AWS' Database Activity Streams and AWS SNS. However, adopting a new architecture using Neon, Inngest, and Vercel eliminated unnecessary infrastructure management while ensuring their system could scale. Each tool solves a key piece of the puzzle: Neon is a serverless Postgres database that eliminates manual scaling, Inngest provides an out-of-the-box CDC pipeline, and Vercel gives Zap the ability to deploy serverless functions with minimal overhead. With this new architecture, Zap can now focus on scaling without the pain of wrangling all the AWS tools.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.