Easy Embeddings Indexing Pipelines with Redpanda and Neon
Blog post from Neon
This blog post discusses how to set up an embeddings indexing pipeline using Redpanda and Neon without writing any code. The process involves reading data from Redpanda, computing embeddings using Ollama, and writing output into Neon for efficient storage and querying of embeddings. Redpanda's compatibility with the Apache Kafka® protocol ensures smooth data ingestion and handling, while Neon's serverless Postgres architecture and pg_vector extension provide efficient storage and querying of embeddings. This setup simplifies the process of building indexing pipelines, making them scalable and high-performing for various applications such as e-commerce transactions or customer reviews.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Vector Search | 15 | 3,701 | 290 | 90 | +59% |
| Serverless | 5 | 676 | 180 | 85 | +28% |
| RAG | 3 | 1,966 | 260 | 82 | -21% |
| Data Pipeline | 2 | 1,437 | 344 | 74 | +109% |
| Real-time | 1 | 4,377 | 976 | 225 | +49% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.