Company
Date Published
Author
Floyd Smith
Word count
1513
Language
English
Hacker News points
None

Summary

In this presentation, recorded shortly after SingleStore introduced SingleStore Pipelines, two SingleStore engineers describe SingleStore's underlying architecture and how it matches up perfectly to Kafka, including in the areas of scalability and exactly-once updates. They explain that SingleStore is a scalable SQL database with a distributed system that scales out on commodity hardware, making it fast and fun to use. The engineers discuss the technical details behind SingleStore Pipelines, which are their solution to real-time streaming analytics workloads, leveraging unique properties of their existing system to create a robust and scalable workflow. They demonstrate how to create pipelines using SQL commands and show how Kafka streams can be automatically distributed across the entire cluster, enabling efficient processing and transformation of data in parallel. The engineers conclude by highlighting the benefits of SingleStore Pipelines and providing a demonstration that viewers can try themselves using a free version of SingleStoreDB Self-Managed.