Company
Date Published
Author
Tyler Rockwood
Word count
1762
Language
English
Hacker News points
None

Summary

At Redpanda Streamfest, a session showcased the concept of Sovereign AI, emphasizing data security by keeping AI processing within local networks instead of sending data to external models. The demonstration involved building an e-commerce application using AI and Redpanda Connect, illustrating how to trigger personalized follow-up emails based on customer purchases without relying on public APIs. The process involves using Redpanda Connect to manage data ingestion into ClickHouse, compute vector embeddings, and perform vector searches to identify similar products for personalized marketing emails. The pipeline ensures transaction processing in real-time, utilizes local GPUs, and includes safety checks with LlamaGuard to ensure email content quality before sending, all while maintaining data sovereignty. The session highlighted Redpanda Connect's capabilities as a full-stream processor, supporting transactional guarantees, automatic retries, and extensive plugin options, with the entire setup available for experimentation through GitHub resources and further community engagement encouraged via Redpanda's Slack.