Bottled Water: Real-time integration of PostgreSQL and Kafka

Confluent has released an open-source tool called Bottled Water, which allows users to transform their PostgreSQL database into a stream of structured Kafka events. This enables change data capture for Postgres, allowing users to unlock the value in their existing data and build systems that can handle large amounts of data changes. The tool uses logical decoding, a feature introduced by PostgreSQL 9.4, to extract row-level change events from the database's write-ahead log. These events are then encoded in Avro format and sent to Kafka topics, where they can be consumed and processed by downstream systems. Bottled Water is designed to work with Confluent's stream data platform and provides a way to maintain a copy of your database in Kafka, making it easier to experiment with new analysis or data formats, and allowing for gradual migration from one system to another with minimal risk. The tool is currently alpha-quality software and is being released as open source to receive community feedback.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.