Stream Binary Data with Protobufs and YugabyteDB Change Data Capture

Stream Binary Data with Protobufs and YugabyteDB Change Data Capture` Protocol Buffers are a Google-developed language-neutral, platform-neutral, extensible mechanism for serializing structured data. By leveraging the "bytea" column type in YugabyteDB, it is possible to store protobuf binary data efficiently. This post explains how to set up a YugabyteDB Change Data Capture (CDC) connector and run a separate microservice that reads messages from Kafka and re-creates protobuf messages using the stored binary data. The process involves creating a CDC stream, setting up a table with the bytea column type, defining a protobuf message definition, deploying source connectors, running a microservice to consume messages from Kafka, and performing operations on the created table.