Announcing WarpStream Schema Validation

WarpStream has announced that its Agents can now connect to any Kafka-compatible Schema Registry and validate records against provided schemas, offering broker-side validation and improved data governance policies compared to existing solutions. This feature enables centralized schema validation, reducing the risk of incorrect data being written to Kafka from producers and ensuring that only compatible data is processed by consumers. WarpStream's solution allows for elastic scaling of its Agents, which can be scaled based on CPU utilization, and isolates parts of a workload using Agent Roles, reducing the impact of increased load caused by schema validation. The feature supports validating JSON and Avro schemas, with support for Protobuf coming soon, and is built into the WarpStream Agent, providing in-environment validation without exfiltrating data.