Bringing Tiered Storage, Wasm Data Transforms, and Protobuf to Redpanda

Redpanda has introduced three major new features: Tiered Storage, Protobuf support in the Schema Registry, and a tech preview for Wasm Data Transforms, aimed at enhancing capabilities for developers building real-time applications. Tiered Storage allows for seamless unification of real-time and historical data by archiving log segments to cloud storage and replaying them as needed, while Protobuf support expands schema management options, complementing existing Avro support and catering to diverse programming languages. The Wasm Data Transforms tech preview enables the creation of WebAssembly-based scripts for data transformation tasks directly on topics, reducing the need for external stream processors and facilitating tasks like data scrubbing and normalization. These features, while currently available in tech preview and not yet recommended for production use, demonstrate Redpanda's commitment to innovation and improving data handling processes in real-time applications.