Home / Companies / WarpStream / Blog / Post Details
Content Deep Dive

Zero Ops Schema Migration: WarpStream Schema Linking

Blog post from WarpStream

Post Details
Company
Date Published
Author
Brian Shih
Word Count
921
Language
English
Hacker News Points
-
Summary

WarpStream Schema Linking is a tool designed to facilitate the continuous migration of Confluent-compatible schema registries into WarpStream's Bring Your Own Cloud (BYOC) Schema Registry, supporting a stateless and zero-disk architecture. It enables seamless schema migration while preserving schema IDs, subjects, and compatibility rules, ensuring the destination registry mirrors the source at the API level. Compatible with various schema registries like Confluent, Redpanda, and Aiven, it provides a straightforward migration path to WarpStream, allowing for scalable read replicas, multi-region synchronization, and disaster recovery. WarpStream Schema Linking employs a declarative approach through a configuration file, using reconciliation to sync schema registries by comparing subject versions, akin to git branches and commits. The process is orchestrated by a scheduler that delegates tasks to agents within the user's VPC, ensuring schemas remain within the user's cloud environment. Unlike other tools that rely on copying internal Kafka topics, WarpStream offers observability through WarpStream's Console and agent-emitted metrics, allowing users to track migration progress without accessing the schemas themselves.