Company
Date Published
Author
Filip Yonov
Word count
2733
Language
English
Hacker News points
7

Summary

Apache Kafka is introducing a new feature called Diskless Topics that replicates data directly in object storage, reducing the total cost of ownership (TCO) and improving performance. This new feature allows users to delegate replication to object storage, eliminating disks from the hot path and reducing costs by up to 80%. The Diskless Topic proposal aims to make Kafka more agile, scalable, and cost-effective, with features such as autoscaling in seconds, multi-region disaster recovery, and reduced IOPS bottlenecks. The new feature is designed to be backwards compatible with existing Kafka topics and can be used alongside traditional replicated topics. By leveraging cloud-native storage services like S3, Diskless Topics can provide a more efficient and cost-effective way to store and replicate data in the cloud.