Company
Date Published
Author
Lucia Cerchie, Neha Narkhede, Josep Prat
Word count
1785
Language
English
Hacker News points
None

Summary

The latest release of Apache Kafka, version 0.9, brings several significant features and improvements to enhance security, scalability, and reliability. The new version includes three key security features: Kerberos authentication, Unix-like permissions system, and encryption on the wire via SSL. Additionally, Kafka 0.9 introduces a new feature called Kafka Connect, which facilitates large-scale, real-time data import and export for Kafka. This feature abstracts away common problems that each such data integration tool needs to solve to be viable for 24×7 production environments. The release also includes support for user-defined quotas on producer and consumer APIs, ensuring that clients do not monopolize broker resources or cause network saturation. Furthermore, the new consumer API offers pluggable partition assignment and offset management, providing users with complete control over consumption semantics while still having the option of relying on convenient fault-tolerant group management semantics.