Company
Date Published
Author
Hugh Evans
Word count
946
Language
English
Hacker News points
None

Summary

The BigQuery Sink Connector, initially developed by WePay in 2016 and later managed by Confluent, experienced a significant shift when Confluent decided to prioritize a proprietary version after the introduction of Google's Storage Write API, leaving the open-source community with fewer options. In response, Aiven took over the development of the connector in 2024, restoring the Storage Write API functionality and releasing an updated version under open-source principles. This move ensured the connector remained accessible and useful for the Kafka community, with Google endorsing it by including it in their documentation for the Managed Service for Apache Kafka. Aiven's commitment to maintaining the connector with genuine open-source principles signifies its dedication to supporting the broader community and fostering innovation in real-time data integration.