Couchbase Spark Connector 2.0.0 Released

The release of the second major version of the Couchbase Spark Connector introduces compatibility with the Apache Spark 2.0.x series, thanks to contributions from community members Luca Rosellini and Shivansh Srivastava. This version enhances support for Spark Streaming and introduces initial support for Structured Streaming, utilizing a new low-overhead, production-ready DCP-client for dynamic scaling and automatic flow control. While the API remains largely unchanged, users can now handle node failures more effectively and start streaming from the current system state. Although Structured Streaming support currently only streams document changes, further developments are anticipated to include deletion handling and improved efficiency. The connector can function as both a source and sink, supporting schema-based data streaming and storage back into Couchbase. Users are encouraged to explore the provided samples repository for practical demonstrations and attend related talks at Spark Summit Europe and Couchbase Connect for deeper insights.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.