Company
Date Published
Author
David Segleau, Director of Technical Product Marketing, Couchbase
Word count
425
Language
English
Hacker News points
None

Summary

Couchbase has announced the release of its Spark Connector 1.2.0, which features significant updates and enhancements, including compatibility with Apache Spark 1.6. This version introduces Java and Scala support for Couchbase view, spatial view, and N1QL query APIs on RDDs, alongside support for the new Subdocument lookup API on RDDs and SparkContext, which requires Couchbase Server 4.5. The release also allows the Java API to leverage Spark SQL directly and extends SparkSQL Filter expressions to support all Spark Filters, including nested ones. Additionally, it enhances Spark Streaming support, though this is still experimental, and includes various bug fixes. The connector can be accessed via Maven Central or spark-packages.org, and feedback from users is encouraged to shape future developments, with a focus on upcoming functionality in Spark 2.x and further improvements to the Spark Streaming interface.