Company
Date Published
Author
Michael Nitschinger
Word count
924
Language
English
Hacker News points
None

Summary

The Couchbase Spark Connector allows developers to move data in and out of Couchbase directly using Spark RDDs, leveraging the scalability, performance, and ease of use shared by both platforms. The connector is available as a developer preview, featuring capabilities such as creating RDDs from documents, views, and N1QL queries, writing RDDs and DStreams into Couchbase, and transparent cluster and bucket management. Developers can access the project on GitHub and follow configuration instructions to set up the connector for use with Spark. The connector supports reading from Couchbase into RDDs, applying transformations, and hinting target document types, as well as writing RDDs into Couchbase using custom converters or flat JSON structures. Future plans include tighter N1QL and Spark SQL integration, DStreams through DCP, and custom converter enhancements.