August 2021 Summaries

In this Node.js tutorial, the author demonstrates how to create async functions that call the Couchbase SDK. The author starts by setting up a Node.js project with Couchbase and then connects to Couchbase using an async function. This connection includes server name/address, username/password, and bucket information. The author shows how to get a JSON document from Couchbase using an async function and handles any errors that may occur. Additionally, the author covers how to upsert a JSON document using an async function, demonstrating its ability to create new documents and retrieve existing ones. Finally, the author provides a full code sample for readers to try out these concepts. The tutorial concludes by congratulating readers on completing the upsert and get cycle in Node.js and invites them to explore further tutorials and resources.

The JavaScript & Friends conference, a gathering of about 200 JavaScript developers, went virtual in 2020 and 2021 due to the COVID-19 pandemic. This year's event featured a keynote by Brandon Bayer, who discussed the evolution of fullstack JavaScript with React, highlighting how frameworks like Blitz JS and Redwood JS have simplified project setups since their introduction in 2020. The conference also included a presentation on Ottoman JS, which is an ODM for Couchbase and Node.js, focusing on JSON data modeling and offering a code demonstration. Numerous other insightful talks were delivered, covering topics such as Redis, user engagement in React, TypeScript, React Native app testing, application security, and documentation. The event provided a platform for networking and learning, with all talks available on the JavaScript & Friends YouTube channel for further exploration.

The introduction of user-defined functions (UDFs) in Couchbase Server 7.0's Analytics Service allows users to create reusable and parameterizable SQL++ queries, enhancing modularity and control over data interactions. UDFs consist of a function signature, which includes the function name and parameters, and a function body, which can be an expression or subquery. These functions can be created within specific dataverses or scopes and offer improved code reuse and flexibility. For example, a UDF can be used to query and rank airlines based on route counts within a given country, streamlining complex queries by performing operations such as joins and aggregations on Collections. Once a UDF is no longer needed, it can be easily dropped. The new functionality is aimed at optimizing query processes in Couchbase Analytics, and users are encouraged to explore this feature and provide feedback.

Declarative query languages have shifted the focus from database engines to what needs to be retrieved, allowing for more efficient and flexible data access. N1QL, a declarative query language used in Couchbase Server 7.0, enables users to instruct the query language on how to retrieve specific data without specifying the underlying programming logic. User-defined functions (UDFs) provide an additional layer of control over queries by allowing users to define custom business logic and extend the capabilities of N1QL. UDFs can be created using inline or JavaScript, with each offering distinct benefits and use cases. The Couchbase Server 7.0 release introduces Scopes and Collections, which enable users to organize their JSON documents and further enhance data management capabilities. By leveraging UDFs, developers can write more efficient and effective queries, taking advantage of the strengths of both relational and document databases.

Couchbase ConnectONLINE 2021 is a virtual event focused on the theme of "modernize now," reflecting the urgency for enterprises to advance their digital transformation efforts accelerated by the COVID-19 pandemic. The two-day event will feature networking opportunities, hands-on data engineering examples, and discussions on NoSQL, cloud solutions, and the future of data management and application development. Keynote speakers include Matt Cain, President and CEO of Couchbase, who will discuss the role of Couchbase in supporting enterprises to build next-generation applications, and Scott Anderson, who will elaborate on the enterprise journey to the cloud. Additionally, Mahdav Mekala from Pepsico will provide insights into their partnership with Couchbase to modernize inventory management. This flagship event promises to showcase real-world customer use cases and new Couchbase features, attracting developers and enterprises eager to innovate and modernize their applications.

This tutorial provides a step-by-step guide for integrating Couchbase with Node.js to create a basic JavaScript application, aimed at users with some knowledge of JavaScript and NoSQL databases. It begins with setting up Couchbase Server or signing up for Couchbase Cloud, followed by installing Node.js and initializing a project with npm. The tutorial details adding the Couchbase Node.js module, connecting to a Couchbase cluster, and performing basic operations such as retrieving a JSON document from the 'travel-sample' Bucket using key-value operations. Additionally, it covers creating or updating a document with the upsert function, ensuring users have the necessary write privileges. The article concludes with an invitation to explore more advanced topics like asynchronous functions and other Couchbase capabilities in future posts, encouraging readers to consult the Node.js SDK documentation for further examples.

Couchbase 7.0 introduces Scopes and Collections, enhancing the Full-Text Search Service by improving search performance and resource utilization across clusters. These new features allow users to organize and namespace data within a Couchbase Bucket, facilitating the grouping of documents without manual attributes. The Full-Text Search Service now supports indexing and searching data from single or multiple Collections within a single Scope, offering flexibility in managing multi-schema documents. With these updates, users can create both single and multi-Collection indexes, benefiting from tailored search capabilities while optimizing cluster resources. Additionally, role-based access control (RBAC) is extended to the Collection level, enhancing security and access management. The introduction of these features requires a fully upgraded Couchbase 7.0 cluster, as mixed-version clusters do not support Collections for Full-Text Search.

Cross Data Center Replication (XDCR) in Couchbase Server 7.0 enhances database high availability, disaster recovery, and geo-locality by introducing support for Scopes and Collections, allowing for more precise data replication in multi-tenant applications and microservices. XDCR now offers implicit and explicit mappings to manage replication between source and target collections within database buckets, enabling both dynamic and programmatic replication strategies. The system introduces a main pipeline for continuous replication and a backfill pipeline to address previously missed data, improving data integrity and flexibility without requiring a restart from sequence 0. This advancement significantly broadens the use cases for XDCR, meeting evolving customer needs by providing granular control over data replication and the ability to adjust mapping rules in real-time.

The latest release of Couchbase, version 7.0, has enhanced its Data Analytics capabilities with two new powerful features: CUBE functionality and ROLLUP aggregation. The CUBE functionality allows users to generate subtotals for all combinations of grouping columns specified in the GROUP BY clause, providing more detailed insights into their data. This is demonstrated through a walkthrough example using sample ecommerce data, where users can calculate total sales by region and year, as well as other aggregated metrics. These new features are designed to help users answer complex data analysis questions and make informed business decisions.

Couchbase 7.0 introduces Scopes and Collections, offering a new way to organize JSON data that simplifies the migration from relational databases to the Couchbase document data model. Scopes serve as logical containers analogous to schemas, while Collections function like tables, facilitating the organization and management of data. This update enhances the N1QL query language by eliminating the need for a type field in every document, making queries simpler and more intuitive, and improving JOIN conditions. The new model retains compatibility with the previous Bucket model, allowing users to transition at their own pace. Migrating involves a straightforward process of creating Scopes and Collections, ensuring unique document keys, copying data, converting indexes, and updating queries. The changes aim to streamline data handling and querying, leveraging Couchbase's distributed architecture for greater scalability and availability.

With the release of Couchbase 7.0, Scopes and Collections are now integrated into the Couchbase Analytics Service, enhancing data organization and analysis capabilities. Scopes and Collections serve as logical containers within a Couchbase Bucket, similar to schemas and tables in relational databases, allowing users to group related data efficiently. The integration introduces key concepts such as Dataverses and Datasets, which align with previous versions and extend functionality by enabling the creation and management of Analytics Collections using Data Definition Language (DDL) statements. This enhancement facilitates seamless query interchangeability between the Query and Analytics engines while maintaining backward compatibility with Couchbase 6.x releases. The new feature aims to streamline data analytics processes and encourages users to explore and provide feedback on its functionality.

Couchbase Server 7.0 introduces significant enhancements to index building and updating through the implementation of Scopes and Collections, which separate Bucket data into logical divisions, allowing for more organized data management similar to traditional RDBMS schemas and tables. This separation not only offers finer role-based access control but also retains the flexibility of a schema-less database by allowing users to create the schema that suits their application needs. The new model optimizes the Index Service by enabling DCP streaming at the Collection level, which reduces the workload on the projector during index builds and updates by focusing on specific Collections rather than entire Buckets. These improvements lead to more efficient processing as the projector no longer needs to evaluate the index WHERE clause for every mutation, resulting in significant CPU and disk I/O savings. Users can take advantage of these enhancements without altering their Index Service configuration, though they must specify Collection names when creating indexes, thereby benefiting from handling smaller datasets throughout the indexing process.

You can now analyze even more of your enterprise data using Couchbase Analytics – without having to move or migrate a byte. Starting today, I’m excited to announce the forthcoming support for Microsoft Azure Blob Storage for external Analytics Collections (currently in Developer Preview). This news follows the support for external Analytics Collections for Amazon Web Services Simple Storage Service (AWS S3) in the Couchbase Server 6.6 release. In short, this announcement means more Couchbase customers can combine data from external sources with local data and remote Couchbase data. Some customers use Azure Blob Storage to reduce storage costs for large volumes of data and want to combine, query and utilize data from Azure Blob Storage in real time for business users and data analytics. External Analytics Collections enable dynamic querying and analysis of data residing in external sources, allowing easy combination of data in real time from both inside and outside Couchbase Analytics nodes. To demonstrate this, an ecommerce company iMaz stores their product reviews on Azure Blob Storage and combines them with their internal data using the Couchbase Analytics Service to run ad hoc queries and analyze business trends. With External Analytics Collections, you can develop complex ad hoc queries for interactive data exploration, answer new business questions, and combine external data from Remote Links to involve other Couchbase data sources as well. Your teams conduct faster and more comprehensive data analyses for more agile decision-making.

Couchbase 7.0 introduces cost-based optimization (CBO) for NoSQL document databases, a significant advancement from the previous rule-based optimization (RBO) approach. Unlike RBO, which might use all possible indexes for query execution, CBO computes the cost of each potential execution path using pre-computed statistics to determine the most efficient plan, particularly when multiple indexes are available. This optimization requires both enabling the CBO feature and collecting relevant statistics on index fields to function effectively. Examples with the Couchbase travel-sample dataset illustrate how CBO can optimize queries by selecting the most cost-effective index for operations like index selection and JOINs. Although CBO is enabled by default, it necessitates regular updates to statistics to maintain efficiency, and it can be disabled if needed through specific settings.

Building an Android mobile app with Couchbase Lite offers hands-on experience with edge computing, emphasizing the development of resilient, low-latency applications that function seamlessly offline. Couchbase Lite, an embeddable version of the NoSQL database Couchbase, integrates with Sync Gateway and Couchbase Server to create a robust platform for edge computing, allowing real-time data synchronization and offline functionality. The tutorial on the Couchbase Developer Portal guides users through using Couchbase Lite in standalone mode within an Android app, following the Android Model-View-Presenter (MVP) pattern to ensure modularity and maintainability. Users learn essential database operations such as initializing, creating, and managing documents, focusing on dynamic user profile management—a common use case for mobile apps. This foundational knowledge prepares developers to explore advanced features like queries, predictive queries, indexing, and peer-to-peer sync, furthering their capability to build fast, resilient applications that leverage edge computing's full potential.

Couchbase Server 7.0 enhances data security by introducing Scopes and Collections, facilitating better mapping between relational and NoSQL data models, and allowing more granular role-based access control (RBAC) down to the level of individual Scopes and Collections. Previously, RBAC in Couchbase was applied at the cluster-wide or per-Bucket level, but the new update enables users to set permissions more precisely, aligning with the principle of least privilege. For example, a partner like Acme Co. can now be restricted to access only hotel data within a specific Collection, rather than the entire travel data set. This is achieved by the flexibility offered by Scopes, which act like schemas in relational databases, and Collections, which organize JSON documents akin to tables. The update also ensures backward compatibility with a default Scope and Collection, while encouraging new applications to leverage the named Collections for better data organization. Additionally, users can test the enhanced RBAC capabilities with hands-on examples, such as setting specific data reader roles for users on defined Collections, ensuring secure and efficient data access management in Couchbase clusters.

Couchbase has introduced new data analysis capabilities in its Analytics Service as part of the Couchbase Server 7.0 release, notably the ROLLUP aggregation feature, which helps aggregate data across multiple document attributes by extending the GROUP BY clause. This functionality is particularly useful for creating subtotals and grand totals in data analysis, as demonstrated with an example involving ecommerce sales data categorized by country, region, product, quantity, and price. By utilizing the ROLLUP sub-clause in an N1QL query, users can efficiently generate hierarchical summaries, such as total sales for all countries and regions, sales by country, and sales for individual regions, with enhanced readability through the transformation of NULL values to "All Countries" and "All Regions." This feature aims to streamline data analysis processes and is complemented by forthcoming capabilities like the CUBE function, which will be discussed in future updates.

Couchbase 7.0 introduces Scopes and Collections, enhancing microservices and multi-tenant application deployment by offering a more flexible data organization system. Scopes and Collections function as logical containers within a Couchbase Bucket, akin to tables and schemas in relational databases but with the added flexibility of JSON documents. This release allows for independent lifecycle management, improved security controls, and simplified N1QL queries. The new system supports up to 1,000 Collections and Scopes per cluster, facilitating the consolidation of microservices and tenants while maintaining logical and security isolation. The deployment architecture needs to consider these limits, as the number of Scopes and Collections is restricted at the cluster level. Additionally, Couchbase 7.0 enhances multi-tenancy by allowing different levels of isolation, resource sharing, and backup/restore options, aligning with modern SaaS application requirements.

Couchbase's 7.0 release extends its multi-document, distributed ACID transactions to the N1QL query language, enhancing the database platform's capabilities for application developers. This update allows for familiar transactional constructs like START TRANSACTION, SAVEPOINT, ROLLBACK, and COMMIT, making it more accessible for developers accustomed to relational database management systems (RDBMS). The transactions maintain data integrity by ensuring changes are isolated until they are fully committed, supporting the full range of N1QL Data Manipulation Language commands. These enhancements facilitate a safer environment for data manipulation, allowing developers to modify and verify data before committing changes. The platform's horizontal scalability is maintained as all transaction management is distributed across different Query Services, minimizing the risk of a central point of failure. However, developers are advised to use N1QL transactions judiciously due to potential impacts on performance and resource usage, particularly in high-volume mutation scenarios.