December 2016 Summaries

In a recent episode of the Pete on Software Podcast, Matthew Groves returns to discuss various aspects of Couchbase with host Pete, an independent software developer and architect who also manages The Swift Ninja blog. During their conversation, they explore what Couchbase is, the languages and SDKs compatible with it, and its deployment options both on-premise and in the cloud. They also delve into how Couchbase can be integrated with relational databases, comparing it to other document databases, and discuss the reasons behind Groves's decision to work at Couchbase, as well as insights into the company's financial sustainability. Additionally, they touch upon the CouchCase project, encouraging listeners to tune in to Episode 51 of the podcast and subscribe via platforms like iTunes and Stitcher.

The blog post guides readers through setting up an AWS IoT Button as a trigger for an AWS Lambda function, which stores JSON documents in Couchbase using the Couchbase Java SDK. The process involves configuring the IoT button using the mobile app, creating an event source mapping for the Lambda function, and testing the button by clicking it to invoke the Lambda function and store a document in Couchbase. The post also discusses how multiple AWS IoT buttons can be used as triggers for different Lambda functions. Additionally, the blog touches on the possibility of registering IoT buttons without having an AWS login, allowing customers to use them without requiring additional setup or access.

Couchbase Mobile is a complete package that includes an embedded database, providing enterprise-class scaling when needed. It offers ease of use and architectural flexibility, making it a compelling choice for mobile app development. Unlike relational databases like SQLite, Couchbase Mobile uses a document-based approach with JSON objects, allowing for flexible schema design and easy data storage. This makes it easier to map natural structures in code to database constructs, reducing the need for manual schema design and SQL statements. The database also provides scalability features, including Sync Gateway, which enables off-device operations and supports large-scale applications. Overall, Couchbase Mobile offers a modern, document-based solution that is easy to use and adapt to changing needs.

The text discusses the process of importing Wikibase data, available in JSON format, into Couchbase Server using the cbimport tool, highlighting its utility for managing large data sets and enabling complex queries with N1QL. The author details their experience downloading, uncompressing, and importing a massive 99GB JSON file, noting the efficient memory usage of cbimport and adjustments made to Couchbase's RAM allocation during the process. The author intends to explore interesting queries once the import is complete and provides guidance for running cbimport on different operating systems, ensuring that the data can be effectively managed and queried across platforms.

The thirteenth episode of the NoSQL Database Podcast, titled "Docker with Distributed NoSQL Databases," explores the use of container technology in database setups, featuring insights from Docker Champion and NoSQL advocate Arun Gupta. The episode provides a comparison between containers and virtual machines, highlighting the ease and efficiency of using distributed databases with Docker. Available on platforms like iTunes and Pocket Casts, listeners can also send questions to [email protected]. The podcast directs developers to the Couchbase Developer Portal for further information on container tools and SDKs, and offers a link for those who missed the previous episode.

Couchbase's Sync Gateway, which supports various platforms including Linux, provides two main installation packages for Linux: a Debian format for Ubuntu and an rpm format for RedHat Enterprise and CentOS. The challenge arises when using other Linux distributions, as these packages may not fully complete the installation or might alter system settings unexpectedly. Sync Gateway consists of a single binary executable that relies on a few dynamic libraries, making manual installation feasible. For distributions not directly supported, manual installation involves unpacking the Debian package's data archive and placing the sync_gateway binary in a preferred directory. It's recommended to run Sync Gateway under a dedicated user ID for security and to automate its startup and restart processes. For further guidance, resources are available on Couchbase's developer portal, and community support can be accessed through their forums and Stack Overflow.

The text provides a detailed guide on developing a URL shortener application using the Ottoman Object Document Model (ODM), Couchbase Server, and Node.js. It highlights the preference for using an ODM over SQL queries for handling NoSQL data and outlines the process of setting up Couchbase Server and Node.js, including necessary dependencies like Express Framework and Hashids. The application involves creating a data model for URLs, establishing a connection to a Couchbase cluster, and implementing RESTful endpoints (/create, /expand, and root) for URL shortening, expansion, and redirection. The guide concludes with a suggestion to enhance the application by collecting analytics data, such as hit counters and browser information, to extend its functionality.

ZeroTurnaround's XRebel is a performance tool for Java Web Apps that provides real-time performance insights to understand and resolve potential issues faster and earlier during the development phase. It integrates with various message queues and databases, including Couchbase, offering a comprehensive overview of all calls made to the backend each time a request is sent to the server. XRebel can be tried by downloading the latest version from ZeroTurnaround's website, deploying it as a Java Agent in JVM configuration, or using Maven with Spring Boot applications. Once deployed, XRebal logs call details and provides access to its dashboard where users can view stacktraces and Couchbase operations. The tool also sends notifications when the trial license is about to expire, prompting users to renew their license.

The text provides a comprehensive guide on how to create a cross-platform mobile application using Ionic 2 and Couchbase Mobile, aimed at both Android and iOS devices. The author revisits a previous project that utilized Ionic Framework 1.0 and AngularJS 1.0, updating it with Angular 2 and Ionic 2 to explore Couchbase Mobile's capabilities in a modern context. The guide outlines the necessary installations, including Node.js, Ionic Framework, Android SDK, Xcode, and Couchbase Sync Gateway, and explains how to start a new Ionic 2 project with a simple to-do list application that syncs across devices. The document details the implementation of a Couchbase service using an Angular 2 provider, ensuring database access is managed efficiently throughout the application. The guide also demonstrates how to enable synchronization with Couchbase Sync Gateway by adding a single line of code, emphasizing the ease of achieving real-time data sync across devices. Additionally, the author offers a GitHub link to a sample project for those interested in further exploration, while addressing potential issues such as plugin compatibility and troubleshooting tips from user comments.

The recent gathering of the Bay Area Android Meetup group on the Peninsula featured two engaging presentations by Martin Bonnin and Tony Constantinides. Martin explored the evolution of video players on Android, focusing on ExoPlayer, while Tony discussed building a cost-effective DIY setup for capturing 360 images, along with the use of image stitching software and the broader realm of 360 photography. Additionally, a brief introduction to the Couchbase Mobile stack was provided, encapsulated in a 16-minute video including a Q&A session. The author expressed interest in discussing topics related to NoSQL for mobile, Couchbase for Android, or related subjects at other meetups or conferences, inviting contact via comments or Twitter.

When managing large distributed databases, administrators often don't have time to go through setup wizards when deploying new software. Couchbase Server provides a RESTful API for provisioning instances, including creating new clusters or joining existing ones. To configure a new cluster, administrators can use the `curl` command to define memory allocation, services availability, and create an administrative account. They can also create buckets with specific settings, such as bucket type, ram quota, and authentication type. Additionally, the RESTful API allows administrators to join existing clusters and rebalance the cluster after adding or removing nodes. By utilizing these API endpoints, administrators can automate the configuration process using scripts, making it easier to manage large-scale deployments.

This developer-focused guide explores the process of migrating an application's data store from MongoDB to Couchbase Server, detailing considerations such as differences in data models, query languages, scaling models, and concurrency mechanisms between the two systems. It highlights key transitions, such as moving from BSON to JSON, leveraging Couchbase's N1QL for querying, and adopting hash-based sharding for simplified scaling. The guide also discusses Couchbase's distinct approach to replication and consistency, emphasizing its automatic sharding and indexing capabilities, and the necessity of redefining document namespaces through key naming and document types. It outlines the advantages of Couchbase's distributed master-master scaling compared to MongoDB's master-slave model while pointing out the importance of adapting bucket usage and indexing to optimize resource allocation and performance. The text concludes by encouraging developers to replace collection namespacing with key naming, utilize N1QL JOINs for query simplification, and consider the appropriateness of key-value access in their migration strategy.

The text introduces a video tutorial that demonstrates how to create a RESTful API for shortening, expanding, and navigating short URLs using the Go programming language, in conjunction with Couchbase Server and N1QL for data querying. The tutorial serves as a comprehensive guide for beginners in both Couchbase and Golang, providing a complete example from start to finish. Additionally, it mentions the availability of video tutorials for installing Couchbase Server on different operating systems, and suggests consulting the Couchbase Developer Portal for more information on the Couchbase Go SDK.

This post discusses working with Couchbase Server from the command line, covering various tools and techniques for managing clusters, collecting logs, running N1QL queries, and utilizing views. The author assumes a basic understanding of NoSQL databases and provides minimal configuration examples to get started with each component of the Couchbase Mobile stack. Key points include using `couchbase-cli` for cluster management, `cbq` for interactive shell access, and `curl` or `httpie` for REST API interactions. The post concludes with a preview of upcoming topics in the series, including Sync Gateway and Couchbase Lite.

The blog post discusses the use of the RETURNING keyword in N1QL queries for Couchbase, which allows the result set of a query to be returned after operations like updates. It provides a practical example using a .NET Core console project, where five documents are initially inserted into a Couchbase bucket with a "processed" field set to false. The example then demonstrates updating these documents to set the "processed" field to true while using the RETURNING keyword to retrieve the updated documents and their keys. The author emphasizes the convenience of RETURNING in simplifying operations and suggests experimenting with more complex updates, such as using the IS MISSING operator. The full source code is available on GitHub, and readers are encouraged to reach out with questions.

Couchbase has released version 2.3.10 of its .NET SDK, featuring bug fixes and enhancements, most notably updates to the Data Structures API and FTS API. This maintenance release introduces support for queues in the Data Structures API, allowing JSON documents stored in Couchbase to function as ordered FIFO queues with concurrency control. Additionally, method names have been refined for consistency across all Couchbase SDKs. The FTS capabilities have been enhanced to allow custom sorting preferences on the server, and the SDK now includes functionality for waiting on N1QL indexes to reach an 'online' state before proceeding. The release addresses several issues, such as exceptions when SSL certificates are incorrectly set up and improvements in handling index preparation and management. The updated SDK is available via NuGet, GitHub, and direct download.

The developer's workshop covered the setup and usage of Couchbase Server, with four lab sections: setting up Couchbase, using Couchbase, building a full-stack application, and creating a simple cluster. The materials are open sourced, including slides, code samples in multiple programming languages, and completed versions for reference. Participants can provide feedback through GitHub issues or pull requests to enhance the workshop. Additionally, the creator offers customization services for conferences, user groups, or businesses interested in hosting a similar workshop.

With the rise of Twitter, SMS text messages, and other forms of short message interactions, there has been an increase in URL shortening services like TinyURL, Bitly, Owly, and others. These services aim to shorten long URLs for distribution in messages. A Node.js-based URL shortener application using Express Framework and Couchbase Server with N1QL will be created to demonstrate the process. The application requires Couchbase Server 4.1+ and Node.js 4.0+. To start, a Couchbase bucket is created for storing data, followed by configuration of the database to allow for N1QL queries. A simple primary index is created using GSI (Global Secondary Index) to enable efficient lookups. The application logic is then implemented using Express Framework and Couchbase, with the use of Hashids for generating short URLs. RESTful API endpoints are created for creating short URLs (`/create`), expanding short URLs (`/expand`), and navigating to long URLs (`/:id`). The full source code for the application is provided, showcasing the logic behind the URL shortener. This project demonstrates a basic implementation of a URL shortener using Node.js, Couchbase, and N1QL, with room for optimization and additional features such as analytics.

The text explores the process of data movement in integration projects, focusing on the use of Couchbase's N1QL language for transforming and manipulating data. It contrasts the traditional ETL (Extract-Transform-Load) with the ELT (Extract-Load-Transform) approach, emphasizing a practical ELT example using Oracle Database and Couchbase. Initially, data from an Oracle HR schema is exported and loaded into Couchbase as JSON documents, followed by a transformation process that involves denormalizing data for performance optimization. This involves embedding referenced data directly within documents to reduce database interactions, such as combining location, country, and region data into a single document and embedding job history into employee documents. The process employs N1QL for creating and managing data in two Couchbase buckets, demonstrating the creation of primary indexes and use of SQL-like queries for inserting and updating documents. The example concludes with the deletion of temporary documents and reinsertion of original job data, illustrating N1QL's capabilities in efficient data manipulation.

I spent nearly a week in Texas visiting four user groups and discussing Couchbase extensively. The second half of the week was spent in Houston, where I presented at two user groups: the Houston.js meetup, which featured a mix of experienced and new developers with various focuses, and the Houston .NET User Group, which is reportedly one of the oldest .NET user groups in the nation. Both events were well-received and provided opportunities for networking and sharing knowledge about Couchbase and its applications.