June 2022 Summaries

Couchbase Capella is a cloud-based Database-as-a-Service (DBaaS) that combines the capabilities of relational databases, like SQL and ACID transactions, with the flexibility and scalability of NoSQL, offering a fully managed JSON document database. Pydantic, a Python library, enhances the development process by allowing developers to define and validate custom JSON objects through type annotations, ensuring data integrity when interfacing with Capella. This blog provides a step-by-step guide for using Pydantic to create and validate JSON documents, which can then be upserted into Couchbase Capella using the Couchbase Python SDK. The process involves creating schema models in Pydantic for structured data, such as user posts and reviews, and demonstrates how to populate and insert these documents into a Capella cluster. The project is publicly available on GitHub for further exploration, and additional resources and tutorials are offered for those interested in learning more about using Capella and Pydantic together.

When utilizing Couchbase as a persistent system of records, it is essential to carefully consider the underlying storage infrastructure, as this significantly affects the data store's performance and availability, ultimately impacting application performance and customer satisfaction. Couchbase is renowned for its sub-millisecond response times, which has driven its widespread adoption, but transitioning from a caching layer to a persistent data store introduces additional complexities, particularly when dealing with large-scale data storage. Key considerations for storage infrastructure include meeting service level agreements (SLAs), such as Recovery Time Objectives and Recovery Point Objectives, and addressing performance parameters like IOPS and latency. Storage solutions must ensure high availability, disaster recovery, and adaptability across different platforms and storage types. Deciding on the appropriate storage solution—whether DAS, NAS, or SAN—requires a thorough understanding of business objectives, application needs, and cost implications, involving collaboration with specialized storage teams to establish an effective storage strategy.

The text discusses the development of an ASP.NET Core project that interacts with Couchbase Capella to implement CRUD (Create, Read, Update, Delete) operations, focusing on creating and updating wishlist data. Initially, the project established basic functionality and introduced read endpoints using SQL++ and a key-value API. The current focus is on adding an endpoint for creating and updating data, utilizing the SQL++ UPSERT command, which combines insert and update operations, and a key-value method using UpsertAsync. Both methods determine whether to create or update based on the presence of an ID, with the key-value API being preferred for its direct access and efficiency in this context. The endpoint's operation is demonstrated through examples, and the project is set to explore the "delete" function next. Users are encouraged to try Couchbase Capella through a free trial and explore .NET examples in the Couchbase Playground.

Couchbase Server 7.1 introduces significant improvements to its Rebalance feature, particularly for the Global Secondary Index Service, through a new element called Smart Batching, which optimizes the index redistribution process when nodes are added or removed from a cluster. The Rebalance operation, critical for maintaining balanced resource usage across nodes, occurs in two phases: Planning, where a simulated annealing algorithm determines an efficient index layout, and Movement, where metadata is relocated, and indexes are rebuilt at new nodes. Smart Batching enhances performance by increasing pipeline parallelism, optimizing data stream sharing, and repairing replicas before moving indexes, thereby reducing resource consumption and minimizing impacts on production workloads. Additionally, it supports greater concurrency by allowing larger batch sizes and considers node load to manage concurrency more effectively. These improvements make the Index Service Rebalance more efficient and less disruptive, enabling Couchbase clusters to maintain optimal performance even as they scale or change.

Despite progress, women in technology still face significant barriers to leadership roles, exacerbated by societal expectations and biases related to gender, race, and appearance. The tech industry, traditionally dominated by men, poses unique challenges for women, such as being overlooked for opportunities and struggling with imposter syndrome. While some companies are working to address gender imbalances, issues like insufficient representation in the tech pipeline and retention exacerbate the problem. To succeed, women are encouraged to advocate for themselves by seeking mentors, adopting an 80/20 mindset for career advancement, and finding companies that align with their values. The rise of remote work has improved work/life balance for many women, and there is a growing emphasis on workplace benefits such as child care. Encouraging women to step outside their comfort zones and advocating for a diverse and inclusive tech ecosystem can help create a sustainable future where women's skills and perspectives are valued.

Couchbase Server 7.1 introduces a High Availability feature for its Analytics Service, ensuring continuous access to data even when one or more Analytics nodes are unavailable due to maintenance or failure. This feature addresses a significant challenge where data previously became inaccessible during node downtimes, affecting business operations and service level agreements. The High Availability mechanism works by hash-partitioning data across nodes and using replicas to maintain data availability; when a node fails, a replica is promoted to handle its data. Depending on the state of replication, varying amounts of data may need to be re-ingested, but the system continues to function in an unbalanced state until recovery or removal of the failed node. This enhancement offers benefits such as uninterrupted real-time data access, minimal disruption to insights, and improved customer experience, making it a highly valuable addition to Couchbase Analytics.

Couchbase, a company focused on enhancing customer outcomes, recently held its first quarter fiscal 2023 earnings call, highlighting significant customer achievements. Western Union expanded its relationship with Couchbase by adopting Capella, a database-as-a-service, to improve scalability, agility, and customer experience in the cloud. Halliburton, a Fortune 500 oilfield services company, chose Couchbase for its mobile and data synchronization capabilities, allowing for increased efficiency in data synchronization across devices with limited connectivity. MercuryGate International, a transportation management system company, selected Couchbase Capella for its scalability to meet low latency requirements. Additionally, a leading website hosting company opted for Couchbase Capella over a cloud service provider for its superior performance and cost efficiency in deploying next-generation e-commerce capabilities. The company is encouraged by the positive momentum and customer feedback and invites potential users to try a 30-day free trial of Couchbase Capella.

Storing data on a Couchbase cluster ensures high performance and stability for services, and can be analyzed using various tools like Grafana, which has recently released its first beta version of the Couchbase data source plugin. The plugin supports querying Couchbase clusters using SQL++ through analytics services, and provides pre-built binaries to simplify installation. After installing the plugin, users can use Couchbase's unique SQL++ with Grafana's powerful visualization capabilities to gain insights into their data without affecting cluster performance. The plugin allows for full-text search, user-defined functions, and supports all cluster SQL++ features, but has limitations on query syntax and data types. It transforms results into Grafana data structures for display in the UI, automatically detecting data type and rendering numerical values as timelines graphs or displaying logs if a column named content is present. The plugin also allows custom dashboards to be built using SQL++, providing more information in Couchbase's Grafana plugin tutorial. The plugin is actively developed with new features coming, and users can provide feedback through forums or GitHub issues.

The article explores the transition from a relational database management system (RDBMS) to a NoSQL document model, highlighting the benefits and strategies for optimizing query performance and index configuration in this modernized approach. It discusses how organizations facing dynamic business requirements can leverage NoSQL databases, such as Couchbase, to enhance their application infrastructure. The text specifically examines the use of an effective index strategy, emphasizing its role in balancing query performance and resource management. Through a practical example involving hotel data, the article illustrates the differences between relational and document models, showing how the denormalized document model simplifies queries by eliminating the need for JOINs and utilizing a single index, thanks to features like Couchbase's FLATTEN_KEYS. This approach not only streamlines queries but also improves performance by reducing the complexity and number of index scans.

The use of cloud-native platforms has made it easier to build business applications, with citizen developers and business users able to contribute to app development. The combination of Couchbase Capella and CData Connect Cloud enables instant, cloud-to-cloud access to NoSQL data from cloud-based low-code platforms like Microsoft Power Apps. To connect to Couchbase Capella, users must configure the platform and create a database user with the necessary permissions, before connecting to it in CData Connect Cloud using a straightforward point-and-click interface. Once connected, users can build business apps that integrate with live Couchbase data, with options for write-back support and bidirectional connectivity. This enables employees to review, analyze, and update business data from anywhere, with the ability to try out CData Connect Cloud and Couchbase Capella for free.

The text addresses common misconceptions about NoSQL databases, specifically focusing on Couchbase and MongoDB, and challenges the notion that Couchbase is merely a key-value store by highlighting its multi-model architecture, which includes capabilities for key-value operations, SQL++ querying, full-text search, analytics, eventing, and mobile synchronization. It criticizes MongoDB's comparison of Couchbase's search capabilities with Lucene by emphasizing Couchbase's integration of the Bleve full-text search engine, which offers features like language awareness and geospatial search without needing additional connectors. The text also hints at upcoming discussions on NoSQL's security, data integrity, and support for ACID transactions, inviting readers to join the Couchbase Discord for further dialogue.

Couchbase recently initiated a new type of developer workshop co-hosted with customers like Doctolib, a healthcare technology company, to foster community engagement and collaboration among developers. The two-day event, held at Doctolib's headquarters near Paris, featured a deep dive into Couchbase's products through interactive presentations and hands-on demos, followed by a hackathon where developers applied the previous day's learnings. The workshop, attended by around 50 developers with additional remote participants, received positive feedback for its technical content and presenters, particularly the hands-on demos. However, attendees suggested more practical examples and less theoretical content, as well as more time for Q&A. The event concluded with a successful hackathon that produced a working prototype for Doctolib's mobile app, demonstrating the benefits of collaborative efforts between Couchbase and Doctolib teams. Encouraged by the event's success and feedback, Couchbase plans to refine and expand these workshops globally to further enhance developer engagement.

Couchbase Server 7.1 introduces several security enhancements for TLS certificates, including support for multiple certificate authorities, encrypted TLS private keys, additional TLS certificate formats, and cluster-wide TLS version 1.3. These changes aim to provide more flexibility and security in managing and using TLS certificates in clusters, such as allowing different certificate chains for application-to-cluster network encryption and client authentication, preventing unauthorized access to encrypted private keys, and improving the overall security of data transmitted over the network.

The Couchbase Impact Awards recognize leaders in various categories, such as Cloud Innovation, Innovating at the Edge, Business Acceleration Leader, and Application of the Year. The awards aim to showcase transformative applications built with Couchbase and make a significant impact across industries. Winners will receive an engraved trophy, be featured on Couchbase's website and in press releases, and have their successes highlighted through customer stories.

Couchbase is announcing the general availability of Azure Blob Storage support for external Analytics collections, allowing customers to combine data from external sources with local data and remote Couchbase data. This feature provides dynamic querying and analysis capabilities, enabling users to easily integrate data from various sources in real-time. The process involves setting up links to external data stores, creating an external Analytics collection, and querying the data using SQL++. External Analytics collections support JSON, CSV, and TSV file formats, including compressed GZIP files, and can be used for data enrichment, dynamic data access, and parallel query processing. This new functionality unlocks the value of external live and archived data residing in external data stores, enabling faster and more comprehensive data analyses and agile decision-making.

On April 5, 2022, Couchbase was granted a second patent by the US Patent and Trademark Office for its innovative approach to optimizing document-oriented database queries on arrays, specifically through a process known as Cost-based Optimization (CBO). This feature, which has been available since Couchbase Server 7.1 and Couchbase Capella 7.0, signifies a significant advancement in bringing CBO to NoSQL databases, allowing Couchbase to offer improved performance and resource efficiency in executing queries. Unlike Rule-based Optimization (RBO), which relies on predefined rules and can be inefficient, CBO evaluates millions of query plans to select the most cost-effective execution path, thereby reducing memory, disk usage, and latency. This advancement sets Couchbase apart as the only document database provider currently offering CBO for NoSQL queries, emphasizing its commitment to technical excellence and innovation in document database management, which is crucial for enterprises relying on high-performance data handling.

Misconceptions about NoSQL databases, such as the belief that they cannot support SQL, are addressed in a blog series focusing on Couchbase and MongoDB. While many NoSQL databases, including MongoDB, do not support SQL, Couchbase offers a more versatile approach by incorporating SQL++, allowing for SQL-like querying alongside key-value operations, full-text search, and other functionalities. Despite claims that enhanced functionality in Couchbase increases complexity, the platform offers tools like Couchbase Playground and Couchbase Capella to ease the developer experience. Couchbase's commitment to SQL standards aims to simplify the transition from relational databases, making it a more accessible option for developers familiar with SQL. Resources such as Don Chamberlain's book on SQL++ and various presentations are recommended for further exploration, while future posts promise to address additional misconceptions about Couchbase's capabilities.

Capella, a cloud-based database as a service from Couchbase, now supports Google Cloud, enabling customers to deploy their applications in the cloud with greater flexibility and alignment between applications and data. Capella is designed to be fast, flexible, and familiar, with features such as a JSON document data store, SQL++ query language, and integrated capabilities like full-text search and operational analytics. The service uses an in-memory architecture with elastic scaling to deliver price-performance benefits, making it more affordable than other DBaaS offerings. With Capella on Google Cloud, customers can take advantage of fully managed Couchbase clusters, supported by the global cloud infrastructure network. This expansion supports hybrid/multicloud strategies and provides a single database platform for alignment between applications and data.

Capella App Services is a newly introduced fully managed and hosted service designed to synchronize data between mobile, web, and IoT apps and Couchbase Capella DBaaS, enhancing Couchbase's traditional mobile and edge capabilities with the scale and convenience of Capella. This service supports the development of offline-first applications, which remain functional even without internet connectivity, by providing an easy-to-use plug-and-go solution that eliminates the need for developers to build synchronization themselves. Capella App Services works alongside Couchbase Lite to manage secure, bi-directional data synchronization with features like role-based access control and peer-to-peer syncing, ensuring data integrity and real-time updates across devices. The intuitive interface allows developers to manage backend sync and database operations effortlessly, facilitating the creation of reliable and performant applications without the overhead of server maintenance. Currently in Private Preview, Capella App Services aims to boost developer productivity and streamline the process of building modern applications.