September 2024 Summaries

G2 has announced the Fall 2024 reports, showcasing Couchbase's recognition across several categories in the Database space, including Trending Key Value Databases, Trending Document Databases, and various usability indices. The software marketplace highlights products with satisfied customers and largest market presence, focusing on factors such as product usability, implementation, relationship, and results. Customers praise Couchbase for its ease of use, performance, scalability, hybrid architecture, and multi-model support, citing it as a great NoSQL solution for real-time data analysis and modern application development. The company is grateful for customer reviews that help deliver the best possible cloud database experience.

Ensuring a seamless flow of data is crucial for effective analysis and decision-making, particularly when it comes to handling unstructured and nested data structures in databases like MongoDB. To achieve this, we explored the process of data ingestion from MongoDB into both ClickHouse, a relational database, and Couchbase Capella Columnar, a NoSQL analytical database. We found that Capella Columnar simplifies working with nested data by not requiring preprocessing for nested data, allowing direct ingestion from MongoDB collections without separate tables or joins. In contrast, ClickHouse requires extensive preprocessing due to the unnesting of nested data, adding new fields necessitating additional table creation and schema updates. Real-time data changes in Capella Columnar are automatically reflected without additional processing, whereas ClickHouse faces challenges with pipeline breaks and manual intervention required for managing these changes. Overall, Couchbase Capella offers a more streamlined approach to handling complex, nested structures, making it the more flexible and efficient choice for environments dealing with real-time data and nested formats.

The Vercel team has announced a new stream schedule, featuring live coding sessions every Tuesday at 10am ET with their DevRel team. The streams will cover various topics, including Vercel V0/Couchbase application development and Vector Search at the Edge. Additionally, HacktoberFest is coming to the end of October, where the team has created GitHub issues for participants to tackle. The year's final months are dedicated to SaaS development, focusing on key components such as payment providers, user management, and email integration with Couchbase. The team invites feedback from viewers to make the streams more interactive and engaging.

The author of this text is an amateur dancer who uses genAI technologies to find cultural events and festivals in Europe for their dance troupe. They use a generative AI chatbot to get recommendations from various genAI services, but are not satisfied with the quality of the results. The author decides to use Retrieval Augmented Generation (RAG) to enrich and optimize the output of the LLM. They create an external data source using the predictHQ's events API and store their external data in a Couchbase collection. The author then creates a vector search index on the embeddings fields, choosing the dot product as the similarity metric. They use LangChain and LangGraph to build an application that fetches data from the vector store and adds it to the LLM prompt context. The application includes two nodes: "vector_search" (entry point) and "chatbot" (finish point). The chatbot node takes the information from the messages and embeds it into the prompt question to the LLM. The author visualizes their graph using IPython.display.Image and displays a Mermaid diagram of the graph. They demonstrate how to use the graph to stream events and display the output in Markdown format.

Companies are on the cusp of integrating artificial intelligence, generative AI, vector search, and edge computing to enhance customer experiences. They see value in these technologies but also have concerns over data security, compliance, and legal issues. Reliable data is crucial for training AI models, and utilizing edge computing can improve speed and availability, especially for mobile devices with limited connectivity. Vector search enables applications like self-service checkout, image recognition, and insurance claims processing, providing more flexibility and accuracy. The integration of natural language and audio capabilities further enhances the vector search functionality. As edge infrastructure becomes increasingly important, IT leaders must work with business leaders to visualize and understand the possibilities of these technologies.

High availability in cloud computing is about ensuring that services and applications are always up and running, even if something goes wrong. This involves having backup systems, automatically switching to those backups if a problem occurs, and spreading resources across different locations to prevent downtime. High availability architecture aims to minimize downtime and ensure the system can recover quickly from failures, reducing the impact on users and the business. To achieve high availability, focus on redundancy by using backup instances for critical components, automating failover to minimize downtime, implementing load balancing to distribute traffic, spreading resources across multiple locations, and continuously monitoring system health. By doing so, you can build a reliable, highly available cloud infrastructure that minimizes downtime and provides consistent service to your users.

You are invited to contribute to Couchbase open-source projects during Hacktoberfest. Explore various starter kits, including a new project called Couchbase Starter Kits, which provides a streamlined way to start building with Couchbase in your favorite language and framework. You can also dive into the Couchbase Shell, a powerful tool for interacting with Couchbase data in a fast, efficient, and flexible way. Additionally, you can explore VSCode and JetBrains extensions that provide seamless integration with Couchbase. The Couchbase Examples repository hosts numerous quickstart projects and tutorials that help developers get started with Couchbase, and you can contribute to this by suggesting new projects, improving existing examples, reviewing and testing them, or exploring open issues. Furthermore, you can get involved in the Couchbase Ecosystem projects by contributing to existing plugins, building new integrations, documentation, and examples, or checking out Couchbase Labs for experimental features and prototypes.

The Capella iQ reference architecture integrates advanced database solutions with generative AI models, utilizing Couchbase NoSQL database for efficient data handling and retrieval. The architecture leverages multiple storage solutions, including Docs DB, Object Storage, and Vector DB, to handle different types of data efficiently. It also includes an orchestrator that manages the flow of data and operations within the system, embeddings that transform textual data into numerical vectors, context and prompt builders that prepare contextual prompts for AI models, sensitive data filters that ensure compliance with data privacy regulations, LLM backend proxies that interact with large language models, moderation and rate limiting components that enforce guidelines and prevent overloading, metrics and logging systems that monitor and optimize system efficiency, public and private LLMs that provide flexibility in choosing the best model for specific use cases. The architecture's workflow begins with an NLU query input from the user interface and ends with generation of content, following a generic step-by-step process that involves prompt building, context building, sensitive data filtering, model selection and proxy, moderation and rate limiting, response generation, response building, and response delivery.

The React Native – Native Module for Couchbase Lite is a new public beta available on NPM, designed to work seamlessly with both Expo and React Native apps, allowing users to easily integrate Couchbase Lite into their mobile applications. The module enables offline data management and supports various features like replication, SQL++ querying, and Full-Text Search (FTS). It also provides examples and documentation for developers to build sample apps and provide feedback, helping the project identify and fix issues quickly. The current version is based on Couchbase Lite 3.1.x and will be upgraded to 3.2 in the near future.

Controlling who can do what in your application is crucial, as this can lead to security risks and operational inefficiencies. Capella Columnar's Role-Based Access Control (RBAC) allows for the definition of roles and access permissions for various external tools, such as BI tools and REST APIs. This fine-grained control helps secure data and ensures that each user has the necessary permissions to perform their tasks without overstepping boundaries. By leveraging RBAC, users can create custom roles and assign specific privileges to manage data access securely.

We're excited to announce Audit Logging support for Capella App Services, a powerful new capability that provides detailed, trackable records of activities that occur within your App Service. These audit logs are generated in a structured JSON format, documenting every significant action or event, including user actions, system processes, and other key events. The introduction of Audit Logging is essential for maintaining security, ensuring accountability, and meeting compliance requirements, particularly for regulatory compliance such as HIPAA. With the new capability, users can now opt-in to generate audit logs and configure exactly which events they want to track, with support for exporting and streaming logs to third-party services like DataDog and SumoLogic. The addition of Audit Logging enhances Capella's security and compliance capabilities, supporting needs for regulatory requirements, improved security posture, and better visibility into application activities.

Couchbase partnered with Cillers to host a Nordic Software AI Hackathon, which brought together around 100 developers to build modern scheduling applications. The event was designed to give developers hands-on experience with game-changing technology and provide a great learning experience. The teams were given two weeks' notice of the challenge and had access to a turn-key platform that made it easy to build production-ready MVPs without complex infrastructure. The stakes were high, with the winning team receiving a trip to Silicon Valley and meet-and-greets with tech giants. The event was a success, with all participants being winners in their own right, and Couchbase highlighted its commitment to developers through its developer tools, SDKs, and integrations.

The new Couchbase Ruby ORM is a tool designed to simplify database interactions and streamline development processes for Ruby on Rails applications. It provides an abstraction layer between the object-oriented nature of Ruby and the document-based storage of Couchbase, allowing developers to work with data as if it were Ruby objects. The ORM simplifies data operations, reduces boilerplate code, enhances productivity, and standardizes data access patterns, making it easier for developers to build scalable and maintainable applications. A practical example demonstrates how to define models with the ORM, including attributes and views, and how to establish associations between data entities. By using the Couchbase Ruby ORM, developers can leverage many of Couchbase's features while maintaining a familiar Ruby development experience.

MongoDB has announced the deprecation of its mobile capabilities, including Atlas Edge Server, Atlas Device Sync, and Atlas Device SDKs, which will force developers to seek new solutions for their offline-first, AI-powered mobile and IoT apps. This move raises concerns about the stability and reliability of MongoDB's tech stack, particularly for customers relying on these tools. In contrast, Couchbase Mobile offers a proven, scalable, and mature solution with over 10 years of mobile support excellence, providing a complete end-to-end database platform with a cloud-to-edge solution that simplifies architecture and provides flexibility, vector search support, and secure data synchronization from the cloud to the edge.

At Couchbase, the company's mission is to solve hard problems and help customers innovate and change the world with modern applications. During the second quarter fiscal 2025 earnings call, Couchbase shared its accomplishments, including excellent new customer logo growth and strong Capella migrations. The company achieved significant wins across various industries such as financial services, manufacturing, retail, technology, communications, travel, and hospitality. Notable customer highlights include a financial service company that chose Capella for client reporting precision, an aviation and aerospace component manufacturing company that selected Couchbase for its mobile offering and edge capabilities, and a global leader in unified retail commerce solutions that expanded its investment in Capella to support its cloud-native point-of-sale system. Additionally, customers such as Toyota-Astra Motor and a multinational electrical and telecommunications retailer have also expanded their investments in Couchbase due to its performance advantage, scalability, and value proposition.

The text discusses how to load recent Stellar blockchain transactions into Capella DBaaS using Python, leveraging the Stellar Horizon service's RESTful API. The process involves connecting to the Stellar network, retrieving trades data from the Horizon server, filtering and processing the data, and uploading it to Capella for storage. The code utilizes the stellar_sdk module and Couchbase's Python client library to interact with the blockchain and database respectively. Once uploaded, the data can be queried using Capella's SQL++ query language, allowing developers to access and analyze the Stellar trades data seamlessly.

We are excited to announce the General Availability (GA) of Couchbase Shell (cbsh), a powerful command-line tool designed to simplify interactions with Couchbase. With cbsh, users can easily query, load data, export data, and conduct full vector searches via a simple command line interface. The tool supports key-value operations, vector search, and SQL++ queries, making it an ideal choice for developers and administrators working with Couchbase Capella and Couchbase Server. To get started, download cbsh for your operating system, create a config file, connect to your cluster, and begin performing CRUD operations, running queries, or leveraging vector search capabilities.

At Couchbase, they are dedicated to removing blockers and creating cutting-edge solutions for developers. The new Capella Free Tier is designed to handle a diverse range of use cases, from small startups to large enterprises, and offers a fully managed database environment at no cost, enabling developers to experiment and build without financial constraints. With the Capella Free Tier, developers can access powerful services including vector search, data, index, query, and search services, all available with easy sign-in and no credit card required. The free tier has limitations, such as a pause after inactivity, but provides perpetual access to the database platform, making it ideal for building MVP products and side projects. The introduction of the Capella Free Tier reaffirms Couchbase's commitment to innovation and supporting developers at every stage of their journey, enabling them to quickly prototype, test, and iterate on ideas, ensuring a real-world environment to develop and test applications before scaling up to larger deployments.

Couchbase's Cross Data Centre Replication (XDCR) enables seamless data replication across various geographies, while ACID transactions support reliable and efficient transaction workloads. XDCR facilitates the replication of data between databases or buckets in different clusters, cloud providers, or data centers. It supports unidirectional and bidirectional operations, active-active replication with automatic conflict resolution, and filtered replication to replicate subsets of documents based on target cluster needs. Couchbase transactions enable ACID actions on the database, supporting distributed multi-document, multi-node ACID transactions at scale without sacrificing performance and high availability. XDCR replicates data from the source to the destination cluster asynchronously, ensuring eventual consistency for transactional updates. Understanding these mechanisms can help clarify why certain documents might not appear in the destination cluster immediately due to the transactional states and replication processes involved.

Vector search is a technique used to retrieve semantically similar items based on vector embedding representations in a multi-dimensional space, and it's gaining popularity in AI applications. Couchbase Lite 3.2 now supports vector search, enabling cloud-to-edge support for these applications. This feature allows for semantic searches on local data to be performed even when the device is offline, alleviating data privacy concerns by restricting searches to authenticated users. Vector search also reduces cost-per-query and provides low-latency searches, making it an attractive option for edge applications. With this feature, developers can build applications that leverage both cloud and edge capabilities, providing a unified experience for their users.

Couchbase has announced three major advancements for its Capella cloud database platform, including the general availability of Capella Columnar, which enables real-time, zero ETL JSON-native data analytics that run independently from operational workloads within a single database platform. This addresses the challenge of parsing, transforming and persisting JSON data into an analysis-ready columnar format, simplifying analysis by writing SQL++ for developers, eliminating the need to wait for the BI team. Additionally, Couchbase Mobile with vector search has been released, enabling cloud-to-edge AI capabilities without dependencies on the internet, making it ideal for mobile apps that require semantic, similarity and hybrid search. The company has also introduced Capella Free Tier, a perpetual free workspace in the Capella Database-as-a-Service designed to help developers get started on Capella without any financial commitment, making it ideal for learning, development, and small projects. Furthermore, Couchbase Capella provides developer productivity advancements such as AI-powered coding assistant Capella iQ, plugins and extensions that accelerate application development, and new AI integrations that leverage vector search capabilities. These advancements aim to help customers reduce costs and simplify operations while enabling developers to create trustworthy, AI-powered adaptive applications that run from cloud to edge.