October 2021 Summaries

Aiven, a company that provides managed cloud data infrastructure, has raised $60 million of additional funding, extending its Series C round to $160 million in total. This new valuation makes the company worth $2 billion and classifies it as a unicorn startup. The company's mission is to make developers' lives better by helping them tap into the benefits of open source data technologies without the burden of maintenance and management. Aiven plans to continue championing easy and accessible open source, launch new products, expand its team, and open offices in Paris and Singapore.

Aiden sponsored a study by IDC to analyze the business value of its managed cloud database services. The results showed that customers experienced a 340% three-year ROI with a 5-month payback period, 37% lower cost of operations over three years, and increased effectiveness of DBA, infra, and security teams. Companies participating in the study were able to realize an average of $184,800 in higher net revenue annually per organization. Aiden's unique multi-cloud, open source approach offers more versatility than on-premises solutions or proprietary cloud offerings, enhancing business agility and risk mitigation benefits.

Microservices are a software development method where applications are structured as small, loosely coupled services. They can be thought of as minimal units of functionality, can be deployed independently, are reusable, and communicate with each other via various network protocols like HTTP. Today, most cloud-based applications that expose a REST API are built on microservices, or may actually be one themselves. These architectures are called microservice architectures. The benefits of microservices include increased flexibility, resistance to failure, unparalleled flexibility for scaling and updating, and the ability to experiment with new technologies. However, challenges include dealing with large amounts of logs when something breaks, testing and deployment becoming more complicated, and the need for microservices to communicate effectively. One solution to these challenges is the use of asynchronous communication via multiple receivers, such as Apache Kafka's pub-sub model. This method allows software components called producers to publish events in time-ordered logs called topics, while consumers can subscribe from these topics by offset. This decouples components from the message bus and each other, allowing for independent development and testing without worrying about dependencies. Apache Kafka is a good communication solution because it solves the problem of tight-coupling between components and communication, supports routing rules configured by consumer, facilitates breaking up larger components into atomic, granular, independent, reusable services, and offers high throughput/low latency. However, setting up and maintaining Apache Kafka can be challenging, which is why managed solutions like Aiven for Apache Kafka® are recommended.

kcctl is a new open source command line tool for Apache Kafka Connect, which allows users to manage all their Kafka Connect instances in one place, whether on-premises or in the cloud. The tool provides an easy way to integrate with Apache Kafka and manage connections to other systems. It also offers similar functionality as Aiven's Command Line Interface (CLI), but can be used for any Kafka Connect instance regardless of its location. To use kcctl, users need to have an Apache Kafka environment with Kafka Connect up and running, which can be easily created using Aiven services. Once installed, kcctl allows users to create connectors, manage them, check data in Apache Kafka, and more.

The open source community has its share of issues, including harassment, arguments, and abuse. These problems can lead to volunteer burnout among contributors who work on these projects in their free time. A common issue is that maintainers are expected to satisfy anonymous demands for free, which creates a toxic environment. To address this, companies like Aiven have established Open Source Program Offices (OSPO) to support the mental health of individuals in the open source community and make it more sustainable. Adopting Codes of Conduct can also help maintain safer environments within these communities.

Apache Kafka MirrorMaker 2 is a robust data replication utility that can increase the resilience of Kafka-centric architectures by copying data from one cluster to another. The top reasons for replicating your Apache Kafka cluster data include disaster recovery, moving to the cloud, reducing latency and network costs, isolating data, and facilitating data analytics. MirrorMaker 2 offers several benefits such as preserving consumer offset mappings, supporting complex replication topologies, and synchronizing topic configuration and ACLs from source to target clusters.