May 2022 Summaries

Aiven is a Finnish company that offers an open-source data infrastructure platform for businesses worldwide. Founded in 2015 by four developers, the company aims to simplify and automate complex data management tasks while promoting openness, ownership, and courage among its employees. Aiven's services include managing databases, data brokers, visualization solutions, analysis tools, monitoring and metrics solutions, search engines, cache, and connectors for integrating systems. The company is committed to sustainability by making energy consumption in the technology sector more environmentally sound through changes in the energy mix and overall energy control. Aiven's employees enjoy a supportive work environment with generous learning opportunities and a strong sense of community.

This blog post discusses how to use an external Apache Kafka connector with Aiven, specifically focusing on gathering Twitter messages into Kafka. The author explains the process of creating a self-managed Apache Kafka Connect cluster and connecting it to Aiven for Apache Kafka. They provide step-by-step instructions on setting up the Twitter source connector, including generating Java keystore and truststore, defining configuration files, and starting the local Connect cluster. The post also covers obtaining Twitter access credentials and configuring the Twitter source connector. Finally, the author highlights the benefits of using a managed service like Aiven for Apache Kafka while still having the freedom to use open-source connectors.

Moving from on-premise data infrastructure to managed cloud services can be a significant business transformation. While it offers benefits such as increased cost control, better information security, improved agility, and focus on growing one's own business, there are also risks involved. These include critical workloads and downtime during and after the transformation process, contractual and legal risks due to standardized service provider contracts, sensitive data and security concerns in the cloud, and potential loss of control over one's own data. To manage these risks effectively, businesses should carefully study their cloud contracts, ensure proper encryption and access controls for sensitive data, and use open source software to avoid vendor lock-in situations.

The text discusses the complex process of database migration from on-prem to a managed cloud service, highlighting five key questions that should be considered during the planning phase. These include determining the source and target databases, handling downtime, assessing whether application code changes are needed, evaluating support for the chosen migration toolkit, and ensuring data security throughout the process. The author also mentions an open-source tool developed by Aiven to assist with PostgreSQL database migrations.

Aiven is committed to promoting sustainability and equal access to technology through its platform, which is based on open source software. The company aims to make developers' lives better by providing efficient storage and movement of data while reducing the environmental impact of cloud services. Aiven also seeks to democratize access to technologies by lowering barriers for people to use these technologies and fostering diversity and inclusion in tech. By doing so, Aiven hopes to empower everyone with the best data technology and contribute to building a world where technology is developed by everyone, for everyone, with the good of the people and our environment in mind.

Kafka Summit 2022 London was a successful event with over 1500 attendees participating in workshops, talks, and networking opportunities. The keynote by Jay Kreps discussed how Apache Kafka fits into the modern data flow, touching on its streaming capabilities, decentralization, declarative nature, developer orientation, and governance & observability aspects. Breakout sessions covered a wide range of topics, including using Kafka for space applications, Debezium connectors, and practical pipelines with ksqlDB. Community interactions were strong, with many attendees expressing interest in Aiven's products and services. The next conference will be called "Current" and will focus on broader data streaming technologies.