August 2024 Summaries

The blog discusses how smart retailers are blending technology with traditional brick-and-mortar stores to enhance customer experiences, creating a 'phygital' world where online and offline shopping experiences seamlessly merge. It highlights the importance of focusing on enhancing in-store experience rather than investing in technology without strategy. The blog also mentions how AI is changing retail by improving customer interactions and streamlining operations. Furthermore, it emphasizes the need for efficient data infrastructure to provide outstanding customer experiences both online and offline.

Aiven has announced the general availability of Tiered Storage in Aiven for Apache Kafka®, which enables seamless movement of older, less frequently accessed data to a lower cost storage tier within Kafka. This feature allows infinite data retention while significantly reducing storage costs and improving performance and operational efficiency. Tiered storage is production-ready for AWS, Google Cloud, Azure, and soon to be available for Bring Your Own Cloud (BYOC) deployments for these cloud providers. The benefits of Apache Kafka tiered storage include unlimited storage, optimized costs, greater elasticity, improved performance, and simplified management.

Financial Services Institutions (FSIs) are facing increasing compliance demands, budget constraints, and cybersecurity risks due to changing regional and national regulations. The Deloitte Report highlights that regulatory drivers account for more than half of the cybersecurity budget at 46% of firms surveyed in 2023. To mitigate these challenges, FSIs should consider open-source technology and careful vendor selection. Open source solutions can help eliminate reliance on proprietary software from a single vendor, reduce the need for high cost vendor-specific skills, and ensure data sovereignty. By choosing the right managed services partner like Aiven, FSIs can save significantly on reducing risk events and supporting teams while ensuring compliance with global standards such as ISAE 3000, ISO27K, GDPR, CCPA, HIPAA, and PCI DSS.

BigQuery continuous queries enable reverse ETL pattern by streaming enriched data from BigQuery back to operational data layers using Aiven for Apache Kafka®. This allows companies to benefit from curated and enriched datasets in real-time, feeding the data into streaming tools like Aiven for Apache Kafka®, making the enhanced information available to downstream systems. The integration of Google Cloud Pub/Sub with Apache Kafka enhances the ETL process by closing the loop between operational and analytical workflows, allowing users to leverage insights from analytics storage directly in their business applications.

Aiven offers a Bring Your Own Cloud (BYOC) model that allows users to apply their AWS compute Savings Plans (SPs) to Aiven data services, achieving significant cost savings and flexibility. In the BYOC model, Aiven runs services on standard EC2 instances in the user's AWS account, meaning their compute SPs will always apply to Aiven services. This approach allows users to control their data and cost management practices while reducing costs by offloading service infrastructure management responsibility to Aiven. When comparing Aiven's BYOC model with AWS native services, the compute infrastructure cost with Aiven is up to 73% lower. Additionally, any enterprise discounts will apply to the infrastructure costs as well. For organizations looking to optimize costs with robust solutions in their existing AWS environments, Aiven's BYOC model may be the best approach.

The Apache Kafka community has released version 3.8.0, which includes numerous new features and improvements from 456 JIRA tickets. This open-source streaming platform is widely used by thousands of organizations globally. Aiven, a company focused on open source software sustainability, was the first to offer managed Apache Kafka in the cloud. The release notes provide a full list of changes, while the documentation includes guidance on upgrading from previous versions.