October 2018 Summaries

Comcast Xfinity Home, a leading home security provider in America, has chosen Aiven Kafka to handle its most critical workflows. The company aims to create a single experience that connects and manages customers' home and automation needs, requiring low latency at massive scale. After evaluating various providers, Aiven for Apache Kafka® was selected as the solution of choice for Xfinity Home due to its ability to maintain high availability and performant 98% of the time under 50ms end-to-end. To learn more about Comcast's challenge and their decision to go with Aiven, download the case study below.

The text discusses the challenges faced by data pipelines due to the current data landscape, including issues with connecting to stored data, batch importing of stock data, limitations in handling variable-length events, and more. It also highlights previous attempts and lessons learned from these scenarios. Furthermore, it presents seven key challenges that modern data pipelines need to overcome: getting data where needed, hosting and storing data, flexibility in data, scaling with data, moving data around, mashing up and transforming data, and visualizing everything. The text concludes by emphasizing the importance of choosing the right tools and services for building effective data pipelines.

The Aiven platform now supports Terraform, an open-source infrastructure as code tooling that can be used to manage Aiven services with greater efficiency. This addition provides users with four options for configuring and managing their Aiven infrastructure. Terraform is ideal for coordinating large, complex infrastructures and connecting pieces of infrastructure in a reproducible, semi-automated way. It offers version control, comprehensive documentation, and automation features that can help increase team efficiency.