New in Confluent Cloud: Making Data, Pipelines, and Ops Accessible for AI-Ready Streaming
Blog post from Confluent
Confluent's latest release aims to simplify the integration of artificial intelligence (AI) with streaming data by introducing features that make AI-ready streaming accessible across existing data platforms. Key innovations include a dbt adapter for Confluent Cloud, facilitating SQL-based workflows for streaming data, and Materialized Tables that simplify managing Flink pipelines by automating offset management. The release also introduces Process Table Functions and external connectivity for user-defined functions, enabling developers to write custom stream processing logic and interact with external services directly from Flink. Additionally, the launch of the Real-Time Context Engine and Streaming Agents enhances the ability to build context-rich AI systems with enterprise-grade reliability. Confluent has also improved data governance by supporting schema IDs in Kafka headers, allowing for the seamless integration of well-structured data into AI and analytics applications. Enhancements in client migration tools and security measures, such as Global API Keys and centralized policy enforcement, further streamline operations and bolster data quality and compliance across the ecosystem.