August 2023 Summaries

The text discusses the benefits of serverless cloud services over managed services, using storage and stream processing as examples. In traditional on-prem environments, users must handle all operational aspects, including setting up clusters and managing resources, which can be both complex and costly. Even with managed cloud services like HDFS, users still face decisions about provisioning and resource management, leading to potential inefficiencies and extra costs. In contrast, serverless platforms like AWS S3 and DeltaStream abstract away these complexities, allowing users to focus on application development rather than infrastructure management. Serverless solutions provide scalability, isolation, and ease of use, as users only pay for resources they actively use, eliminating the need for resource over-provisioning. DeltaStream, in particular, offers a unified platform for stream processing and database functionalities, enabling seamless integration with streaming stores and real-time query execution without the concept of clusters, thus simplifying the user experience and optimizing costs.

DeltaStream has chosen Apache Flink as its foundational engine for stream processing due to its scalability, efficiency, and robust open-source community, which supports a wide array of use cases, from anomaly detection to IoT and machine learning. Flink's flexibility is augmented by its rich connector ecosystem, facilitating seamless integration with various data infrastructures, while its performance is enhanced by low-latency, scalability, and fault tolerance features. However, Flink's complexity and operational challenges can be daunting, prompting DeltaStream to develop a serverless platform that simplifies stream processing through an extended SQL grammar and a modern user interface. This platform lowers the barrier to entry by abstracting away Flink's complexities, supports real-time materialized views, and offers features like secure data sharing and role-based access control. DeltaStream's enhancements aim to offer an intuitive and efficient experience for managing streaming data, while allowing users to leverage Flink's capabilities without the steep learning curve typically associated with distributed processing systems.

DeltaStream has introduced a Private SaaS offering to address customer concerns about data security and privacy, enabling users to process streaming data without it leaving their network while maintaining a fully managed service. This solution is particularly appealing for customers with strict data sovereignty requirements, as it ensures data remains within the customer’s Virtual Private Cloud (VPC), thereby adhering to regulations such as GDPR. DeltaStream's architecture includes a control plane and a data plane, with the latter operating within the customer VPC to handle data processing securely. The Private SaaS model provides a serverless experience, scaling infrastructure as needed while allowing customers to manage cloud costs effectively by leveraging existing relationships with cloud service providers. This approach not only enhances security but also simplifies adoption for organizations that cannot use traditional SaaS services, offering a seamless, scalable, and cost-efficient solution for streaming data management.

In the first half of 2023, DeltaStream emerged from stealth mode with significant developments in the real-time streaming market, including the launch of its Private SaaS platform, also known as "Bring Your Own Cloud" (BYOC), and a free trial version, enabling customers to enhance data processing efficiency and maintain data security. DeltaStream's Private SaaS allows customers to scale their infrastructure while the company manages the data operations within the customer's VPC, ensuring both operational efficiency and security. The company also introduced an improved user interface, achieved SOC 2 Type II compliance, and actively participated in industry events like the RTA Summit and Databricks Summit. DeltaStream hosted its first webinar on Streaming Analytics, launched a new website with enhanced product content, and received positive feedback from founder Hojjat Jafarpour on the importance of security and efficiency for data-handling companies. DeltaStream continued to evolve its offerings with news about simplifying analytics, cost-saving initiatives, and the general availability of DeltaStream Fusion to unify analytics in a single platform.