June 2022 Summaries

Starburst has acquired Varada, a data analytics accelerator from Tel Aviv, to enhance its data lake analytics capabilities. The acquisition is aimed at improving query performance by up to seven times on average and reducing cloud compute costs by up to 40% on AWS, thanks to Varada's patented indexing technology that optimizes data processing without relocating or modeling data. This strategic move is anticipated to solidify Starburst's leadership in the industry, with the integration expected to be available to select customers within thirty days and to all Starburst users by Fall 2022. Both companies leverage open-source Trino, facilitating a swift integration process. Starburst plans to showcase this advancement through the "Starburst Analytics At Warp Speed Tour," featuring virtual and in-person events, including a virtual kick-off on June 29 and appearances at the AWS Summit NY and the Gartner Data & Analytics Summit.

In the AdTech industry, companies face significant challenges in managing user data due to unique data pipelines, duplicative data storage, and the need for compliance with privacy laws like CCPA and GDPR. Starburst addresses these issues with features such as data federation, access control, Trino fault tolerance, and granular task retries, which simplify data management, enhance data access, and improve the stability of ETL jobs. Data federation, in particular, allows for seamless data transfer across different systems, reducing the need for costly architectural modifications. Access control ensures secure and efficient data usage by providing a single point of access, minimizing data duplication, and facilitating user-specific access rights. Trino's features support more stable ETL processes by aiding in adaptive planning and failure recovery, which is crucial for maintaining data integrity and compliance with privacy regulations. AdTech companies are encouraged to consider legal risks, cost optimization, and query performance, with Starburst emerging as a leading choice in data federation technology to address these industry-specific challenges.

Role-Based Access Control (RBAC) is a critical framework for managing data access within organizations by assigning permissions based on individual roles, aiming to prevent unauthorized access and minimize human error. The importance of granularity in RBAC, especially at the table level, is emphasized as a means to enhance data security, regulatory compliance, and the separation of user and administrator responsibilities. The text highlights the potential pitfalls of inadequate RBAC implementation, such as accidental data mishandling, and discusses best practices for maintaining effective RBAC systems, including clear role definitions, regular reviews, and establishing safeguards. The article underscores the need for robust RBAC to prevent mishaps and protect sensitive data, using Starburst Galaxy as an example of a platform that facilitates granular RBAC management.

The text discusses the challenges and inefficiencies associated with traditional ETL/ELT processes that often rely heavily on custom coding in languages like Java, Scala, or Python, leading to maintenance burdens and increased time-to-value for business initiatives. It highlights how a significant portion of data engineers' time is wasted on repetitive maintenance tasks, which incurs high costs for enterprises. The text proposes using SQL as a more cost-effective and maintainable alternative for data pipelines, given its popularity and the ease with which it can be understood by both technical and non-technical professionals. Starburst's approach to ETL/ELT, particularly with its Project Tardigrade, offers a solution by integrating SQL with fault-tolerant capabilities and optimized query performance, reducing the need for manual tuning and allowing data engineers to focus on adding business value. With Starburst, enterprises can streamline their data pipeline processes, benefiting from both interactive and batch processing capabilities, and leverage fully-managed SaaS platforms like Starburst Galaxy for efficient infrastructure management.

Selecting a data analytics solution with external audits by reputable third-party firms provides tangible evidence of robust security and compliance practices, which is crucial for businesses prioritizing data protection. Starburst, for instance, underscores its commitment to data security through ISO 27001 certification and SOC 2 Type 1 and 2 audits for its Galaxy offering, demonstrating management's top-down approach to integrating security into business processes. This external validation not only simplifies a company's audit process by providing proof of secure management in the supply chain but also confirms adherence to standard operating procedures, crucial for growth and scaling. Opting for a provider with multiple audits, such as SOC2 and ISO 27001, indicates a commitment to comprehensive security coverage, which is vital for protecting sensitive information and reducing cybersecurity risks during the procurement process.