March 2021 Summaries

The article critiques the conventional data warehouse model for its inherent coordination bottlenecks, despite its foundation on scalable parallel database systems, and introduces the concept of a "data mesh" as a solution. The data mesh allows teams to work independently on specific datasets, mirroring the parallel processing of computers, thereby reducing the need for coordination and enhancing scalability. While it decentralizes data management and empowers teams to take full ownership of their datasets, it also risks creating data silos due to diverse team preferences for data tools and storage formats. The article emphasizes the importance of systems like Presto, Trino, and Starburst, which can query diverse data sources independently of storage, to overcome these silos and facilitate the implementation of a data mesh. The author argues that with advancements in data management technology, the rationale for maintaining centralized data warehouses is diminishing, making the data mesh a more viable and modern approach to data management.

Starburst Global Access Control is a security solution designed to ensure that data in Starburst Enterprise is accessed only by authorized users, addressing the need for stringent data security measures in large organizations. It operates by enforcing predefined policies that restrict or mask data based on user access permissions, thus preventing unauthorized exposure to sensitive information. The system includes features such as access control policies, column masking, and row-level filtering, which collectively allow organizations to manage who can see or modify data at various levels. These policies can be tailored to specific groups or departments, enabling companies like the example corporation to control data access in alignment with their internal structures. Additionally, Starburst Global Access Control integrates with Apache Ranger for centralized policy management, simplifying security architecture across multiple clusters, and it supports sandbox environments for development and testing purposes. This comprehensive approach to data access management highlights the importance of planning and implementing security measures to protect sensitive data in today's data-driven landscape.

Starburst Galaxy, a new offering from Starburst, aims to simplify the connection between data and business value by leveraging managed infrastructure and the power of Starburst Enterprise. The product is inspired by the astronomical concept of starburst galaxies, where the gravitational interactions between galaxies lead to new star formation, symbolizing how bringing together diverse datasets can illuminate new analyses and enhance data-driven decision-making. The product's name reflects this metaphor, suggesting that just as starburst galaxies catalyze the creation of new stars and elements, Starburst Galaxy facilitates the rapid integration of data sources, enabling businesses to extract greater insights and value. The product is designed to support complex and mature data environments, offering a modern, secure, and user-friendly experience for data teams looking to optimize their analytics processes.