Announcing Server-Side Scan Planning with Starburst and Databricks

Starburst Enterprise Platform 481-e STS introduces server-side scan planning for Iceberg through the REST Catalog API, allowing compatible catalogs to return exact file scan tasks and scoped credentials without requiring Starburst to process Iceberg metadata files. Its initial integration with Databricks Unity Catalog uses the Iceberg 1.7.0 `/plan` endpoint and Unity Catalog’s ScanAPI to centrally enforce fine-grained governance policies, including attribute-based access controls, row filters, column masks, and governed tags, for managed Iceberg tables queried through Starburst. Unity Catalog evaluates user policies, creates sanitized temporary data files, and provides Starburst only with authorized files and short-lived credentials, enabling consistent policy enforcement across Databricks and external engines without embedding Databricks-specific policy logic in Starburst. Starburst plans to support any Iceberg REST catalog implementing the endpoint, positioning the capability as part of broader industry efforts toward interoperable, centralized data governance.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.