Announcing the public preview of Warp Speed in Starburst Galaxy
Blog post from Starburst
Warp Speed, now available in public preview in Starburst Galaxy, is an autonomous caching and indexing solution designed to enhance data teams' performance by accelerating interactive workloads up to 40%. It uses patented technology to automatically identify and cache frequently accessed data, optimizing data lake performance without requiring manual data partitioning strategies. This feature simplifies data operations for teams lacking time or expertise in query optimization, abstracting complex details from end users. Warp Speed significantly improves query execution times by minimizing full table scans and offloading resource-intensive operations, demonstrated by a 5x performance boost and a 10x reduction in CPU time in benchmark tests. Ideal for multi-dimensional data scenarios such as fraud detection and geospatial analytics, Warp Speed allows teams to either speed up workloads or expand data querying capabilities without increasing latency. Accessible through the Galaxy platform, it currently supports AWS S3 and Tabular catalogs and offers insights into index and cache usage for users to evaluate its impact.