Company
Date Published
Author
Isaac Warren
Word count
206
Language
-
Hacker News points
None

Summary

At the Iceberg Summit, a presentation was given on I/O optimizations in compute engines, focusing on the Bodo engine's capabilities to enhance performance in Iceberg-backed environments. The discussion, led by the speaker and Srinivas Lade, highlighted practical strategies to reduce query times, optimize file access, and improve performance, notably cutting query times from 900 seconds to 60 seconds and reducing the number of rows read from 60 billion to 60 million. The presentation emphasized Bodo's manager-less, SPMD architecture, which supports high-performance distributed computation. Future improvements, such as enhanced caching strategies, alternative file formats, and better utilization of sort/partition information at read time, were also explored. The talk targeted those interested in compute engines and query optimization on Iceberg, inviting further discussion and feedback from the audience.