June 2025 Summaries

At the Iceberg Summit, a presentation was given on I/O optimizations in compute engines, focusing on the Bodo engine's capabilities to enhance performance in Iceberg-backed environments. The discussion, led by the speaker and Srinivas Lade, highlighted practical strategies to reduce query times, optimize file access, and improve performance, notably cutting query times from 900 seconds to 60 seconds and reducing the number of rows read from 60 billion to 60 million. The presentation emphasized Bodo's manager-less, SPMD architecture, which supports high-performance distributed computation. Future improvements, such as enhanced caching strategies, alternative file formats, and better utilization of sort/partition information at read time, were also explored. The talk targeted those interested in compute engines and query optimization on Iceberg, inviting further discussion and feedback from the audience.

Bodo's latest update, version 2025.6, introduces powerful data manipulation features to its DataFrame library, enabling users to work with their data more efficiently than ever before. Native support for reading Iceberg tables allows for seamless integration with this popular data storage format, while core operations such as merging and sorting have been unlocked, providing a solid foundation for analysis and processing workflows. The Bodo API has also seen significant expansion with over 80 new methods added, covering advanced string manipulation, sophisticated date/time handling, and highly-requested functionality like `isin()` and `clip()`. Furthermore, the core engine has been enhanced to support complex filter expressions and improved performance in various computations, including faster data previews. This release lays the groundwork for future developments, particularly groupby operations, which will be supported in a forthcoming update.