July 2026 Summaries

The revamp of the profiling dashboard involved transitioning from an SVG-based renderer to a Canvas-based one, significantly enhancing performance and user experience. Previously, each frame in a flame graph was represented as a DOM node, which required the browser to manage numerous elements, resulting in slower interactions. By utilizing Canvas, the new renderer eliminates the need for these DOM nodes, instead directly painting pixels from precomputed data, which streamlines rendering and interactions like zooming, scrolling, and resetting. This shift reduces the time for rendering operations, as seen in metrics where Canvas outperforms SVG, cutting rendering times by several factors and enhancing frame rates. However, the transition to Canvas comes with trade-offs; Canvas necessitates manual handling of features like hit-testing, text truncation, and tooltip rendering that were previously managed by the DOM. Despite these challenges, the overall improvement in responsiveness and speed showcases the effectiveness of the new approach.

The blog post discusses the innovative use of Delta Lake tables and the integration of DataFusion for querying data within a Rust-based database system. The system uniquely distributes tenant data across two Delta Lake tables, requiring a process to read from both to get a comprehensive view. Initially, the custom delta-rs library fork was used for data operations, but the team explored DataFusion's capabilities to streamline this process. By building a DataFusion TableManager and the GreatLakes TableProvider, they enabled efficient parallel processing and SQL querying of the Delta Lake actions, enhancing performance. However, while DataFusion proved faster for large datasets, it incurred overhead costs that affected performance for smaller queries, such as those involving 10 commits, due to the physical planning and optimization steps. The team plans to refine this process to optimize performance further, balancing the use of DataFusion and bespoke code for varying query sizes.