Company
Date Published
Author
CARTO Contributors
Word count
608
Language
English
Hacker News points
None

Summary

Measuring tile rendering processes to improve performance` Our infrastructure's tile generation process consists of two main steps: gathering required data from the database filtered by tile bounding box, and sending this data to the renderer to generate the tile. The process has a wide improvement margin for data gathering due to its time and resource consumption compared to actual tile rendering. To better understand and measure the process, we gathered PostgreSQL logs using a custom parser to extract relevant information such as query execution times, XYZ coordinates of requested tiles, and affected tables. We also processed inconsistencies in log line formatting, merged queries that were split across multiple lines, and aggregated prepared statement execution times. The resulting data allowed us to identify query runtimes and how many times the same tile is generated, providing valuable insights to improve the process.