February 2014 Summaries

Heap utilizes PostgreSQL to efficiently manage backend processes by storing event data as hstore blobs organized in arrays, optimizing performance for tasks such as funnel queries. A notable challenge arose when a PostgreSQL function designed to handle large input arrays became inefficient, executing in quadratic time and taking approximately 40 seconds for 100,000 elements due to the way PostgreSQL processes arrays of variable-length elements like hstores. The original approach relied on array indexing, which incurred significant performance penalties, as PostgreSQL had to re-scan arrays for each index access. A solution was found by replacing the indexing method with the use of the `unnest` function, which linearizes parsing the array and allows for efficient deduplication and sorting of events by `event_id`. This adjustment reduced processing time to about half a second for the same input size, demonstrating a more idiomatic and efficient handling of arrays in PostgreSQL. The experience underscores the importance of understanding PostgreSQL's array handling nuances and suggests using `unnest` over direct array indexing for better performance.

The Event Visualizer is a newly launched tool designed to simplify analytics integration by allowing users to track events and generate metrics without any coding knowledge. By using a point-and-click interface, users can define events for analysis in funnels or graphs and adjust them retroactively to include historical data. This tool addresses the need for non-technical individuals, such as marketers, product managers, salespeople, and designers, to access and understand analytics without depending on engineers to set up data collection. By overcoming the bottleneck of requiring technical expertise for event tracking, the Event Visualizer aims to democratize data accessibility and use, enabling more informed decision-making across various roles within a company. Users can explore the tool by signing up for a free trial of Heap, enhancing their ability to visually link on-screen actions with specific events and simplify the analytics process.