A Journey of Driving Down Test Flakes to 0% at Metabase - Part 1

End-to-end (e2e) testing, often seen as the pinnacle of the testing pyramid due to its complexity and cost, presents significant maintenance challenges for teams striving to replicate real user behavior. Many teams, deterred by these challenges, limit their e2e tests despite their potential value. Replay is addressing this issue by providing tools that enhance the understanding of test failures and instabilities, as demonstrated through a collaboration with Metabase, an open-source business intelligence software. By recording and analyzing test runs with Replay DevTools, the team identified issues such as the inability of tests to detect short-lived elements like loading spinners, which were not appearing due to quick API responses. A solution was proposed to use the `setDelay` function instead of `setThrottle` to ensure the spinner consistently appears for a longer duration, thus stabilizing the test. Replay's ability to capture operating system calls allows for the observation of elements rendered briefly, offering a distinct advantage over traditional session recorders and reducing the burden of test maintenance.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.