How (not) to test signup and keep your CEO happy

Checkly, a product testing platform, has implemented end-to-end (E2E) monitoring for its own signup flow to ensure that important transactions are properly tracked and to prevent flooding of the database with ghost accounts. The E2E check uses Playwright to automate user interactions, including filling out email and password fields, clicking the "Signup" button, and deleting the account after a certain period. However, this check was recently pointed out by Checkly's CEO as not being clean enough, highlighting the importance of data quality in product development. To address this issue, the team had to filter out the E2E check from their analytics tools, such as Segment, and tweak the script to suit their needs, including introducing reusability with code snippets.