How Notum Implemented A/B Testing for Strapi.io

Notum implemented A/B testing on the Strapi.io website using Amplitude's Experiment tool to allow the marketing team to conduct experiments with minimal development effort. The process involved creating a hypothesis, picking a metric, creating a variant, deciding who will see it, allocating users, activating the experiment, and analyzing results through the Amplitude dashboard. The solution used a global wrapper that fetched all variants on mount, improving component load times after an initial longer initialization. This approach allowed the marketing team to modify elements like text or color if a variant key was present, though it posed a potential long-term impact on page load speed.