Company
Date Published
Author
Morgan Scalzo
Word count
305
Language
English
Hacker News points
None

Summary

The virtual meetup hosted by John Wilke, featuring Statsig team members Craig Sexauer and Pierre Estephan, provided insights into the integration of experimentation into project plans, emphasizing its role in helping product teams achieve aggressive KPI targets despite resource constraints. The discussion highlighted the importance of selecting the right metrics, the significance of measuring all product changes, and the value of smaller, scrappy experiments in prioritizing product features during the second half of the year. Additionally, the session explored the benefits of long-term Holdouts and the CUPED method for faster, less biased experiments, while also drawing on insights from experts like Ronny Kohavi and Allon Korem on fostering a robust experimentation culture. The meetup underscored the evolution of platforms like Optimizely and detailed how A/B testing has reshaped strategies at companies like Facebook, reflecting the dynamic nature of product experimentation and Statsig's unique company culture.