Generative AI's evolving capabilities, exemplified by large foundation models like OpenAI's ChatGPT, have significantly increased the scope for developing innovative applications. Statsig, an experimentation platform, has seen a surge in interest from companies looking to refine AI-based features by testing different parameters and configurations. Notable examples include Captions, WhatNot, and Notion, which have leveraged Statsig to enhance their AI offerings. The platform simplifies experimentation with generative AI, allowing developers to test and compare the efficacy of various foundation models and their configurations in a single environment. This capability is crucial as it provides visibility into the effects on user engagement and model performance, facilitating informed decision-making without unintended consequences. Statsig's ability to conduct simultaneous experiments on app features and foundational model changes makes it a powerful tool for developers, enabling them to innovate rapidly while maintaining control over the impact of their adjustments. As more companies delve into AI applications, Statsig's platform offers a structured approach to experimentation, ensuring that new features are backed by empirical data and insights.