November 2024 Summaries

GrowthBook has released beta bandits as part of its 3.3 update for Pro and Enterprise customers, allowing users to test multiple variations against each other while driving traffic towards better-performing arms. Bandits are particularly useful in short-term promotional campaigns or when testing multiple call-to-action designs, but they require a clear decision metric that is relatively stable and may not be ideal for learning about user behavior on several metrics. GrowthBook's bandits use Thompson Sampling to balance exploration and exploitation while preserving user experience through Sticky Bucketing, which ensures consistent user experiences across sessions. The platform accommodates changing user behavior by adjusting weights to prevent biased results, and it integrates with popular data warehouse solutions such as BigQuery, Snowflake, and Databricks. GrowthBook's bandits can adaptively allocate traffic within hours or less if events land in the data warehouse quickly. Users can get started with Bandits for free or check out the setup guide for more information. The platform is designed to live on top of existing data infrastructure without complicating it.

GrowthBook version 3.3 has been released with several key features and improvements. Multi-Arm Bandits are experiments that dynamically allocate traffic to maximize efficiency, reducing losses and risks when testing multiple variants. The new metric capabilities include Metric Groups, which allow users to save and organize groups of metrics, and Live SQL Preview, enabling real-time preview of metric behavior. Additionally, a new design system has been implemented, providing slicker visuals, improved keyboard navigation, and better Dark Mode support. A Built-in Managed Warehouse is also being launched, offering a fully managed ClickHouse option for teams without the resources to set up their own data warehouse, allowing them to automatically benefit from ongoing improvements to the Warehouse Native offering. These updates aim to empower users to create, organize, and analyze metrics more efficiently than ever before.

GrowthBook has announced its integration with the modern open-source JavaScript registry, JSR, to provide a seamless experience for implementing and managing feature flags in JavaScript and TypeScript applications. This collaboration simplifies the process of publishing and importing JavaScript modules, offering features like TypeScript support, auto-generated documentation, and enhanced security through provenance attestation. With this integration, developers can easily install GrowthBook using the deno add command or npm, generate a deno.json file listing project dependencies, and use GrowthBook with Express servers to implement feature flags in their applications. The JS SDK offers an excellent developer experience with first-class TypeScript support, auto-generated documentation accessible in code editors, and more. This integration brings benefits like streamlined integration and utilization of feature flagging in development workflows, empowering developers with a seamless experience for implementing and managing feature flags in their applications.