Company
Date Published
Author
Tore Hanssen
Word count
652
Language
English
Hacker News points
None

Summary

Statsig provides support for SDKs across various languages and frameworks, including popular client-side technologies like React and JavaScript, and server-side languages such as Node.js and Python. These SDKs are designed to handle either single-user scenarios on the client side, where evaluations are done upfront, or multi-user server-side scenarios, where gates and experiments are evaluated locally. To ensure consistency across its SDKs, Statsig developed a server SDK consistency test that evaluates the behavior of SDKs against the Statsig backend. To streamline testing, they introduced Kong, a Typescript-based framework that allows for a "write once, run anywhere" approach, enabling comprehensive testing of SDK behavior using the Jest framework. These tests are crucial when making server or SDK changes to ensure stability and reliability. Future plans include extending the tests to long-running webserver scenarios to check for performance issues like memory leaks and race conditions, incorporating complex test cases, and using production traffic to validate SDK functionality. Additionally, insights into experimentation culture and strategies for running A/B tests effectively are discussed, alongside highlights of Statsig's dynamic work environment and innovative projects.