Issue 4: A/B Testing at Etsy, New Adversarial Attach, MLOps Landscape
Blog post from Comet
The Comet Newsletter's fourth issue delves into several developments in AI and machine learning, including a new adversarial attack called DeepSloth, which targets Adaptive Deep Neural Nets to increase latency in model deployments across edge devices and cloud servers. The newsletter also highlights Etsy's use of the CUPED method for more accurate A/B testing by reducing noise with pre-experiment data, allowing for shorter experiments with smaller sample sizes. Furthermore, it explores the application of Transformers in Few-Shot Learning, demonstrating how large language models like GPT-Neo can perform tasks with minimal data input at inference time without domain-specific fine-tuning. Additionally, the newsletter discusses the burgeoning MLOps landscape, offering insights on selecting the right tools for machine learning projects through a decision framework that considers the specific needs and adoption strategies of organizations.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Model Fine-tuning | 2 | No monthly metrics for this publish month. | |||
| LLM | 2 | 62 | 14 | 7 | +130% |
| AI Guardrails | 1 | No monthly metrics for this publish month. | |||
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.