April 2021 Summaries

This post discusses the implementation of a practical attack on synthetic data models to measure unintended memorization in neural network models, as described in "Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks" by Nicholas Carlini et al. The authors use this attack to evaluate how well synthetic data models with various neural network and differential privacy parameter settings protect sensitive data and secrets in datasets. They work with a smaller dataset containing sensitive location data, which is considered challenging to anonymize. The authors insert canary values into the model's training data and measure each model's propensity to memorize and replay these canary values. Results show that differential privacy works well at preventing memorization of secrets across all tested configurations, while gradient clipping also effectively prevented any replay of canary values with only a small loss in model accuracy.

The Gretel team has developed an AI-based bartender that generates new cocktail recipes. Inspired by the desire to break away from repetitive drinks, the team trained a machine learning model on a large database of cocktail recipes and used it to create innovative mixtures. Despite initial challenges with the AI's performance, they eventually achieved impressive results. The Gretel Bartender can now generate an infinite number of unique cocktails based on a user's preferred base liquor. To access this service, users simply need to tweet their favorite spirit to the Gretel Bartender Twitter bot and receive a custom recipe in return.