July 2026 Summaries

Retool faced challenges with integrating AI models into their platform due to differing update cadences between their cloud and self-hosted services, leading to discrepancies in model availability and provider rate tracking. To address this, they developed an AI model registry, a continuously refreshed JSON document that maintains accurate model definitions and provider rates, independent of software release cycles. This architecture ensures that new models and rate changes are quickly available across all deployments, providing a seamless experience for customers. By adopting a lenient parser and strict producer model, Retool ensures backward compatibility, allowing older deployments to function without disruption when encountering new data fields. The registry's append-only history and compile-time enforcement of rate data further enhance accuracy and governance, illustrating the importance of decoupling configuration changes from binary releases.