How Contextual AI automated CI with Modal GPUs

Contextual AI, a company offering an end-to-end platform for building enterprise AI applications, faced challenges with their continuous integration (CI) process due to the need for flexible resources. They used tiny models as stand-ins during large-scale tests and had to manually run tests on in-house GPU nodes, which was inconvenient and time-consuming. After searching for alternative CI providers, they found Modal, a platform that offers flexible configurations of GPUs on-demand, allowing them to automate their test suite and maximize developer iteration speed while maintaining a high quality bar.