GPT-4o-mini is a powerful generative AI application that offers fast and high-quality outputs across various workloads, but its frequent inference cost can add up quickly. In contrast, Alibaba's Qwen2.5-14B, an open-source alternative, provides comparable results at a significantly lower cost when hosted in-house. A switch to Qwen2.5-14B enables teams to support flexible LLM choices and take advantage of automated solutions like AI Enabler for deploying and testing models, as well as dynamically routing requests for cost and performance optimization. Benchmark tests revealed that Qwen2.5-14B is 2.3 times less expensive than GPT-4o-mini at full capacity, while its cost-effectiveness varies depending on utilization levels. By using Cast AI's platform and following a few simple steps, teams can test and deploy the most optimal LLM model for performance, cost, and security, making it an attractive alternative to running proprietary models.