Open-source AI models, particularly smaller and fine-tuned ones, are increasingly seen as the future due to their efficiency and cost-effectiveness, as demonstrated in experiments where smaller models outperform larger commercial counterparts. Llama-2-70B, a large open-source language model, has historically posed challenges in training and serving but can now be fine-tuned more easily and for free using Ludwig, an open-source framework that enhances model training with a YAML-based interface. Ludwig introduces optimizations such as QLoRA-based fine-tuning and gradient accumulation, allowing Llama-2-70B to be fine-tuned on a single A100 GPU. A case study on structured JSON generation from natural language text, involving the CoNLLpp Named Entity Recognition dataset, revealed that fine-tuning Llama-2-70B significantly improves performance over few-shot predictions from models like GPT-3.5 and GPT-4. The fine-tuned model achieved nearly perfect JSON outputs and a high Jaccard similarity score, demonstrating its effectiveness in real-world applications. The process is accessible to organizations with limited hardware resources and can be further supported by platforms like Predibase, which offer efficient, cost-effective, and configurable fine-tuning and deployment solutions.