Prem-1B-SQL: Fully Local Performant SLM for Text to SQL

PremSQL is an open-source, local-first Text-to-SQL library designed to promote data privacy and control by avoiding third-party models, offering customizable pipelines for natural language querying on private databases. The library supports small language models and has released Prem-1B-SQL, a fine-tuned model for generating SQL queries from natural language inputs, available on Hugging Face with over 10K monthly downloads. The evaluation of Prem-1B-SQL on datasets like BirdBench and Spider showcases its performance, achieving notable execution accuracy on challenging tasks, although it still faces challenges with increasing difficulty levels. The fine-tuning process of Prem-1B-SQL involved using various datasets and highlighted the importance of model parameter selection and error handling for improving performance. Future plans for PremSQL include scaling up to larger models, enhancing inference methods, and expanding features to further democratize the field of AI-driven data analysis.