Introducing SAM – A 7B Small Agentic Model that outperforms GPT-3.5 and Orca on reasoning benchmarks -

SuperAGI has developed SAM (Small Agentic Model), a 7B model that exhibits strong reasoning capabilities, outperforming larger state-of-the-art models like GPT-3.5 on multiple reasoning benchmarks such as GSM8k and ARC-C. Despite being trained on a significantly smaller dataset, SAM-7B achieves superior performance by leveraging a strategically curated dataset and explanation traces to enhance its reasoning abilities. The model was fine-tuned using open-source large language models (LLMs) and evaluated with a custom pipeline to ensure fair comparison across benchmarks like HellaSwag and Winogrande. The research emphasizes the importance of data quality over quantity and introduces a method of generating reasoning traces through a Reasoning Skeleton Prompt to guide open-source LLMs in producing consistent and diverse explanations. Although SAM-7B excels in reasoning tasks, it is not suited for conversational applications due to the absence of safety and bias guardrails, indicating that while the model is promising for reasoning, it requires further development for broader applications.