Build an Agent That Thinks Like a Data Scientist: How We Hit #1 on DABStep with Reusable Tool Generation

NVIDIA's KGMON (NeMo Agent Toolkit) Data Explorer presents a groundbreaking architecture for autonomous data analysis agents, designed to tackle the challenges of multi-step reasoning and complex data analysis in structured, tabular data. Developed by NVIDIA's Kaggle Grandmasters LLM Agent Research Team, the project showcases a multi-phase methodology that separates foundational knowledge building from rapid inference, leveraging a ReAct agent for open-ended exploratory data analysis and a Tool Calling Agent for rule-based tabular data QA. This approach establishes a new state-of-the-art performance on the DABStep benchmark, achieving a 30x speedup over traditional methods and excelling particularly in hard tasks. By employing a learning loop that generates reusable tools, the system mimics the workflow of a seasoned data scientist, enhancing both the speed and accuracy of data processing. The architecture's effectiveness is validated by its top ranking on the official DABStep leaderboard, outperforming competitors like AntGroup's DataPilot and Google AI's DS-STAR. This innovative framework not only advances data-intensive research but also sets a new standard for scalable, high-quality data insights using LLM-powered agents.