Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox
Blog post from Hugging Face
Microsoft and Hugging Face describe ThinkingBox-Training, a reinforcement-learning framework that converts executable checks of an agent’s final database state into binary rewards for training agents on stateful business tasks. Using a fixed pool of 187 non-benchmark tasks selected through repeated base-model probes for “offline policy-relative difficulty,” the team fine-tuned Qwen3.8-27B with 50 GRPO steps and evaluated it on the separate 507-task ThinkingBox-Bench. Average success increased from 51.70% to 60.78%, while the number of tasks completed correctly in all 20 attempts rose from 38 to 107, though pass@20, measuring tasks solved at least once, declined slightly from 453 to 446. The reported results suggest that training primarily improved repeatability rather than broadening coverage, with gains across domains and an estimated reduction in cost per dependable task from $24.36 to $8.00. The approach rewards correct terminal outcomes rather than prescribed tool-call sequences, using deterministic database checks for most tasks and limited LLM-assisted judgment where database state alone is insufficient. The authors released the training stack and documentation, while noting that benchmark and training tasks remain distinct but share the same task framework and some infrastructure, limiting the scope of transfer claims.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| MCP | 6 | 11,921 | 1,232 | 235 | +12% |
| LLM | 4 | 6,578 | 1,243 | 236 | +9% |
| Opus 5.5 | 4 | 624 | 118 | 53 | +19% |
| GPT-6 Astra | 3 | 330 | 80 | 42 | -48% |
| AI Coding Assistant | 1 | 1,961 | 544 | 148 | +23% |
| AI Model Fine-tuning | 1 | 868 | 227 | 77 | +17% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.