DecisionFormer
Blog post from Hugging Face
DecisionFormer is an Apache 2.0 open-source library from FrontiersMind for converting Hugging Face backbones into calibrated decision models that score predefined options in a single forward pass rather than generating text. It supports choice, yes/no, and ordinal-score questions, returning probability distributions, selections or expected scores, and confidence measures derived from distribution shape, with per-question-type temperature calibration fitted on held-out data. Users configure models through YAML files and can fine-tune with full training, LoRA, QLoRA, or head-only modes across decoder and encoder architectures, selecting among several decision heads and causal, bidirectional, or prefix-bidirectional attention where supported. The project also releases the deciformer-15k dataset mix, provides tools for data splitting, leakage checks, evaluation, comparison, checkpoint export, API serving through the `/v1/systemone` contract, and optional vLLM support for compatible Qwen-based models. Documentation emphasizes reproducible training, multi-GPU execution, structured task data, distillation and calibration metrics, while noting limitations around remote-code models, some attention modes, vLLM compatibility, storage requirements, and planned additions including FSDP2, shared state encoding, multimodal inputs, and more head types.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Model Fine-tuning | 37 | 868 | 227 | 77 | +17% |
| Jev | 1 | 1,284 | 96 | 54 | -40% |
| LLM | 1 | 6,578 | 1,243 | 236 | +9% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.