Response Healing: Reduce JSON Defects by 80%+

Response Healing is a new feature introduced by OpenRouter to automatically correct malformed JSON responses from large language models (LLMs) before they reach applications, significantly improving reliability in structured output requests. This feature has led to substantial reductions in defect rates, with Gemini 2.0 Flash and Qwen3 235B models experiencing declines of 80% and 99.8% respectively. Response Healing is particularly effective in fixing common JSON syntax errors such as trailing commas and missing brackets, and it operates at inference time without logging completions. Although it enhances JSON syntax reliability, it does not address schema adherence issues, which remain a separate challenge. The plugin, which is free to use and adds negligible latency to response times, can be enabled through OpenRouter’s settings, while also offering potential XML output support upon request.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.