Testing Claude Fable 5: Built a Java Module & a Security Flaw
Blog post from Sonar
Claude Fable 5, Anthropic's advanced coding model launched in 2026, demonstrated its ability to rapidly generate a functional Java module by creating a REST API in 13 minutes using the microsoft/gctoolkit codebase. Despite its efficient output, which included handling concurrency and sanitizing filenames, the module failed a quality gate due to a HIGH-severity security vulnerability and insufficient test coverage identified by SonarQube Cloud. The model effectively addressed path traversal issues but overlooked an insecure temporary directory vulnerability linked to OS-level knowledge, illustrating a gap in its training data. While the experiment showcased the model's ability to produce working code autonomously, it also highlighted the non-deterministic nature of AI-generated code, where different runs can introduce varying higher-severity bugs. The absence of a quality feedback loop during development meant the model could not self-correct these issues in real time, emphasizing the importance of integrating existing quality infrastructure, like SonarQube, to catch common issues without requiring AI-specific adjustments.