Flaky Test API Now GA, New Auto-Fix Skill, Skill Quality Improvements
Blog post from Semaphore
Sem-ai's API now provides access to flaky test data, allowing users to identify and fix the most disruptive tests with an AI agent for a cost of approximately $1 to $1.50 per fix. This service ranks tests by disruption count and includes metadata like the last failure timestamp and relevant logs, which can be accessed through GitHub. The sem-ai skill for fixing flaky tests automates the process by analyzing the root cause, implementing solutions, and verifying fixes through local tests or by using Semaphore test boxes to run tests across multiple machines for high-confidence validation. Recent updates to sem-ai skills include additional examples, improving agent adherence to instructions and overall reliability. Future updates will address user and organization management in the API, with ongoing improvements based on user feedback.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Agents | 1 | 4,874 | 1,103 | 240 | -1% |