Home / Companies / Semaphore / Blog / Post Details
Content Deep Dive

Flaky Test API Now GA, New Auto-Fix Skill, Skill Quality Improvements

Blog post from Semaphore

Post Details
Company
Date Published
Author
Pete Miloravac
Word Count
284
Company Posts That Month
3
Language
English
Hacker News Points
-
Summary

Sem-ai's API now provides access to flaky test data, allowing users to identify and fix the most disruptive tests with an AI agent for a cost of approximately $1 to $1.50 per fix. This service ranks tests by disruption count and includes metadata like the last failure timestamp and relevant logs, which can be accessed through GitHub. The sem-ai skill for fixing flaky tests automates the process by analyzing the root cause, implementing solutions, and verifying fixes through local tests or by using Semaphore test boxes to run tests across multiple machines for high-confidence validation. Recent updates to sem-ai skills include additional examples, improving agent adherence to instructions and overall reliability. Future updates will address user and organization management in the API, with ongoing improvements based on user feedback.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
AI Agents 1 4,874 1,103 240 -1%