Automated QA: Testing Your App the Way a Real User Would
Blog post from Factory
Automated QA is a skill designed to enhance software testing by simulating real user interactions within applications and providing structured reports directly to pull requests. This tool operates by executing user-like actions such as filling out forms and calling endpoints, then posting a comprehensive QA report with visual evidence to GitHub, allowing reviewers to quickly assess pass/fail statuses and explore detailed logs. It features a streamlined approach where each pull request receives a single, updated QA comment, eliminating duplicate threads and ensuring fresh results with every commit. The process can be configured as an optional CI check, triggered on demand, enabling teams to focus on significant changes without disrupting workflows. Developers can also conduct local QA sessions to test branches before pushing, offering a fast feedback loop for broken flows. Setup involves running a command in a Droid session, which tailors the QA skill to the specific project by analyzing the codebase and collecting contextual information. This integration into the development loop ensures that testing becomes a seamless and reliable part of the code review process, providing clear and actionable insights without additional dashboards. Automated QA is included in all Factory plans, and comprehensive documentation is available for further details.