Regression Testing
Regression testing runs a predefined test group against every PR preview deployment and posts the results to the PR. Reviewers see pass/fail results directly in GitHub without leaving the review, and broken changes get caught before merge.
Use this when you already know the flows that matter and want them verified the same way on every PR. To also catch issues nobody wrote a test for, pair it with the Exploration agent.
See Pull Request Testing for prerequisites, supported providers, and troubleshooting.
Setup
- Open your project and go to the PR Testing tab.
- Enable Test groups for PR runs and select the test group to run on pull requests. Enabled tests in this group will execute against every new deployment preview.
- In Integrations → Vercel, connect Vercel and choose the matching Vercel project.
- If Vercel deployment protection is enabled, add a bypass token.
Optional: in Integrations → GitHub, choose a target branch if you only want PRs aimed at one base branch, such as main, to trigger automatic runs.
Every new preview deployment now triggers the selected test group automatically.
Disabled tests are skipped in PR runs but remain available for manual runs.
If the selected group uses a Preparation Test, PR runs honor it too: the prep test runs first, web consumers reuse the saved session, and non-web consumers stay in the batch without browser-session reuse.