Skip to main content

Commit-Based Testing

Commit suites automatically select and run the tests most relevant to a specific git commit. Use them for pre-merge verification and post-deploy checks.

How It Works

When you create a commit suite, DebuggAI:

  1. Receives the commit hash and your changes info (diff or JSON)
  2. Analyzes what changed in the repository
  3. Automatically selects the E2E tests that cover those changes
  4. Groups them into a suite tied to that commit

No manual test selection needed — the AI picks the relevant tests based on what changed.

Creating a Commit Suite

From the Suites page, open the Create Commit Suite dialog:

FieldRequiredDescription
Repository NameYese.g., my-app
Repository PathYese.g., /path/to/repo
Commit HashYesFull or short hash
TitleNoHuman-readable label
DescriptionNoContext about the commit
Changes InfoNoUpload a JSON/diff file or paste changes manually

Providing detailed changes info improves test selection accuracy.

Running a Commit Suite

Once created, open the suite and click Run. All selected tests execute as a group.

Track progress in the Run History tab — status moves from Pending to Running to Completed or Error. Each run shows duration, who started it, step count, and a link to the full run output.

Commit Suite vs Regular Suite

RegularCommit
Test selectionManualAutomatic (AI)
Tied toProjectCommit hash
Use caseOrganizing tests by featureCI/CD, pre-merge verification
CreationManualVia dialog with commit info

Viewing Commit Info

On the suite detail page, commit suites show a Commit info card in the left panel with the full commit hash and a summary of the changes used to select tests.

Workflow: Pre-Merge Verification

  1. Push your branch
  2. Create a commit suite with the branch's HEAD commit hash
  3. Paste or upload the diff from your PR
  4. Run the suite
  5. Review results before merging