TestGenie – Troubleshooting and FAQs

This page answers common questions and helps you troubleshoot issues when using TestGenie.

AI Test Case Generation

Why are no test cases generated?

Possible reasons:

  • Insufficient context — the scenario description is empty or too vague, or the coverage issue has no meaningful summary or description

  • Project not configured — Test Case or Test Step issue types are not mapped in Issue Mapping, or required link types are missing

  • Unsupported issue type — the current issue is not configured as a valid requirement (coverage) or Precondition type

What to do:

  • Provide a clearer scenario description

  • Check and complete the Issue Mapping configuration for the project

  • Ensure the issue type of the current issue matches what is configured as the Requirement issue type in Issue Mapping

Why is my issue not recognised as a requirement or precondition?

TestGenie uses your Issue Mapping configuration to identify issue roles:

  • If the issue type is not mapped as a Requirement or Precondition type, the agent will not treat it as one

  • This applies regardless of the issue's content or labels

What to do:

  • Open Issue Mapping

  • Add the issue type to the appropriate field (Requirement issue type or Precondition issue type)

  • Save Changes, then retry generation from that issue

What happens if Issue Mapping configuration is missing?

If TestGenie detects missing or incomplete configuration:

  • It will not proceed with creating Jira issues

  • The agent will inform you that configuration is missing and ask you to configure the project first

What to do:

  • Open Issue Mapping and fill in all required fields across all three sections

  • Save Changes

  • Return to the Rovo agent and restart the generation session

How does test case regeneration work?

Regeneration of planned test cases happens automatically during the planning stage when the context changes — a new scenario description, a change to preconditions, or a different requirement issue.

Rules:

  • Regeneration only happens before Test Case draft generation

  • Once you have confirmed drafts, the planned list is fixed for that session

  • If you need a completely new set of test cases after drafts are generated, start a new generation session with the Rovo agent

Test Plans

Why is the Execute Plan button not doing anything?

Possible reasons:

  • No test cases linked — a plan with no linked test cases cannot be executed

  • Execution Planning not configured — the Test Execution issue type or link types in the Execution Planning section of Issue Mapping are missing

  • Enable Test Execution tracking is not checked — this checkbox in the Execution Planning section must be enabled for execution tracking to work

What to do:

  • Verify that at least one test case is linked to the plan via the Link Test Cases action

  • Open Issue Mapping, check the Execution Planning section, fill in all fields, and tick the Enable Test Execution tracking checkbox

  • Save Changes, then retry

Why can I not see the Active Runs sidebar?

The Active Runs sidebar only appears when at least one execution run exists for the plan. Click Execute Plan to create the first run.

Test Execution

Why is the TEST RESULT column not showing a dropdown?

This can happen if:

  • The Enable Test Execution tracking checkbox in Issue Mapping → Execution Planning is not checked

  • The execution run was created before the checkbox was enabled — create a new run after saving the updated config

The defect link action only appears on test cases that have been marked as Failed. Mark the test result as Failed first, then the ACTIONS column will show the defect link option.

Also verify that the Defect Orchestration section in Issue Mapping is fully configured — Defect issue type, Defect ↔ Execution link type, and Defect ↔ Test Case link type must all be set.

Why does the stat card count not match the number of test cases I can see?

The stat cards reflect the saved result states stored in the system. If you have just marked a result, wait a moment for the count to update. If the mismatch persists, refresh the page.

Export Report

Why is the Export Report button not generating a file?

  • Ensure the execution run has at least one test case with a saved result

  • If the run is empty (all test cases are Not Executed with no results saved), the export may produce an empty report

Try marking at least one test result before exporting.

Licensing

Why is there a license warning banner on the Get Started screen?

The banner appears when no active TestGenie app license is found for your site. This can happen if:

  • The app was installed but not purchased/subscribed to

  • Your subscription has expired

  • The license is on a different Jira site

What to do:

  • Contact your Jira administrator to verify the subscription status on the Atlassian Marketplace

  • Teams up to 10 users are on the free tier and do not require a paid license