With the release of Xray Cloud 15.0.0, Xray expands its latest AI capabilities with the introduction of AI Test Prioritization, joining two recently released features: Xray's Rovo Test Plan Summarizer and AI-generated Manual Scripts for Test Case Designer, introduced in Xray Cloud 14.0.0.
Testing is rarely just about executing test cases. Teams need to understand where risk exists, how testing is progressing, and whether a release is ready to move forward. As delivery cycles become shorter, answering these questions quickly becomes more challenging.
Together, these capabilities support different stages of the testing lifecycle. AI Test Prioritization helps teams determine which tests should be executed first. Rovo Test Plan Summarizer provides an immediate understanding of test progress and release readiness. AI-generated Manual Scripts for Test Case Designer accelerate the creation of structured, data-driven test scripts.
All of these capabilities are available directly within Jira and Xray, allowing teams to work within their existing environment while improving how they plan, execute, and understand testing.
Xray's AI Test Prioritization introduces a smarter way to decide which Tests should be executed first when time is limited.
QA teams often work within constrained testing windows where running an entire Test suite isn't feasible. Rather than relying on manual prioritization, Sembi IQ analyzes historical testing data and automatically re-ranks Tests within Test Plans and Test Executions, helping teams focus on the areas that present the highest risk.
AI Test Prioritization considers multiple signals, including:
The feature also introduces several capabilities designed to improve both efficiency and transparency:
AI Test Prioritization is available across all Xray Cloud tiers, with usage limits based on your subscription:
By helping teams focus on the most important Tests first, AI Test Prioritization supports faster release decisions without requiring teams to manually analyze large volumes of testing data.
Understanding the status of a Test Plan often requires navigating through multiple views, reviewing execution metrics, and manually connecting information spread across Tests, Test Executions, Requirements, and Defects. Powered by Atlassian, Xray's Rovo Test Plan Summarizer simplifies this process by retrieving, interpreting, and transforming Xray Test Plan data into clear, natural language summaries directly within Jira.
Instead of manually gathering information from multiple reports, teams receive a consolidated view of the most important Test Plan insights, including:
By bringing this information together in a single summary, the agent helps teams quickly understand the overall health of a Test Plan and identify areas that may require attention before a release.
Because the summary is generated within Jira, teams can review, share, and discuss testing progress without leaving their existing workflow. This makes it easier for QA teams, engineering managers, and other stakeholders to stay aligned on release readiness while spending less time interpreting reports and more time acting on the insights.
In Xray Enterprise, Test Case Designer now includes AI-powered Test Script Suggestions through Sembi IQ, helping teams generate both data-driven AI-generated Manual Scripts or AI-generated Gherkin BDD Scripts using natural language.
Instead of writing every test step manually, users simply describe the scenario they want to test. Sembi IQ then analyzes the prompt together with the existing testing model to generate a suggested script that can be reviewed, edited, and accepted.
The feature supports both:
To improve suggestion quality, teams can optionally configure Design Guidance, allowing Sembi IQ to use testing goals and supporting documentation when generating scripts. Users remain in full control throughout the process, with the ability to edit, accept, or reject individual suggestions before they become part of the final Test Script.
Key benefits include:
The capabilities introduced in Xray Cloud 14.0.0 and Xray Cloud 15.0.0 are designed to support different stages of the testing process.
Together, they create a more connected workflow, where test design, execution, and reporting are aligned and easier to manage.
These features are designed for teams that need to balance quality with delivery speed.
QA Leads can gain clearer visibility into risk and make more informed release decisions.
Test Managers can plan and adapt execution strategies more effectively.
Agile teams can focus their efforts on the most relevant tests within short sprint cycles.
By supporting decision-making at key points in the testing process, these capabilities help teams maintain confidence even when time is limited. Together, the AI capabilities introduced across Xray Cloud 14.0.0 and Xray Cloud 15.0.0 support different stages of the testing lifecycle.
If you are using an older version of Xray, your Jira administrator will need to update the app through the Connected Apps section to access these capabilities.
AI Test Prioritization uses Sembi IQ to intelligently rank Tests within a Test Plan or Test Execution based on historical Test Run data, associated Defects, Test metadata, execution history, and user-defined context. This helps QA teams execute the most relevant Tests first when time is limited.
The feature analyzes multiple factors, including historical Test Runs, recent and overall failure rates, Test flakiness, associated Defects, Test metadata, Requirements, and optional user prompts and Jira labels. Based on this analysis, Sembi IQ automatically re-ranks Tests and provides AI Priority Insights explaining the prioritization.
AI Test Prioritization is available across all Xray Cloud plans, with usage limits depending on your subscription:
Together, Xray Cloud 14.0.0 and 15.0.0 introduce three AI-powered capabilities:
These capabilities support different stages of the testing lifecycle, from test design and execution planning to reporting and release readiness.
Powered by Atlassian, Xray's Rovo Test Plan Summarizer generates natural language summaries of Test Plans directly within Jira. It consolidates execution progress, Requirements coverage, Test results, and linked Defects into a single summary, helping teams quickly assess Test Plan health and release readiness.
Available in Xray Enterprise, AI-powered Test Script Suggestions allow teams to describe a testing scenario in natural language and receive suggested data-driven AI-generated Manual Scripts or AI-generated Gherkin BDD Scripts. Users can review, edit, accept, or reject suggestions before saving them, and optionally use Design Guidance to improve the relevance of the generated scripts based on testing goals and supporting documentation.
Rovo Test Plan Summarizer requires both Xray and Atlassian Rovo to be installed in your Jira environment. AI Test Prioritization must be enabled by a Jira administrator through Xray's AI Hub before it can be made available to all users or selected groups. AI-generated Manual Scripts are available within Test Case Designer for Xray Enterprise customers.