Test automation is essential for modern software delivery. It supports faster feedback loops, strengthens release confidence, and enables continuous integration at scale. Yet despite its importance, many teams struggle to expand automation at the pace they need.
The biggest obstacle is not validating functionality. It is converting structured manual tests into actionable automation scripts.
Manual tests already represent validated logic. They capture business intent, functional coverage, and risk mitigation. However, transforming those tests into framework-ready scripts often requires time-consuming rewrites, specialized coding expertise, and handoffs between testers and automation engineers.
With Xray’s AI Test Script Generation, that barrier is removed directly inside Jira, and it's available for Xray Advanced and Enterprise tiers.
This new capability transforms structured manual test cases into actionable automation scripts in minutes, without exiting your workflow within Jira and Xray.
Removing the manual-to-automation bottleneck
For years, teams have treated manual and automated testing as separate tracks. Manual tests validate business behavior and reduce early risk. Automated tests provide repeatability and scalability. The transition between the two has traditionally required starting over, but Xray’s AI Test Script Generation changes that flow.
Instead of rewriting validated tests from scratch, teams can now start from an existing manual test case in Jira and select the new “Automate Test” option:
From there, they choose their framework and language, including support for Playwright and Selenium, and generate a script aligned with their stack.
The AI interprets the intent behind structured test steps and produces:
- A framework-compatible automation script
- Configuration and dependency guidance
- A structured checklist to refine and complete the script
Generated scripts may include placeholders such as <BASE_URL> or <USERNAME>. These placeholders must be replaced with environment-specific values like application URLs, credentials, or element selectors before the script can be executed.
The goal is not to deliver flawless, production-ready automation instantly, but instead to dramatically reduce the initial scripting effort and accelerate the path from validation to automation. Automation begins from what teams have already confirmed works. Not from zero.
How to generate automation scripts inside Jira
Xray’s AI Test Script Generation is designed to fit naturally into your existing workflow. There is no new tool to learn and no external integration required. Everything happens inside Jira.
Here is how the process works step by step:
- Option 1: Start from an existing manual test case
Open a structured manual test case that already contains validated steps and expected results. - Click “Automate Test”
Select the new Automate Test option directly from the test case view. - Choose your framework and language
Select the automation framework you are using, such as Playwright or Selenium, and define the language that fits your stack. Enter a version name that will help you reference the generated script later. - Provide a short prompt
Add a brief instruction describing what you want the automated script to achieve. This gives the AI context before generating the output. - Review the generated files
Sembi IQ returns the automation script along with configuration guidance and dependency files. At this stage, nothing is final. It is a starting point. - Refine and adjust the script
Add application-specific details such as URLs, element identifiers, parameters, and any additional variations. You can continue interacting with the AI to improve or modify the script. For example, you might introduce invalid credential scenarios or refine assertions.
You can iterate on a generated script by providing additional instructions. Each generation allows up to five refinement iterations.
After reaching this limit, you must start a new script generation.
- Download or copy the script
Once satisfied, download the script or copy it directly into your IDE and integrate it into your CI environment. - Create the automated test version
Finalizing the process creates a new automated test version inside Xray, preserving traceability between requirements, the original manual test, and the generated automation.
This structured flow ensures that automation does not break away from your validation process. Instead, it becomes a natural extension of it.
Accelerating automation without scaling headcount
One of the most persistent challenges in QA is balancing automation ambition with available expertise. Automation engineers are often responsible for rewriting logic that already exists in manual test cases, which limits how quickly coverage can expand.
Xray’s AI Test Script Generation reduces that repetitive scripting effort. By handling the initial structure of the script, it allows automation specialists to focus on refinement, optimization, and advanced logic rather than rewriting from scratch.
It also broadens participation. Testers who understand functional intent but may not have deep coding expertise can now contribute more directly to automation efforts. This reduces handoffs and improves collaboration between QA and engineering.
The business impact is tangible:
- Faster automation without increasing headcount
- Reduced repetitive scripting effort
- The ability to refine and adjust generated scripts before execution
- Broader participation in automation efforts
- More predictable release cycles
Automation becomes more scalable because the entry barrier is lower and the workflow remains structured.
Designed for structured QA environments
Generic AI tools can generate code snippets, but they lack context. They do not understand structured test artifacts in Jira. They do not maintain traceability. They exist outside the QA workflow.
Framework-native generators may support script creation, but they often require starting from scratch and assume strong coding expertise. They are rarely connected to validated manual test cases or linked back to requirements.
Xray’s AI Test Script Generation is different because it is built inside structured test management and powered by Sembi IQ, Xray’s AI platform. It generates scripts directly from validated manual test cases, preserves traceability, and creates a new automated test version within the same ecosystem.
This ensures continuity between requirements, manual validation, and automated execution. Automation is not meant to be an isolated activity; it's part of an integrated quality strategy.
Operational considerations when generating scripts
When using AI Test Script Generation, a few operational constraints apply.
File uploads are subject to a maximum combined size limit of 1 MB. This limit is calculated as the total size of all selected files. If the combined size exceeds the limit, the selection must be adjusted before uploading, as any additional files will not be accepted.
Supported file types include TXT, MD, XML, YAML, PY, C, CPP, CC, C++, JAVA, JS, TS, JSX, TSX, SH, BASH, GO, RUST, SQL, HTML, RTF, CSV, JSON, DOC, DOCX, and PDF.
Best practices for effective script generation
Generated scripts are intended as a starting point and should always be reviewed before execution. To achieve the best results:
- Provide clear and specific instructions in your prompt.
- Keep your input concise and focused on the behavior you want to automate.
- Review and refine the generated script to ensure it aligns with your project’s framework conventions and environment configuration.
Following these practices helps ensure the generated scripts integrate smoothly into your existing automation pipelines.
More than automation generation
This launch represents more than a new feature. It reinforces Xray’s position as the AI-powered automation acceleration layer inside Jira.
Automation is no longer limited by the rewrite phase. Teams can scale from validated manual tests to framework-ready scripts in minutes, refine them with expert oversight, and maintain continuity across the testing lifecycle.
This builds on Xray’s broader AI capabilities powered by Sembi IQ. AI Test Case Generation helps teams accelerate the creation of structured test drafts from requirements, and AI Test Model Generation in Xray Enterprise enables structured behavioral modeling for deeper coverage insight. Together, these capabilities strengthen the path from requirement to validation to automation.
With Xray’s AI Test Script Generation, that path becomes even more seamless. Automation begins from what teams already know works. And it scales from there.
Xray’s AI Test Script Generation FAQ’s
What is Xray’s AI Test Script Generation?
Xray’s AI Test Script Generation is an AI-powered capability that transforms structured manual test cases into actionable automation scripts compatible with frameworks such as Playwright and Selenium, directly inside Jira.
Which Xray tiers is it available on?
It is exclusively available for Xray Advanced and Xray Enterprise.
Does it replace automation engineers?
No. It accelerates the initial script creation process but does not replace expertise. Teams review, refine, and finalize scripts before execution, ensuring quality and control remain in human hands.
Does this require new tools or platforms?
No. The entire workflow operates inside Jira within Xray. Generated scripts can be downloaded or copied into your existing IDE and CI environment.
Is automation generated from scratch?
No. Scripts are generated from structured manual test cases that have already been validated in Jira, preserving context and intent.
How does this connect with Xray’s other AI features?
Xray’s AI Test Script Generation complements AI Test Case Generation, which helps create structured test drafts from requirements, and AI Test Model Generation, exclusive for Xray Enterprise, which supports structured behavioral modeling. Together, these capabilities accelerate the full journey from requirement to automation.
Note on availability:
Since the release of Xray Cloud 7.5.0, we’ve transitioned our AI capabilities to “Enabled by Default” to ensure all users have immediate access to the productivity gains Sembi IQ provides.
The platform’s full power is available out of the box, rather than hidden behind menus. However, your workflow comes first, and you have absolute control to toggle it off in the settings if it doesn’t fit your needs. If you prefer not to use AI in your workflow or have previously disabled it, you can disable it at any time in your settings: Xray App Settings → Xray Features → AI Hub.
If you’re an Xray Advanced or Enterprise user, take advantage of this feature today. Access it from the Test Repository or any Manual Test Case.
If you are still on Xray Cloud 6.16.0, your Jira admin must manually update Xray to the latest version in order to take advantage of all recent and future releases. (Including AI Test Script Generation).
