Xray Comparison

Explore and learn more about everything that separates Xray from its main competitors in test management for QA in Jira.

Top 3 reasons to choose Xray over TM4J

Explore and learn more about everything that separates Xray from its main competitors in test management for QA in Jira.

Accelerated efficiency with enterprise support for automated testing

With native support for BDD (Gherkin/Cucumber) and integration with multiple test automation frameworks, including JUnit, NUnit, Robot, Behave, Calabash, SpecFlow, Selenium and UFT Pro (LeanFT), there’s no excuse why you shouldn’t be automating.

Powerful Coverage Analysis and Test Environments for fast deployment

Xray’s unique capability of advanced coverage analysis gives you real-time statuses of the coverage of requirements on a given version, on a given plan and even on a specific environment, so you can quickly assess if requirements are validated and can be safely deployed.

The only tool that allows you to manage all your Tests as Jira issues

Xray’s tests are normal Jira issue types, allowing you to configure screens, workflows, and add custom fields to your testing related issues. With your Test Management natively integrated, your testers and developers are working on the same interface and can easily collaborate.

Xray vs TM4J Features

Xray TM4J

Specify

Create, view, edit, clone tests
Link to Defects and Requirements
Imbued Generic Automated Tests
Native Support for BDD /Gherkin/Cucumber
Preconditions for test cases
Re-use preconditions between test cases
Multiple preconditions for test cases

Organize

Organize testing artifacts in the same or different projects
Hierarchical test organization in folders and subfolders

Execute

Create, edit, clone and schedule test executions
Personalize and create Test run statuses

Measure

Track with progress bars on Test Execution/Cycles
Track requirement coverage/status directly on issues, as an attribute
Advanced Coverage Analysis
Built-in gadgets and reports
Custom gadgets and reports

Explore and evolve

Extensive query language (more than 30 JQL functions)
Built-in REST API

Characteristics

Email notifications
Use of Jira Issue Types
Test, Pre-Condition, Test set, Test execution, Test plan

Test environment

Analyse test results and requirement coverage per Test Environment

Agile integration

See Test Executions and Test Plans in Jira’s native Agile board along with their progress
CI Native Integrations
Jenkins
Bamboo
Team City
Detailed instructions for GitLab, Circle CI, Azure DevOps and others
Importing results
Cucumber, JUnit, NUnit, Robot framework, Behave, Selenium, Xamarin Test Cloud
Importing tests
Manual via Excel/CSV
Cucumber
JUnit, NUnit, Robot framework
Importing results from HP AL/QC 12.5x & Zephyr
Exporting Tests to fully customized DOC/PDF/Excel with Xporter
Integration with other Atlassian-related tools (e.g. Confluence)

Extra features

UI supported languages
English, German, French, Spanish
More languages
Support for Risk-Based Testing
Support for next-gen projects (cloud)
Mobile app for iOS and Android

Xray vs. TM4J Pricing

Xray TM4J

Users

10 $10 $10
25 $500 $700
50 $1,250 $1,400
100 $2,500 $2,800
250 $4,500 $5,600
500 $7,000 $9,000
2000 $11,000 $15,000
10,000 $14,000 $20,000
over 10,000 $18,000 $25,000

Ready to use Xray?

Get started with a trial for your business