In today's competitive market, you can’t afford to risk poor product quality and software failures. Unfortunately, many companies still use outdated methods to manage their tests like Excel, Word, Google Sheets, or other spreadsheet tools.
Without a proper test management app, your quality suffers and testing remains archaic and at the most basic level, tracking and logging tests.
A test management solution fast-tracks you to success, allowing you to perform a variety of tasks related to testing and quality, so you continuously deliver the highest quality software.
The differences between a test management app and Excel speak for themselves.
With Excel you can only:
With a Test Management app like Xray, you can do a LOT more, including:
See how a test management app puts you in control of your testing.
First, and foremost, Excel is not a tool for testing activities. Specifying tests in Excel limits you greatly: your tests are not objects you can easily reuse, you can't attach files or embed screenshots easily. Besides this, you can't track changes for each of your tests nor explicitly link with existing requirements in Jira.
Xray puts you in control so you can fully format your test specification, add files or embed them in the steps. You can also implement data-driven testing and easily run your tests with a given dataset. The full-screen step editor is another one of the many additional features that enable your team to be more efficient.
Organizing tests is quite limited in Excel. With a test management solution like Xray, you have a lot more control over your test organization. You can either create a list or use a folder structure: the Test Repository. With the Test Repository you can easily search for tests, filter them, and perform operations for them (e.g., scheduling an execution).
Planning the tests for a sprint, or a version is also hard. In Xray, you have the Test Plan that can not only be used for planning some testing effort but also that tracks its consolidated results, no matter if your tests are traditional manual test cases or automated tests. With the Test Plan, you can track tests and results on a folder basis. You can also assign Test Plans and add them to your Scrum or Kanban boards.
Executing tests in Excel remains archaic: just report the overall status. A test management solution needs to provide you with data so you can access your readiness to deploy. With Xray, you can track overall progress, assign individual runs to specific users, and report detailed information during execution, including attaching screenshots and other evidence on each step, create a defect, and link it to the step.
In order to be able to decide whether a release is good enough to be shipped, you need to be able to answer the following questions:
A test management app needs to help you answer the previous questions and more.
With Xray you can, you can assess the coverage status based on the latest reported results for a version, in some environments.
You can use the Test Coverage report to make an analysis at the project level, with drill-down capabilities to assess the completeness of each requirement. See Xray's extensive coverage analysis capabilities.
If you’re working on a project where you use test automation to provide quick checks and track regressions, the following questions arise:
With Excel, you can’t answer any of these questions, period. In order to enable CI/CD, you need visibility of all testing efforts, including manual scripted test cases, test automation, and exploratory testing.
A proper test management tool needs to provide a bird-eye view of your testing and act as the single source of truth for your team. That's precisely what you can do with Xray coverage analysis and test planning capabilities.
Teams adopt a variety of test automation frameworks. Xray not only supports many CI/CD tools (e.g., Jenkins, Bamboo, TeamCity, GitLab, GitHub) but also many different test automation frameworks (50+ testing tutorials available).
Xray also supports BDD in case your team is using Cucumber, Behave, SpecFlow, or similar Gherkin-based frameworks.
You're part of a team and similarly to other team members, you'll have some tasks at hand. It's important to make sure all tasks are properly tracked, including testing activities.
With a test management app, you can track test specification, execution, and planning. Core Xray entities (i.e., Test, Precondition, Test Set, Test Execution, and Test Plan) are issues, so you can manage them as you would manage any other work item in Jira.
Test Runs are also assignable and then, for example, you can use a Dashboard gadget to easily track the runs assigned to you.
There are common demands from teams wishing to track their testing wisely. Have you faced these questions before?
Xray provides you with information available right on the work items you're looking at: either on the Story issue screen or on the other testing entities (e.g. Test Executions, Test Plans).
You can also use tailored testing reports, such as the Traceability Report that you can use to easily see the impact of your testing, and the relations between
Epic <=> Story <=> Test <=> Test Runs <=> Defects.
There are many other reports and also gadgets that you can use in your Jira dashboard to provide you information about the testing status and its progress. If you need to generate documents in PDF, Word, or Excel with your testing evidence, no worries: that can be automated either by using the built-in document generator or with the Xporter app.
Whenever talking about agility, we're also talking about transparency/visibility of information and collaboration on all ongoing tasks.
With Xray, everyone has visibility of testing activities and their progress. For example, tasks can be tracked directly on the covered item (i.e., the "requirement"/story) issue screen. Furthermore, anyone can leave feedback on testing entities. Since Tests are explicitly linked to requirements, it's easy to access relevant information.
All tasks, including the ones derived from testing, are managed in Jira, the place where the team is already managing other tasks related to the product development.
Whether you work in a highly regulated environment or just need to comply with common quality standards, you need to make sure your overall process, including testing, is clear, auditable, traceable, controllable, accountable, and can support proper risk management.
Xray is used by companies in highly regulated environments and by many other companies that wish to have better control over their processes.
Besides change tracking, entity assignment, permission handling, Xray also provides the ability to implement workflows for testing entities. For example, you can set approval/reviewal processes in place.
These are just some of the many capabilities Xray provides in order to help teams meet quality goals.
Do you have tests written in Excel and want to reuse them? Xray provides two features so you can migrate your existing Excel cases to Xray and take advantage of Xray right away. You can migrate test cases in bulk and import steps to an existing test case.
See the full tutorial to get started.
Bottom line, Excel and Word are not intended for testing. If you work in a small team, perhaps Excel can seem enough at first. But soon you will find that you need a tool that can provide real-time insights about Quality and foster collaboration between testing and development.
Xray enables your team to collaborate together to improve quality, so you can handle risks and make critical decisions with ease.
But don’t take our word for it. See how these companies made the move from Excel to Xray and never looked back.
Success case: DEIF, a global power supplier, gained 50% testing efficiency when they moved their test management from Excel to Xray.
Success case: A medical device manufacturer moved from Excel to Xray in order to meet mission-critical regulations with ease.