Xray for JIRA Overview

Bruno CondeLead Product Developer

Manage Automated and Manual Tests inside JIRA

Why JIRA?

“JIRA is the ideal environment for Test Management”

• Project Management

• Defect Tracking (bugs)

• Collaboration / Comments

• Customizable and adaptable

• Advanced Workflow capabilities

• Searching

• Work Assignment

• Tracking changes

• Relating issues using links

• Importing issues from other systems or formats

Tests

Defects

Requirements

... so what is missing?

• Test related artifacts (tests, executions, plans)

• Visibility of testing results and progress in Agile boards

• Requirement Coverage visibility

• Advanced reporting for generating documents and drill-down

on data

Testing with Xray

Specify

• Test

• Pre-Condition

Organize

• Test Set

• Test Repository (v3.0)

Plan• Test Plan

Execute

• Test Execution

• Sub-Test Execution

• Test Run

Xray for JIRA

Manual and Automated and Pre-Conditions

Specifying Test Cases

• Composed by a list of steps

• Each Step is defined by:

• Action/Step

• Data

• Expected Result

• Input Attachments

• Support for JIRA Wiki markup

• Importing steps from

• Excel (using copy&paste)

• CSV

• JSON

• Other Test issues

Specifying “Manual Tests”

• Native support for Cucumber

• BDD – Specify tests in a business-readable

domain-specific language

• Test definition serves as documentation

• Automated test steps may be implemented in

Ruby, Java, .Net, etc

• Export specification and execute it during

Continuous Integration

Specifying “Automated Cucumber Tests”

Abstracts initial steps that must be ensured before starting the test.

• Manual or Automated (mapped to background clause in case of Cucumber)

• Reusable; may be linked to multiple Tests

Complement specifications with “Pre-Conditions”

Xray for JIRA

Organizing your Test Cases

Organize Test Cases using Test Sets or create a hierarchy

Flat, with “Test Sets”

Organizing Tests Cases

A issue that represents a list of tests organized by some logical way.

For the “hierarchy/folder mindset”…

Hierarchical (v3.0)

Xray for JIRA

Plan which Test Cases will be included in your next “release/cycle” and analyze the testing progress

Creating a Test Plan

A “Test Plan” has the following goals:

• Specify which Test Cases will be

included in your testing goal (e.g.

the next release)

• Consolidating the latest execution

results for the Tests

Planning with “Test Plans”

Xray for JIRA

Executing Tests

A task for executing a group of tests on a given version and environment of the

system.

• Contains a list of tests and their results (i.e. test runs)

• Can be labeled, prioritized, assigned to testers and contain components, etc.

• May be created manually or during Continuous Integration

Executing with “Test Executions”

• Set Execution Result

• Create Defect issues

• Attach Evidences

• Add comments

• Check the Execution Activity Log

At the execution screen of a Test Run…

Xray for JIRA

Automated Tests

Supported formats

• Xray JSON

• Cucumber

• Behave

• JUnit

• Nunit

• Robot framework

• Calabash

• … more to come

Integrating with automated test frameworks

Xray REST API and CI tools

https://confluence.xpand-addons.com/display/XRAY/REST+API

Xray for JIRA

Where do I create Test cases? And what about Executions?

Project Organization Scenarios

A single project to manage your Requirements and Defects, Test

related issues and also have all your Test Executions.

All for One and One for All

A dedicated project for Xray issue types.

Don't mix my Requirements and Defects with Tests

Ok, great… but how can I know the status of requirements?

Xray for JIRA

Requirements with testing information

With Xray:

• Real-time information about the coverage status of the requirement for a given version

• Real-time information about the associated test results, for a given version

• A ”requirement” may be any issue type you may have; test coverage can be made in any issue type

Xray for JIRA

Analyzing the status of Requirements, Tests for a given project

Reports

• Built-in reports

• JIRA gadgets in JIRA dashboards

• Agile boards

• Through other top-notch JIRA add-ons

Multiple ways of reporting

Provides a quick way of evaluating the current (coverage) status of your project's

requirements, so you will be able to see if they are ready to release or not.

These reports are provided both as native reports as well as Gadgets.

Requirement Coverage Reports

Shows the testing traceability, from requirements to defects.

This helps you analyze the requirements and related Tests, Test Runs and

defects, for quickly identifying uncovered or incomplete/faulty requirements.

Traceability Report

Xray gives you visibility of your testing results and its progress.

Enhanced Agile Boards with Xray

Use Xporter to generate fully customizable Word, Excel or PDF files with your testing

reports to give to your management, colleagues or to your customers

(e.g. Test specification, Test Execution progress and respective results, Test Plan details).

Reports as deliverable assets

Our support is amazing!

Xray for JIRA

Q&A Session

w w w . x p a n d - a d d o n s . c o m

Thank you!

bruno.conde@xpand-it.com