How to automate your QA process?

Add-on Discovery Day

Sergio Freire

Xray’s Product Manager

Xray for JIRA empowers test teams to manage and deliver rock solid software solutions

Agenda

1. QA challenges

2. Test Automation

3. Automation on workflows

4. Automation on reporting

5. Live showcase

6. Wrap-up

1. QA challenges

Xray for JIRA

1. Releasing faster (speed vs quality)

2. Manual and automated testing

3. Fast feedback, where you need it

4. Integration with many different automation frameworks

5. Easy integration

6. Support for different methodologies (waterfall, Agile, “hybrid”)

7. Losing time doing all kinds of extra stuff

QA Challenges (well… some of them)

1. Releasing faster

Speed vs Quality - are they real enemies?Let these help you out:

• Agile

• DevOps, DevTestOps

• Continuous Integration

• Automated Testing

• Continuous Testing

• Continuous Delivery

Release often, with confidence. Motivate your team, make your customers happy.

Image by www.genalice.com.

2. Test Automation

Xray for JIRA

Can you automate everything? Or should you?

• Tests can be automated but choose well what to automate

• Defect creation and analysis will be manual (AI will take time to achieve

this goal)

• Some collateral activities can be automated (e.g. environment setup,

reporting, etc)

• Try to focus on what gives you most value and automate the repetitive

tasks

Automation

The cost of bugs

Code Complete, Steve McConnell, 2004

• The cost of fixing bugs grows exponentially depending on the phase in which

they are detected

• The fix cost also depends on the stage where bugs are initially introduced

=> Automated testing to the rescue!

Phase in which a Defect is

introduced

Phase in which a Defect is detected

Supported formats

• Xray JSON

• Cucumber

• Behave

• JUnit

• Nunit

• Robot framework

• Calabash

• … more to come

Automation in mind…

Integrating with automated test frameworks

Enabling Automated Tests

Fitting all together

3. Automation on workflows

Xray for JIRA

Possible scenarios

• Disallow executions with workflow statuses

• For Test Executions in specific

status

• In progress Test Execution workflow status

• After the first run

• Resolved Test Execution workflow status

• When all runs are in final status

• Resolution for Resolved Test Execution

Workflow automation example for Test Executions

Manage execution life-cyle

3. “Automation” on reporting

Xray for JIRA

Real status of requirements with in-context information

With Xray:

• Real-time information about the coverage status of the requirement for a given version

• Real-time information about the associated test results, for a given version

• A ”requirement” may be any issue type you may have; test coverage can be made in any issue type

Provides a quick way of evaluating the current (coverage) status of your project's

requirements, so you will be able to see if they are ready to be or not.

JIRA Dasboards: Requirement Coverage Gadgets

Useful, yet lack quality related information.

Standard Agile Boards

Xray gives you visibility of your testing results and its progress.

Enhanced Agile Boards with Xray

Use Xporter to generate fully customizable Word, Excel or PDF files with your testing

reports to give to your management, colleagues or to your customers

(e.g. Test specification, Test Execution progress and respective results, Test Plan details).

Reports as deliverable assets

5. Live showcase

Xray for JIRA

1. Integrating with Junit automated tests

• Automatic report sent to email using Xporter

2. Automated testing using BDD with Cucumber

3. Consolidated results in Test Plan

Live showcase

• Cucumber supported natively

• BDD – Specify tests in a business-readable domain-specific language

• Test definition serves as documentation

• Automated test steps may be implemented in Ruby, Java, .Net, etc

• Export specification and execute it during Continuous Integration

Specifying “Automated Cucumber Tests”

6. Wrap-up

Xray for JIRA

1. Use JIRA with Xray for managing the complete lifecycle of your software projects

2. Xray is the perfect tool for Test Management inside JIRA, enabling automation features

3. Xporter complements Xray, enabling advanced reports in Word, Excel, PDF with custom layouts

Deliver faster and better releases with JIRA and Xray

Xray for JIRA empowers test teams to manage and deliver rock solid software solutions

w w w . x p a n d - a d d o n s . c o m

Thank you.

sergio.freire@xpand-it.com