Using JIRA for Test Case Management

September 25, 2015

Introduction to QASymphony for [INSERT

COMPANY NAME]

Using JIRA for Test Case Management

March 9, 2016

#JIRATesting @RyanYackAttack

• Audio for this webinar is delivered through your computer. Make sure your speakers are turned up or use a set of headphones.

• If your audio quality is choppy, it could be your internet connection.

• You can customize your webinar viewing experience by increasing, decreasing or minimizing the size of the widgets on your screen.

• If you have questions, enter them in the widget on the left.

HOW TO WATCH THIS WEBINAR

#JIRATesting @RyanYackAttackRobust testing platform purpose-built to help agile teams create

higher quality software

ABOUT QASYMPHONY


Creating Visibility and Speed with Automation and Test ManagementThursday, March 24th at 2pm ET

Guest Speaker: Joe Colantonio• A test automation architect for a large

Fortune 100 company with more than 15 + years of test automation and performance testing experience.

• Founder of the popular test automation blog, joecolantonio.com and the host of TestTalks, a podcast dedicated to all things test automation related.

UPCOMING WEBINAR


QUALITY JAM 2016 – APRIL 13TH IN ATLANTA

Learn more at qualityjam.com

Speakers Include:

• Scott Berkun, Best Selling Author

• Keith Klain, Software Testing Thought Leader

• Michael Cooper, Chief Quality Officer, Healthcare IT Leaders

• Ian Culling, CIO of VersionOne


• Early bird pricing of $100. Pricing will go up to $200 on March 15st.

• For a limited time, you can get an additional $20 off using the promo code QASVIP when you check out.

• For the first 5 people who send an email to [email protected], you will get a complimentary pass to the event.

QUALITY JAM 2016

mailto:[email protected]


• This webinar will be recorded and available on-demand tomorrow. You will get an email when it is available.

• Join the conversation on Twitter using the hashtag #JIRATesting.

• Use the Q&A widgets to ask questions during the webinar.

• At the end of the webinar, you will be asked to take a short survey.

HOUSEKEEPING


Ryan YackelSenior Sales Engineer, QASymphony

• Serves as the “customer voice” for all QASymphony products.

• Comes to QASymphony from Macy’s, where he managed testing on large enterprise initiatives.

• Certified scrum master from Scrum Alliance and holds a Bachelor of Arts degree from Covenant College.

OUR PRESENTER

How JIRA is setup for testing

Pros and cons of customizing JIRA as a test case management solution

Pros and cons using add-ons with JIRA for test case management

Pros and cons of external integrations with JIRA for test case

management

How to get the best of both worlds using JIRA, plugins and integrations

WHY ARE WE HERE?

JIRA ADOPTION

10

The #1 software development tool used by agile teams

Agile Adoption Rate

September 25, 2015


COMPANY NAME]

HOW JIRA IS SETUP FOR

TESTING

12

HOW JIRA IS SETUP FOR TESTING

Where is the Test Issue

Type?

13

DEFAULT PROJECT ISSUE TYPES

Basic software

development

Kanban

Scrum

MANUAL AND AUTOMATED TESTING

14

Manual Testing

(Acceptance, Integration, Functional,

Automated Testing

(Continuous Integration Server)

RegressionSession BasedReuse, Configurations

Other Automation FrameworksUsing Jenkins

September 25, 2015


COMPANY NAME]

OPTION A: CUSTOMIZE JIRA ISSUES

16

CUSTOMIZE JIRA: SAMPLE WORKFLOW

Test Case

Test Run Affects Version

Actual Outcome

Result

Assignee

Parent Issue

Subtask

Only latest subtask status history

How are you going to reuse the subtask? How will we group these?

Where do we see the coverage report?

Test Run

Test Run

17

CUSTOMIZE JIRA: SAMPLE WORKFLOW

User Story

Test Case / Run Affects Version

Actual Outcome

Result

Assignee

Parent Issue

Subtask

Only latest subtask status history

What happens when the user story is moved to DONE?

How will I configure the test run?

CUSTOMIZING JIRA: PROS & CONS

18

Custom issue types such as test case

Workflow controls QA, devs and tester actions

Existing Reporting / Customisable

Uses an existing and known tool - JIRA Only

New Manual Execution

No testing-specific functionality

Only integrates with testing frameworks via CI server

Test Cycle, Suite execution

Test step Execution Status

Version control

Environment Configuration

Is JIRA built for testing or does this seem like we are forcing the issue? - No pun intended :-)

If workflows are created to getting issues DONE, what about regression testing and reuse?

What about Test Coverage reporting (Manual, Automated, Session Based)?

Obvious traceability limitations between issues and test case coverage

September 25, 2015


COMPANY NAME]

OPTION B: INTEGRATIONS

OPTION B: INTEGRATIONS

20

Add-ons (Internal Integration)

Dedicated Test Case Management (External Integration)

OPTION B: ADD-ONS

21

OPTION B: ADD-ONS

22

Test Case Steps

Test Issue Type

OPTION B: ADD-ONS

23

Gherkin Style Test Scripting

Feature / Scenario

Issues

OPTION B: ADD-ONS

24

Test Grouping

Latest Execution

Result

25

Test Case

Version 1

Test Run Version 1

Test Case

TEST EXECUTION

Test Run Version 1

Test Run Version 1

JIRA Issue

Project Limited

Version Limited

JIRA Infrastructure

ADD-ONS: PROS & CONS

26

Zero or limited ability to reuse test cycles

No logical folder structures

Unknown change history for Test Case Versions and Limited visibility into Test Execution History

Test Case Duplication

No ability to share test case objects across JIRA projects

Look and feel similar to JIRA

Dashboards within JIRA

Atlassian Market $ Model

Adding Test Specific Functionality

Link test objects with other issues

Inherited limitations of JIRA infrastructure

What about sharing tests cases and steps within multiple projects?

Running same test, different variables

Think about how your teams are going to scale

OPTION B: EXTERNAL TEST CASE MANAGEMENT

27

28


Automated and Manual Execution


29

Enhanced Execution

Setup Test Run

Configuration


30

Test Run Log

Test Run

TEST EXECUTION

31

Test Case

Version 1

Version 2

Version 3

Project A

Project B

Project C

Results Assignee

ConfigConfig

Test Run

Test Log

Test Log

Test Run

Test Log

Test Log

Test Run

Test Log

Test Log

Results Assignee

ConfigConfig

Results Assignee

ConfigConfig

EXTERNAL TEST CASE MANAGEMENT: PROS AND CONS

32

Constant Database Synchronizations

Artifact Mapping - Permissions

Browser restrictions (ex Internet Explorer only)

Not fulling integrated with JIRA

Open Source Friendly Varies

Fully dedicated test case management

Enterprise Test Features - Configuration Manager - Automated Testing - CI Integrations (ect)

Customized Test Repositories

Easy Reuse and Object Sharing

Multiple Test Strategy Support

Enterprise features, without sacrificing real time integration

Does your team have a wide range of testing methodologies?

Does your test strategy warrant an enterprise test tool?

BEST OF BOTH WORLDS

33

BEST OF BOTH WORLDS

34

BEST OF BOTH WORLDS

35

CONCLUSION MATRIX

36

Very Smallto Small

Smallto Medium

Mediumto Large

Large to Enterprise

Manual TestingNo Regression

JIRA Only

BDDManual Testing

qTest, Zephyr for JIRA,

Manual, ExploratoryAutomationCI

qTest

qTest

Manual TestingSome Automation

Manual, ExploratoryAutomationCI

Spreadsheets

qTest ScenarioBehavepro, XRAY

Zephyr Enterprise

HPQC or Borland

Team Size Testing Types Tools

QUESTIONS?

37

Ryan Yackel

[email protected]

linkedin.com/in/ryanyackel

@ryanyackattack



Thank You

Using JIRA for Test Case Management

Software

Transcript of Using JIRA for Test Case Management