© 2015 IBM Corporation

IBM DevOps for Enterprise Systems

Test Concepts and Technologies

May 18th 2015

Scott Davis & Dennis Behm

Dennis.Behm@de.ibm.com SDAVIS@de.ibm.com

Testing in DevOps …….

Automated Testing

– Test Bucket

– xUnit Component Testing

Continuous Testing

– Build

Big Bang || Virtualization

– API Testing

Shift Left

2

© 2015 IBM Corporation3

IBM DevOps for Enterprise Systems

RDz 1 Click to Generate, Build, and Run test cases

© 2015 IBM Corporation4

IBM DevOps for Enterprise Systems

RDz – Simplified UI Flow

1) Select source code,

invoke Generate Test

Case action from

context menu

2) Entry can be added here

4) Add entry, edit data . . .

3) Press [Edit Test Entry Data]

button to launch editor 6) Choose

stub or real,

press [OK]

5) Press [Generate Test Case]

button to proceed

7) Generating the test case . . .

8) Build test case

© 2015 IBM Corporation5

IBM DevOps for Enterprise Systems

Import Data from Input files

2) Press [Import Data from File] button

1) Press [Edit Test Entry Data]

button to launch editor

3) Specify file, number of

records, and then press

[OK] button to import

4) Work with the

imported data

Test Entry Data Editor

2 Test Entries, Cases

© 2015 IBM Corporation6

IBM DevOps for Enterprise Systems

Standardized Results

© 2015 IBM Corporation7

IBM DevOps for Enterprise Systems

Code Coverage

Theme : zUnit

2015+20152014

Q2 Q4Q3Q3 Q4 Q1 Q2Q1

Planned ConceptualSTATUS: Released

RDz v9.1.1

• Stubbing I/O calls (no

VSAM support )

• Simplified User flow

• Test Entry editor to allow

specification of Input and

Expected output

• Persistence of test data

RDz Next

• PLI Support

• Code coverage

integration

• COBOL ODO support

• UI enhancements

• Handling changes to

Data model after test

case is created

• Stubbing VSAM I/O

Future Roadmap

• DB2 support

• Unit testing of CICS

transaction

• Unit testing of IMS

transaction

• Test Data

Generation

Theme : Test Optimization

2015+20152014

Q2 Q4Q3Q3 Q4 Q1 Q2Q1

Planned ConceptualSTATUS: Released

RDz Next

• Developer role:

• What tests to run for

given set of changes?

• What tests to write to

cover the gaps based

on Code coverage ?

Future Roadmap

• Tester role:

• What is the

optimal set

of tests to

run ?

• What are the

gaps in test

coverage ?

© 2015 IBM Corporation10

IBM DevOps for Enterprise Systems

10

Service Virtualization

Enables the creation of “virtual services”:–Virtual Services simulate the behavior of an entire application or system during testing

–Virtual Services can run on commodity hardware, private cloud, public cloud

–Each build system, developer, tester can easily have their own test environment

–Developer and testers continue to use their testing tools (Manual, Web performance, UI test automation)

Early testing in the product-life-cycle

Additional component and service layer testing

Ability to run end-to-end test scenarios

Identify and fix bugs earlier in the product life cycle.

Shortened release cycles, quicker time to market

Cap

ture

& M

od

el

Heterogeneous Environments

Public CloudPrivate Cloud

Data Warehouse MainframeEnterprise Service Bus

Directory Identity

File systems

Collaboration

App Under TestRouting Service

Third-partyServices

Portals

ContentProviders

EJB

SharedServicesArchives

Business Partners

Messaging Services

Databases Mainframeapplications

App Under Test

Third-partyServices

Packaged apps, messaging services, etc.

Virtual Services

Test Virtualization Concepts

11

•What it’s all about. Inject; observeTEST

•The fastest way to build tests and stubsRECORD

•Observe without consuming (typically in a test)WATCH

•The act of creating a simulation (stub) of a service [for testing reasons]VIRTUALIZE

•The ability for a stub to decide whether to process a message or give it to the real service SIFT-AND-PASS-THROUGH

•Populating Tester with information from external middlewareSYNCHRONIZE

•Transports move messages; content is the messageTRANSPORT VS CONTENT

IBM Solution for Test AutomationA smarter solution for better quality

• Rational Test Workbench is a desktop

solution that enables testers/developers to:– Capture and model virtual services

– Test services and applications long before their

user interfaces becomes available and do integration

testing

• Rational Test Virtualization Server is a

server solution that:– Provides a central environment to virtualize

heterogeneous hardware, software and services to

provide 24x7 testing capabilities

– Reduces infrastructure costs of traditional testing

environments

– Virtual Services can be built from the interface

definition of the system for a wide variety of

protocols, formats or technologies

Unterstütze Technologien

• HTTP/S

• WebSphere MQ

• JMS (multiple)

• REST

• S/MIME

• Java RMI (virtualization only)

• JVM (virtualization only)

• SAP IDoc, BAPI, RFC, XI 3.0

• Software AG’s IB & IS

• TCP/(S), IP, UDP

• CICS TG

• CICS IPIC

• CICS DPL

• IMS Connect

• TIBCO Rendezvous, Smart Sockets & EMS

• ActiveMQ

• Email (SMTP, IMAP) (testing)

• Files

• FTP/S

• WebSphere Application Server

• IBM Integration Bus (WSMB)

• WebSphere MQ

• Websphere SI Bus

• WebSphere RR

• UDDI

• Web Services / REST (WSDL/WADL)

• System z (CICS and IMS)

• Software AG IS, Broker, BPMS

• Oracle Fusion

• TIBCO ActiveMatrix

• BPM

• Databases(JDBC)

• DB2 - EXEC SQL

• Log Files

• CentraSite

• SCA Domain

• XML (XSD, WSDL, WADL)

• SOAP

• JSON

• COBOL Copybook

• PL/I Include

• ASC X12

• UN/EDIFACT

• DFDL

• ISO 8583

• ISO 20022

• Fixed Width

• Java Objects

• AS2

• Software AG Broker Docs

• .Net Objects

• Bytes

• SWIFT

• CHIPS

• FedWire

• TIBCO ActiveEnterprise

• EBCDIC

Messaging Protocols SOA, ESB, Others Message Formats

Content and Schemas

1

4

Mainframe Support

CICS Transactions thru IPIC

CICS to CICS thru DPL within a CICSPLEX

Recording and Virtualization thru the CICS Transaction Gateway,

releasing a mainframe necessity

DB2 Virtualization from CICS COBOL programs

– CLIP (Compiled Language Intercept Processor)

MQ based services w/o changes to the configuration

Built-in Support für COBOL & PLI Copys & Includes

IMS Transactions over SOAP or IMS Connect

Native support for EBCDIC

IBM DevOps for Enterprise Systems

Back Ups

© 2015 IBM Corporation17

IBM DevOps for Enterprise Systems

IBM DevOps for Enterprise Systems

© 2015 IBM Corporation19

IBM DevOps for Enterprise Systems

zUnit Testcase Structure Overview

Develop zUnit Test Case Run zUnit Test CaseBuild zUnit Test Case