Download - Test Automation Demonstration with Dr Yongyan Wang by XBOSoft

Dr Yongyan Wang hosted by XBOSoft

Test Automation Framework

XBOSoft info

• Founded in 2006• Dedicated to software quality

• Software QA consulting• Software testing services

• Offices in San Francisco, Beijing, Oslo and Amsterdam

From XBOSoft:

Amy Jan

Housekeeping•Everyone except the speakers is muted

•Questions via the gotowebinar control on the right side of your screen

•Questions can be asked throughout the webinar, we’ll try to fit them in when appropriate

•General Q & A at the end of the webinar

•You will receive info on recording after the webinar

About the Speaker

Dr Yongyan Wang is senior Software QA for iovation in Portland, Oregon.

He developed the "Inverse Modeling theory" in his PhD program to guide numerical simulation to understand generic linear and no linear problem.

After receiving his PhD, Dr Wang started working in the software quality assurance field focusing on test automation.

Dr Wang has extensive experience applying automation tools, like QTP, Expect and autoIt to address industrial automation needs.

Test Automation Framework Demoby Yongyan Wang PhD

• Test Automation Framework (Google : CPAN TAF)• Test Automation Challenges/Framework Design Principles• Test Automation Framework Demo for Principles

– Simplicity/Easiness - point & click, cut & paste– Repeatability/Reliability/Reusability/Universal– Independency/Adaptable/Extensibility– Self-contained IDE /w command-line developer mode

6

Test Automation Framework Demoby Yongyan Wang PhD

• Test Automation Framework (Google : CPAN TAF)• Test Automation Challenges/Framework Design Principles• Test Automation Framework Demo for Principles


7

• Test Automation Framework (Google : CPAN TAF) • Test Automation Challenges/Framework Design Principals• Test Automation Framework Demo for Principles


8

Test Automation Framework Demo

• TAF is an open source tool and free to everyone • TAF is a generic framework for any repeatable tasks• TAF collaboration tool (QA, Developer, Mgr, Executives)• TAF has a distributed Peer to Peer, plug-in architecture• TAF is language/script/application independent• TAF is a self-contained IDE for test automation dev.

9

Test Automation Framework Google keyword: CPAN TAF

• Test Automation Framework (Google : CPAN TAF)• Test Automation Challenges/Framework Design Principals• Test Automation Framework Demo for Principles


10


Test Automation Challenges & Design Principals

• TC Auto is unpredictable: Independency/Adaptive for Change– Test Type independent (unit test, func test, accept T.,UI test, perf test)– Test Content independent (Jira, Lab Update, Test env, etc) – Test Tool independent (QTP, AutoIt, Expect, Perl, Selenium, codeUI)

• Automated TC lacks consistency & hard to debug: Repeatable– TC code struc to ensure repeatability (TC pre, exec, verify, post Proc)

• Too complicate to run: web UI for everyone– TAF Web UI is simple and easy to use for everyone from anywhere

(Developer/QA/Support/Mgr/Executives)

11

• Test Automation Framework (Google : CPAN TAF) • Test Automation Challenges/Framework Design Principals• Test Automation Framework Demo for Principles

– Simplicity/Easiness (Installation, TC magnt, and TC Report)– Repeatability/Reliability/Reusability/Universal– Independency/Adaptable/Extensibility– Self-contained IDE /w command-line developer mode

12


• Install Strawberry Perl (youTube: CPAN TAF)• Install TAF from CPAN (youTube: CPAN TAF) perl –MCPAN –e “install Test::AutomationFramework”• Install Test Bed (youTube: CPAN TAF) perl –MTest::AutomationFramework –e “help”

13

Simplicity/Easiness (Installation, TC magnt, and TC Report)

• Automation Organization• Automation Remote Display • Automation Remotely Execution• Report Test Result (P/F, performance and TC logs)

14

Simplicity/Easiness (Installation, TC magnt, and TC Report)

Test Framework Web GUI (by going to http://qtp1)

SAE Test Automation Framework by Yongyan Wang 15

Test Framework and different Test Case Types

04/07/23 SAE Test Automation Framework by Yongyan Wang 16

To start TC and to Monitor TC Status

17

Historical Pass/Fail, Perform, Test environ Report

18

Historical TC Logs (by clicking on TC_Lab_C4 link)

19

• Test Automation Challenges/Framework Design Principals• Test Automation Framework (Google : CPAN TAF)• Test Automation Framework Demo for Principles

– Simplicity/Easiness (Installation, TC magnt, and TC Report)– Repeatability (Test case structure ensure repeatable)– Adaptable/Independency/Extensibility (autoIt integration)– UI user mode and command-line developer mode

20


Test case definition (tc.pl)tc.pl print “pass|fail|null|number”

generate log “_tcLogAppend.txt” setup(), execution(), verification(), teardown()Test suite definition (index.pl) index.pl [enter] displays each TC description index.pl [index] executes test case [index]webUI execution Pattern Run Test case once or 24/7 till stopped Run Test suite once or 24/7 till stopped

21

Repeatability (Test case structure ensure repeatable)


– Simplicity/Easiness (Installation, TC magnt, and TC Report)– Repeatability/Reliability/Reusability/Universal– Independency/Adaptable/Extensibility– Self-contained IDE /w command-line developer mode

22


Independency/Adaptable/Extensibility

Test Suit (Acceptance Test)

QTP based GUI Test

Non-GUI Test

Defect Certification

Build Push/Installation

Equipment (CMTS/CM) Monitor

Performance Test

Quality Method: Req Mapping

Test Environ Monitoring

Quality Method: Jira TC Metrics

Task

s Tools: QTP, AutoIt, Expect, Selenium, Perl, JavaScript…

TAF

Independency/Adaptable/Extensibility



25


Test Bed Real Time Demo



26


Create Test Suite hook (index.pl)c:\_TAF\taf.pl testsuite=c:\testsuite1;generateTAFTestsuite

Integrate Test Suite “e.g. calc test suite” c:\_TAF\taf.pl testsuite=c:\autoIttestsuite;generateTAFTestsuite

Execute Test Suite/Casec:\_TAF\taf.pl testsuite=autoIttestsuite;execc:\_TAF\taf.pl testsuite=autoIttestsuite;testcase=testcase0002;exec

Delete Test Suite from webUIc:\_TAF\taf.pl testsuite=c:\autoIttestsuite;deleteTAFTestsuite

Capture Test Commands from webUI command

27

IDE command-line developer mode

Test Suite Integration Example

Test Purpose: calc multiplication works correctly (2*2=4)autoIt TS format: autoIt3 calc.au3 num1 num2 calc.au3 prints pass/fail and generate _tcLogAppend.txtTAF test suite hook (index.pl) Index.pl and index.pl 1

Integrate Test Suitec:\_TAF\taf.pl testsuite=c:\autoIttestsuite;generateTAFTestsuite

28

One click access to • Test suite/case execution, test results and summary• Test suite/case code, which are “hide” in webUI• Test case logs, log in logs, url in logs• TAF configuration and Test bed scripts• TAF activity commands• Access other TAF host on the internet

29

TAF Test Bed Revisited



30


Questions & Answers

Follow us: @XBOSoftand on Linkedin

Questions at: [email protected]

To contact Yongyan Wang, PhD

Google : CPAN TAFEmail : [email protected] : 503-593-0582

mailto:[email protected]

Thanks for attending and hope to hear from

you soon!