WebVizOr: A Fault Detection Visualization Tool for Web Applications

Goal: Illustrate and evaluate the uses of WebVizOr, a new tool to aid web application testing

Test web applications for correctnessProblem: Difficult to analyze results of large test suites Our Contribution:

Visualization tool that enables navigation of test suite results Integration of various test oracles that identify possible faults in web applications

Uses in Industry and Research

General Web Application Testing Process

Motivation

View Detailed Test Case Info

Visualize Oracle Comparator Results

Highlighted differences in filtered responses allow the user to quickly monitor

• HTML tag change

• Page content change

Figure 1: A screen snapshot of WebVizOr presenting the results of executing the same test suite on two versions of a web application.

Current Test Case

Oracle Views Available

Current Response

Current Oracle View

Navigation Buttons

Navigation Frame

Side by Side View of Two

Sets of Responses

Highlighting Indicating

Found Differences

Detailed Test Case Informatio

n

WebVizOrExecute Oracles

Identify Faults

Present Results

Oracle Scripts(Filter)

OracleReports

Oracle Script(Compare)

Fault Information

Directory of HTML Responses

Test Case(HTTP Requests)

Information

Summary of Evaluation

Ease of Navigation:Navigate to any response in 4 clicks or

lessGo directly to responses listed in fault

report

Oracle Integration:Integrated seven oraclesCreated fault report for easy access to oracle

results

Subject Web Applications:

Extensibility:Update a single configuration file to

integrate new oracles

Portability:Under investigation

Time and Space Costs:

WebVizOr Architecture

Tool Features

Test case details allow user to

• View complete HTTP request

• Determine if error in response corresponds with request parameters

• Jump to and view associated response

View Saved HTML Responses

Single Suite Version:

• View results of test suite execution (responses) in rendered or raw HTML form

Test Suite Fault Report

Real-world web application testing: Regression Testing

Useful during maintenance or before release of a new application version

Oracle Development:Use of the tool within our group has already led to

the development of two new oracles

Holly Esquivel Sara Sprenkle and Lori PollockBarbara Hazelwood

Department of Computer Science & Information Systemsh t t p : / / w w w . c i s . u d e l . e d u / ~ h i p e r

Requests

Web Application ServerWeb Application Servercode

…

Test Suite HTML responses

…

ActualResults

…

ExpectedResults

Possible Fault

Figure 2: A screen snapshot of WebVizOr’s fault report.

Oracle Detected faults in the Suite

Oracle Detected Faults in this Test

CaseTest Case’s Responses

Oracle Not Run

All Test Cases Listed

No Faults Found

Faults Found

WebVizOr’s fault report allows the user to

• View suite’s results

• Jump to and view a test case or response

• View an oracle’s results on the suite or a test case

Dual Suite Version:

• View results of two sets of test suite executions (responses) side by side

• Utilize oracles to compare, view, and detect potential faults in responses

O u r w o r k w a s f u n d e d b y C R A – W D i s t r i b u t e d M e n t o r P r o j e c t

Oracle

Future Work

Pass

Responses

WebVizOr

Evaluate Oracles• Some oracles are better at catching certain faults• Quantitative and qualitative analysis of oracles’ false positives and false negatives

Develop New Oracles• Use analysis to create more accurate oracles

22,129

1,107

Total # Requests

12.2 requests1,800Digital Publications Library DSpace

6.6 requests169Regional Workshop Registration and Management Masplas

Avg. Case Size# Test CasesDescription Application

Usage Filtered Text Files

1 per oracle 2 per oracle2 Compare Dual Application Versions

Comparison Files

0 0

Generated HTML Files View Single Application Version

2MasplasDSpace

DSpaceMasplas

1 sec5-15 sec

5 sec22 sec

Initialization Time