Performance Testing with SoapUI and Siege

Diana CârciuSoftVision

10th of November 2012

Performance Testing

Why? What?How ?

Why Performance Test?

“A business in today’s digital culture needs to make sure that its website is working hard for the business and not against it.”

Why Performance Test?

SpeedScalabilityStability

SpeedDoes the application respond quickly enough for the intended users?

How do we measure?

Responsiveness

User experience

ScalabilityWill the application handle the expected user load and beyond?

How do we measure?

Load

Capacity

Volume

StabilityIs the application stable under expected and unexpected user loads? (AKA Robustness)

How do we measure?

Consistency

Reliability

Stress

What is Performance Testing?

SpeedScalabilityStability

Load testingStress testingEndurance testing

->

Load Testing

Progressively

Concurrent users

Response time

Stress Testing

Upper limits

“That’ll never happen in production” ….but it does

Endurance TestingContinuous expected load

Tests ran long time

Emergent behaviors

How to conduct Performance Tests?

Performance key pointsPerformance Test Plan (how much

load?)

Choose tools

Performance key points

Concurrency/throughput (Transaction Rate)

Server Response Time

Server Resources Monitoring

Performance Test Plan (how much load?)

Transactions

Schema

Three situations

Tools – 2 case studies

SoapUI – testing

Web-Service based Application Performance

Siege – Web site

load testing

SiegeSimple but powerful Linux based toolSupports basic authentication, cookies, HTTP and HTTPS protocols

Configurable number of simulated users

Can be used test a Windows server.

SoapUIA java-based web service testing toolUsed for inspecting, invoking, developing, simulating, mocking and load-testing web services

Server monitoring

Users

Time run/min

CPU% Memory private (KB)

Network bytes/sec

Tomcat

Tomcat Mean Max

1000 15 18.2 1,096,024 661,634 11,860,523

2000 15 29.6 1,246,924 1,042,553 7,420,530

Performance Monitor statistics

Where to go for more information- http://www.perftestplus.com/resources.htm - Scott Barber presentations

- http://www.soapui.org- http://www.joedog.org/siege-home- Web Load Testing for Dummies - Scott Barber

- http://technet.microsoft.com/en-us/library/cc749249.aspx

Thank you!

Please fill the evaluation form!

cdnaro@yahoo.com

Diamond Sponsors

Platinum Sponsors Gold Sponsors

Training Partners Media Partners