Post on 22-May-2015
• Determine the usability/effectiveness of an application under load.
• Detect bottlenecks before a new system or upgrade is deployed.
• Tune for better performance
The peace of mind that it will work on go-live day
alone justifies the cost of performance testing.
Why do we Performance Test..?Why do we Performance Test..?
What is Performance Testing?• Performance Testing Determines Speed Scalability Stability Confidence
… while focusing on User Expectations System Constraints Costs
Specifically, it answers: How many…? How much…? What happens if…?
WHY NOT MANUALLY PERFORMANCE TEST?
Manual performance testing can be done by gathering numerous folks together and synchronizing executing
the transactions.
The drawback is that measuring response time depends on user accuracy. And it is very hard to
synchronize the testing AND repeat the tests.
And the coordination problem is expanded if you think about including international users.
AUTOMATED PERFORMANCE TESTING
UserSimulation
Controller Web Server
Application Server DatabaseInternet/
WAN
Replaces real users with virtual users
Generate a consistent, measurable, and repeatable load, managed from a single point of control
Efficiently isolates performance bottlenecks
Performance Test ProcessPerformance Test Process“Evaluate System”“Evaluate System”
Evaluate System
This is the most important process because it involves …
(1) predicting actual user experience
(2) accessing any system limitations
(3) defining stakeholder expectations
Performance Test ProcessPerformance Test Process““Draft test scripts/scenario”Draft test scripts/scenario”
Evaluate System The scripts will contain transactions which are the most intensive activities performed on the application.
Draft test scripts/ test scenario
Performance Test ProcessPerformance Test Process“Execute Performance Tests”“Execute Performance Tests”
Evaluate System
Draft test scripts/ test scenario
Execute Performance Test
LOAD TESTS are the end to end performance test under anticipated
production load.
STRESS TESTS determine the load under which a system fails and how it
recovers from failure.
DURATION TESTS are test with a constant load over a period between 8
and 24 hours to determine if an application’s performance degrades
over an extended period of time.
BASELINE TESTS is the execution, validation, and debugging of scripts collectively in a test scenario. The
results will be used for comparison with future testing results.
Performance Test ProcessPerformance Test Process“Entire Process”“Entire Process”
Execute Performance Test
Draft test scripts/ test scenario
SLA Acceptable?
YESCreate
Performance Test Certification
Evaluate System
Review Results
NO / Tune Server
Response Time Degradation Curve
Performance Test Services
DatabaseWeb Server Application ServerInternet/WANLoad GeneratorController Load Balancer
EJB JDBC JSP Sitraka
JMonitor
Oracle MSSQL
Server DB2
Network Web Servers
App Servers Java
3270 5250 VT100
Legacy
Oracle MS SQLServer DB2 ODBC
Databases
EJBs CORBA COM RMI MQSeries
Middleware
Web Services HTTP(S) XML Citrix ICA
Web
PeopleSoft Oracle
ERP/CRM
Protocols
MonitorsDiagnostics
Operating Systems Databases
Windows Unix Linux
SNMP WAN
Emulation
MS IIS iPlanet Apache
BEA WebLogic
IBM WebSphere
ATG Dynamo iPlanet App
Server
J2EE .NET
Platforms
We have the ability to mimic many protocols. Here is a list of the protocols.
The Diagnostics tool provides a set of Diagnostics modules that
trace, time, and troubleshoot end-user transactions across
ALL tiers.
And while a testing is executing we will monitor your servers!
Performance Test Triggers?
• New Systems• Increasing Number of Users• New Functionality• Software Upgrades• Operating System Upgrades• Hardware Upgrades• Infrastructure Upgrades/Changes• Slow application response
Here are some examples of what should trigger a performance test execution!
Performance Test ToolboxOur team has the latest and greatest tools…!!!
How do you engage our team?
Answer: Just open up a Performance Test SOS ticket…
http://eaptsos
More information about performance testing is on thehttp://tim.turner.com/tso/ea/groups/sharedsvc/perftest/default.aspx