Performance Engineering Requirements

3
***Performance Testing Requirements * Throughput: It indicates (a). number of transactions per second an application can handle (b). amount of transactions produced over time during a test Throughput depends on different factors: (1). specifications of the host computer (CPU Speed, RAM Size & Allocation, Network Speed, Disk RW Speed, IOPS/ IOs) (2). processing overhead in the software (RAM Utilization by the Software, Response Time) (3). Degree of parallelism both hardware and software (Monolithic OS, Hybrid OS, CPU Architecture, Parallel Processing, Connection Pool, DB Choice and Architecture of RDBMS/ DB Server, Normalization, Mirroring, Load Balancing, Software Architecture, Hardware Architecture including that of the Motherboard, NIC Cards) (4). Types of transactions being processed (Messaging Queues, Threading, RT (Real Time Transaction System), Hyper Threading, Batch Processing, CPU Cache) * Response Time (Depends upon response in milliseconds, NIC Design and CPU, Router Capacity (capacity to handle so many packets per second, MTU size)) * Network Latency ( % Packet Drops, Network Bandwidth) * CPU Utilization * % Disk Busy (Depends on Disk IOPS/ Ios) * % Free Memory/ % RAM Utilization (Depends on RAM Speed and MTR (MB Maximum Transfer Rate)) * Caching/ Paging/ Swapping * Threshold Limit * Memory Leakage (Depends on Ramp Up, Ramp Down, Garbage Collection, Memory Heap/ Heap Size)

Transcript of Performance Engineering Requirements

Page 1: Performance Engineering Requirements

***Performance Testing Requirements

* Throughput: It indicates (a). number of transactions per second an application can handle (b). amount of transactions produced over time during a test Throughput depends on different factors: (1). specifications of the host computer (CPU Speed, RAM Size & Allocation, Network Speed, Disk RW Speed, IOPS/ IOs) (2). processing overhead in the software (RAM Utilization by the Software, Response Time) (3). Degree of parallelism both hardware and software (Monolithic OS, Hybrid OS, CPU Architecture, Parallel Processing, Connection Pool, DB Choice and Architecture of RDBMS/ DB Server, Normalization, Mirroring, Load Balancing, Software Architecture, Hardware Architecture including that of the Motherboard, NIC Cards) (4). Types of transactions being processed (Messaging Queues, Threading, RT (Real Time Transaction System), Hyper Threading, Batch Processing, CPU Cache)

* Response Time (Depends upon response in milliseconds, NIC Design and CPU, Router Capacity (capacity to handleso many packets per second, MTU size))

* Network Latency ( % Packet Drops, Network Bandwidth)

* CPU Utilization

* % Disk Busy (Depends on Disk IOPS/ Ios)

* % Free Memory/ % RAM Utilization (Depends on RAM Speed and MTR (MB Maximum Transfer Rate))

* Caching/ Paging/ Swapping

* Threshold Limit

* Memory Leakage (Depends on Ramp Up, Ramp Down, Garbage Collection, Memory Heap/ Heap Size)

Page 2: Performance Engineering Requirements

* Performance TestingTo Determine Behavior of the System under given Load Conditions

* Load TestingTo Determine the Maximum Subjected Load that a System can handle at a given point of time.Depends Upon Number of Users Handled at a Given point Time

* Stress TestingTo Determine the Behavior of the System under deprived resource conditions

* Soak TestingTo Determine the Behavior of the System under prolonged subjected Load Conditions

* Scalability TestingTo Determine whether an application can be scaled up in terms of:=increased resource usage or by increased number of users

* Endurance TestingTo Determine the Behavior of the System under endured or subjected load for given increasing/ varying Load Conditions/ duration

*** Performance Testing using LoadRunner Requirements* Business Case Stories/ Real World Situations* Scripts to be captured in VUGen or Coded in VUGen* Parametrization for Unique Data Constraints* Correlation for Dynamic Data being submitted in POST or Submit Transactions* Goal Oriented Scenario* Manual Scenario* % Wait Time or Response Wait Time or Sleep Time* Think Time* Rendezvous Points* Retry Intervals* Transaction Steps* Sampling Period* Ramp Up Duration* Ramp Down Duration* % Hits Per Second* Unique Data* Sequential Data* Random Data* Response Time* Standard Logging* Extended Logging

Page 3: Performance Engineering Requirements

***Profiling or Monitoring Tools for Capacity PlanningWily SitescopeWily IntroscopeShunra WAN EmulatorTeamQuestSolarwinds Librato DashboardPerfMonWindbgIDA PROHIEWSysInternalsNETSTATIOSTATTaskManagerpspingiptracetracerttopsysadmmemstat