Performance and Automation Testing using Apache Jmeter for Agile Environment

Post on 09-May-2015

8.487 views 4 download

description

Jmeter, a powerful performance testing tool from the Apache Jakarta project, can be used to simulate a heavy load on a server, network or object .This helps to test the strength or to analyze overall performance of the system under different load conditions. It has a Full multithreading framework which allows concurrent sampling by many threads and simultaneous sampling of different functions by separate thread groups. It can test servers eg. Web Server – HTTP, HTTPS, Web Services – SOAP, JUnits, Database via JDBC. Jmeter based tests can be integrated into scheduled builds using build tool like Apache Ant . JMeter and Flex BlazeDS Application Performance Testing can be used in a scenario where the front end is developed using flex, the flex remote objects communicate in the flex AMF format. We can leverage JMeter for such scenario where an AMF message can ride over http and a web application can be tested for performance testing and load testing. Take away for the audience :- Examples which illustrate how to use Jmeter in load testing and automation testing.

Transcript of Performance and Automation Testing using Apache Jmeter for Agile Environment

Contents

• Performance testing• Agile methodology• Automated testing• JMeter

2/20/2010 First Draft 2

What are the pain points ?

19%

18%

17%

16%

16%

14% Reliability issues: connection drop issuesover a period of time.

Load test at module level.

Scalability in terms of Number of usershandled by the system.

Quick comparison of Performance testresults across OS Platforms.

Load test at the functional level.

PSR testing for Quick POCs. (Based on survey conducted at BMC Software)

PROCESS

• Write code( 1- 6 months)• Compile code• Send it to QA (or Production ?)• Performance Regression• PANIC !

No Performance Testing !

A BETTER WAY

• Write code• CI compiles code and runs test• Send it to QA ( or Production?)• Performance Regression• PANIC !

No Performance Testing !

A BETTER WAY 2.0

• Performance test artifacts as soon as they pass Unit and Functional testing

• Fast feedback for developers

• No Surprises

Warm Up

• Performance testing• Agile methodology• Automated testing

2/20/2010 First Draft 7

It’s your turn

• Performance testing• Agile methodology• Automated testing

2/20/2010 First Draft 8

• To determine how fast some aspect of a system performs under a particular workload .

2/20/2010 First Draft 9

Performance testing

2/20/2010 First Draft 10

“ What cannot be measured, cannot be improved.”

Performance Testing

JMeter

• What is JMeter• Who can use JMeter• Where can we use JMeter• When can we use JMeter• Why to use JMeter• How to use JMeter

2/20/2010 First Draft 12

JMeter

• What is JMeter– Background– History

2/20/2010 First Draft 13

JMeter• Who can use JMeter

– Dev and QA

Using open source tools for performance testing Presenter: Goranka Bjedov

JMeter• Where can we use JMeter

2/20/2010 First Draft 15

JMeter• When can we use JMeter

- Know how the system responds to work load- Pound system with simultaneous requests

- Performance- Scalability- Reliability

– PSR tests on the quick POCs.– Use in AGILE– Use other tools that complement JMeter, e.g.

Perfmon

2/20/2010 First Draft 16

Why JMeter

• Catch performance regressions quickly• Simplify the hunting of bugs• Code with confidence• Know the performance cost of features• Go home on time

It’s Demo Time

• JMeter and JUnit• JMeter and database query testing• JMeter and Web based Flex Performance

testing

2/20/2010 First Draft 18

Performance Testing of Flex Web Application

• AMF - Action Message Format (AMF) binary format used to serialize ActionScript objects

• To performance test flex web app, need to generate required amf file first.

Distributed Testing

It’s your turn

• Performance testing• Agile methodology• Automated testing

2/20/2010 First Draft 21

Automated Testing

1. Integration with CI tools- Ant Target

- HTML Report Generation

Comparisons, Alternatives, Conclusions

• Shortcomings of JMeter• Conclusions

2/20/2010 First Draft 23

Resources

• Apache JMeter Home

– http://jakarta.apache.org/jmeter/

• Google TechTalk- Using open source tools for performance testing

2/20/2010 First Draft 24

Questions

2/20/2010 First Draft 25

2/20/2010 First Draft 26

Sameer Naik - sameer.naik31@gmail.com

Prasad Nirantar – prasadnirantar@gmail.com

Contact Details