Post on 03-Apr-2018
7/28/2019 Overview on Cloud Computing and Performance Testing
1/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Unlock the power of Sharing
Overview on Cloud Computing
and Performance TestingBy Harish Negi
7/28/2019 Overview on Cloud Computing and Performance Testing
2/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel22
Agenda
What is The Cloud?What is Cloud Computing?
Benefits of Cloud Computing
Risk/Concerns of Cloud Computing
What things are the same about testing cloud solutions?
What is different about testing cloud solutions?
Testing Phases
Key Characteristics of the Cloud
Performance/Load Testing
Performance Testing in the Cloud
Performance Testing Scenarios
Testing on-premises applications from the cloud
Testing Cloud Application and Services
Testing Cloud and on-premises Applications
Cloud Performance Testing Challenges
Cloud Performance Testing Solutions
7/28/2019 Overview on Cloud Computing and Performance Testing
3/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel3
What is The Cloud?
Internet (The Cloud) accessible solution
Off-premise multi-tenant architecture
Accessed via a browser (PC or Wireless)
Delivered as Software as a Service (SaaS) ,
Platform as a Service (Paas)
Infrastructure as a Service (Iaas)
Common cloud companies are:
Google, Amazon, Microsoft, IBM, HP and Salesforce
7/28/2019 Overview on Cloud Computing and Performance Testing
4/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel4
What is Cloud Computing?
Forrester defines cloud computing as:
A pool of abstracted, highly scalable, and managed compute infrastructure
capable of hosting end-customer applications and billed by consumption.
7/28/2019 Overview on Cloud Computing and Performance Testing
5/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel5
Benefits of Cloud Computing
Scalability The distributed nature of Cloud solutions allow utilization to be spread
evenly amongst available servers meaning applications can scale on demand.
Location independent access Using thin clients or virtualization. The only limitation
being internet access.
Reduced cost of ownership Using service providers with currently existing Cloud
deployments means the need to own hardware to support the Cloud solution
can be almost entirely removed.
Server efficiency/utilization The spread of server workload improves server
efficiency and increases utilization of otherwise lesser used servers producing greater
return on investment.
7/28/2019 Overview on Cloud Computing and Performance Testing
6/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel6
Continue...
Green IT The reduced requirement for hardware, implementations and location
dependence means business can reduce the environmental impacts of its IT
infrastructure.
Instantly deployable environments Environments can be built and deployed for
specific needs such as test or deployment. The use of virtualization using the Cloud
means that these environments can be scalable to production size and deployed within
far reduced timescales.
Reduced maintenance cost The centralization of all IT components means that
maintenance can be carried out centrally on a one time only basis. The maintenance
is then mirrored in all end user instances of that Cloud solution.
7/28/2019 Overview on Cloud Computing and Performance Testing
7/20 Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel7
Risk/Concerns of Cloud Computing
Lack of control When IT infrastructure is outsourced to an external third party how
does the business maintain control of their data, impact down time, drive
technology change or influence decisions which may impact their solution?
Security How can business ensure the potentially sensitive information which
traverses the cloud is safe and secure?
Privacy concernsWhat can business do to maintain the privacy of their users and
information when using the cloud?
7/28/2019 Overview on Cloud Computing and Performance Testing
8/20 Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel8
Continue
Data Integrity When using third party solutions for Cloud Computing whatassurances
do businesses have their valuable data remains intact?
Availability Cloud Computing solutions rely on the availability of their infrastructure to
be able to function. Should a business critical Cloud Solution be unavailable
for any time, what is the business impact?
Business Acceptability How sure can a business be that their third party solution issuitable for its intended use?
7/28/2019 Overview on Cloud Computing and Performance Testing
9/20 Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel9
What things are the same about testing
cloud solutions? Requirements coverage based testing
Risk-based structured test approach
Test Plan / Test Phases
Test Cases / Test Data / Test Automation
Defect Management / Functional Test
Use of off-shore resources / Virtualization
Politics {Quality / Schedule / Resources}
7/28/2019 Overview on Cloud Computing and Performance Testing
10/20 Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel10
What is different about testing cloud
solutions?
Shared multi-tenant test environments
Security (Test User IDs / SSO)
Integration of on/off premise systems
Performance / volume test
Defect isolation
Documentation of Out Of the Box reqs
Release Management
7/28/2019 Overview on Cloud Computing and Performance Testing
11/20 Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel11
Performance/Load Testing
Traditionally, to support such a test, you would need the following components in place:
A good load-testing software
Sufficient load-testing hardware for your load-testing environment
Target testing hardware similar to your production hardware for your target-test
environment with your software installed
Sufficient bandwidth for realistic simulation
Skilled professionals to run, monitor and analyze the results of the tests
Other equipment to simulate realistic environment
7/28/2019 Overview on Cloud Computing and Performance Testing
12/20 Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel12
Key Characteristics of the Cloud
Elasticity
Accessibility
Efficiency
Global Delivery
Immediacy
7/28/2019 Overview on Cloud Computing and Performance Testing
13/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel13
Performance Testing in the Cloud
Test planning
Test development and construction
Test execution
Test result analysis and reporting
7/28/2019 Overview on Cloud Computing and Performance Testing
14/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel14
Performance Testing Scenarios
Testing on-premises Applications from the Cloud
Testing Cloud Application and Services
Testing Cloud and on-premises Applications
7/28/2019 Overview on Cloud Computing and Performance Testing
15/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel15
Testing on-premises applications from the
cloud
7/28/2019 Overview on Cloud Computing and Performance Testing
16/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel16
Testing Cloud Application and Services
7/28/2019 Overview on Cloud Computing and Performance Testing
17/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel17
Testing Cloud and on-premises
Applications
7/28/2019 Overview on Cloud Computing and Performance Testing
18/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel18
Cloud Performance Testing Challenges
Firewall exceptions and remote configuration
Storage and bandwidth costs
Cross cloud alignment bottlenecks
Failover Testing
Elasticity and scalability
Application Tuning
7/28/2019 Overview on Cloud Computing and Performance Testing
19/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel19
Cloud PerformanceTesting Solutions
HP (Loadrunner)
IBM (Rational Performance Tester)
Micro Focus (SilkPerformer CloudBurst)
SOASTA (CloudTest)
7/28/2019 Overview on Cloud Computing and Performance Testing
20/20
Copyright IBM Corporation 2011
IBM TESTING SERVICES - GLOBAL DELIVERY INDIA
Learn. Reuse. Excel20
Thank You