Leveraging Cloud Green IT

Leveraging the Cloud for Green IT:

Predicting the Energy, Cost & Performanceof Cloud Computing

2009 Optimal Innovations, Hyperformix & RS Performance

Amy Spellmann,Optimal InnovationsRichard Gimarc,Hyperformix, Inc.Mark Preston,RS PerformanceDecember 9, 2009Session# 431

Leveraging the Cloud for Green IT: What are we going to talk about?We will describe & demonstrate a methodology for predicting performance, energy and cost for expanding on-premise IT into the Cloud.

Cut through the hype:View Cloud as a new platform in your infrastructureQuantify the effect of utilizing CloudEnergyCostPerformanceUtilize a repeatable, scientific methodologyLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Leveraging the Cloud for Green IT: AgendaBusiness MotivationCloud ConsiderationsMethodologyCase StudySummary & Recommendations

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Cloud Computing: What is it?A general term for Delivering hosted services over the Internet Highly automated platforms that can be assigned to applications or services on demandServices are broadly divided into 3 categoriesInfrastructure-as-a-Service (IaaS) Platform-as-a-Service (PaaS)Software-as-a-Service (SaaS)Cloud services have 3 distinct characteristics that differentiate it from traditional hostingSold on demand, e.g., by the minute or the hourElastic, a user can have as much or as little of a service as they want at any given timeFully managed by the providerLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Cloud Computing PromisesFlexible, on-demand IT servicesLow entry cost (CapEx vs OpEx)Timely ScalableGreenerElastic

Follow the herdblindly into the Cloud?Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Is Cloud a Good Fit for You?Have Cloud solutions evolved enough to meet the demands of your growing enterprise?Is Cloud a good fit for your business from a cost, energy and performance perspective? Are Cloud solutions greener?

The decision requires a formal evaluation to ensure that the benefits can be realizedLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Energy Consumption: Are Clouds Greener?Energy consumption in the data center is often not well understood [Koomey]Economies of scale enable Cloud providers to be more efficientScalability and efficiency must be balanced to meet profit marginsEnergy usage can be reduced through free cooling and specialty hardware (e.g. Amazon, IBM, Google, Microsoft)Cloud vendors must be able to demonstrate their energy efficiencyLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Why Consider Cloud Computing?IT infrastructure at capacity, need to accommodate growthAvailable power to the data center at capacityOpportunity to expand on-premise IT with on-demand resourcingPay-as-you go cash outlay vs. large investment up frontGovernment & utility energy saving incentives: rebates, carbon penaltiesLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Cloud ConsiderationsAttributeTraditional On-PremiseCloud ComputingInfrastructure ScalabilityServer upgrade (CapEx)Potential data center expansion (CapEx)Cloud resources (OpEx)Limits data center expansion (CapEx)Deployment TimelineWeeks to monthsOn-demand in minutes/hoursInfrastructure ManagementPhysical and virtualized components(Virtual) Cloud resources Business ContinuityResponsibility of on-premise IT staffPartner with Cloud providerPhysical Resource UtilizationSize to handle peak loadsLow utilization during non-peak timeScale dynamically with on-demand resourcesEliminates the need to overbuild(1 of 2)Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Cloud ConsiderationsAttributeTraditional On-PremiseCloud ComputingNetwork InfrastructureData center IT staff responsible for networks and network expansion (CapEx)Utilize Cloud network infrastructure (OpEx) Additional on-premise network may be required (CapEx)PerformanceResponse time depends on workload volumes & supporting infrastructureDependent on responsiveness of the virtual resourcesPotential new network delay between on-premise and CloudEnergy Driven by IT infrastructure & supporting facilityFixed limit on power drawEnergy consumption managed by the providerLimits on-premise energy growth IT Budget CategoriesCapEx for infrastructureOpEx for facility & energyPrimarily OpEx for infrastructure(2 of 2)Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Cloud Consideration Set of AttributesAddressed in Case StudyInfrastructure ScalabilityPhysical Resource UtilizationNetwork InfrastructurePerformanceEnergyIT Budget CategoriesNot Addressed in Case StudyDeployment TimelineInfrastructure ManagementBusiness ContinuitySecuritySoftware LicensingOperations StaffingFacilities CostMaintenanceLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

Modeling & Capacity PlanningBusiness Growth / DemandDecision Support for Leveraging the Cloud Predictive Performance & Capacity ManagementOn-Premise Provisioning ?Cloud Provisioning ?

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Methodology Traditional + Cloud AnalysisTraditional Capacity Planning+ Cloud AnalysisInfrastructure Capacity AnalysisWorkload & Growth AnalysisIT Provisioning Plan & Cost OptimizationBusiness Planning & CommunicationsEnergy FootprintImpactCloud Provider CapacityOn-Premise + Cloud PerformanceCompareOn-Premisevs. CloudIdentify Cloud ServicesLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Data Center & Application Growth ChallengesWeb-based eCommerce applicationCurrent server infrastructure at capacity limitExpecting 2x workload growth over next yearData Center reaching power limitsCapacity Planning Question:Should we expand our on-premise infrastructure to handle the expected growth, or should we leverage the Cloud to support the increased workload volume?

On-Premise Provisioning ?Cloud Provisioning ?Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Approach: Compare On-Premise vs. CloudDetermine workload growth patternSize on-premise infrastructure to handle growthSelect a Cloud providerQuantify required Cloud resourcesCompare & contrast energy, cost & performanceCapacity Planning Question:Should we expand our on-premise infrastructure to handle the expected growth, or should we leverage the Cloud to support the increased workload volume?On-Premise Provisioning ?Cloud Provisioning ?

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study: Capacity Planning Factors to AddressWhat additional on-premise infrastructure would we need to support workload growth?What Cloud resources would we utilize to support the additional workload volume?How does the cost compare; on-premise versus Cloud?How is our energy bill affected by growing into the Cloud?Is there a performance penalty for augmenting our on-premise IT infrastructure with the Cloud?Are we able to leverage the on-demand nature of Cloud resources?These factors will enable us to answer:Should we expand our on-premise infrastructure to handle the expected growth, or should we leverage the Cloud to support the increased workload volume?Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Workload Growth Pattern

Historical data shows workload volume by hourSimplify analysis by assuming 25% stepsAnalyze 4 load levels instead of 24

Baseline workload: hours 0-5 & 22-23Increased workload volume from hours 6-21; add on-premise capacity or route to the Cloud?Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Todays Current Baseline

27 serversMaintain 70% utilization threshold

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Size On-Premise to Handle 2x GrowthIncrease workload by 2x25% growth stepsUpgrade DB serverAdd servers to other tiers (+31)

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Select a Cloud ProviderAmazon Web Services (AWS)Elastic Compute Cloud (EC2) - PaaSStandard InstancesHigh-CPU InstancesEC2 Compute Unit has the equivalent CPU capacity of a 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Prepare to Model Cloud ResourcesDevelop model representations of EC2 Standard Instances

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Number of instances required to satisfy on-demand3 instance sizesMaintain 70% utilization thresholdLeave DB on-premise

On-Demand ProvisioningCase Study Quantify Required Cloud Resources

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#On-premise servers will handle workload from hours 0-5 and 22-23Additional workload from hours 6-21 will be routed to the Cloud

Case Study Cloud Workload Routing

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

Instance pricing per hour of useData transfer cost based on GB quantity of in/out per monthCase Study Compute Cloud Cost per Month

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Case Study Estimate Hourly Energy FootprintCloud EFP constant across the day additional work routed to the cloudOn-Premise scenario EFP follows workload volume+31 additional servers contribute to On-Premise EFP

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Comparisons On-Premise vs. Cloud ScenariosEnergyCost

Performance

Cloud provides away to cap ouron-premise energyconsumptionCloud requires alower initial investment,but costs accumulateover timeCloud may increaseour business serviceresponse timesLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

Cumulative monthly energy cost for the Cloud solution is approximately half of the On-Premise solution (29 vs. 59 servers)

$1,602 vs. $3,092 per monthHour-by-hour energy consumption

The peak on-premise EFP is 50% lower using the CloudComparisons EnergyLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

Cloud scenario: on-premise servers handle all off-peak workloadOn-premise upgraded servers built out to handle peakSmall Standard are slower than on-premise counterpartLarge & XLarge are faster than corresponding on-premise servers

Comparisons Average Response Time: CPUWorkload routed to Cloud for hours 6-21Cloud response time is weighted average of requests handled on-premise and those routed to the cloudLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

Keeping DB on-premise incurs additional network overheadOn average 1.5 DB accesses per transaction (max of 5)Hybrid architectures may increase response time beyond acceptable limitsChatty applications are not good candidates

Assume 100 msec round trip latencyMax response time increase > 0.5 seconds

Comparisons Average Response Time: CPU + Network LatencyLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

On-PremisePurchase of 31 new serversEnergy for built-out infrastructure (58 servers)

CloudEnergy cost of on-premise servers (27)On-demand monthly cost of Cloud instances and data transferSlope of Cloud curve is steeper, implying higher incremental cost (OpEx)On-Premise OpEx is $3,098 - Cloud OpEx is $7,018BreakevenComparisons Cost of On-Premise vs. CloudLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

On-PremiseUpfront CapEx investment for 31 new serversOpEx at $3,098 per month for energyCloudOn-demand Cloud requires no initial CapEx investmentMonthly OpEx of $7,018 Some Cloud providers now support both cash outlay timing models in which an upfront CapEx expense offsets lower recurring OpEx expenses.Comparisons Cost Breakdown$83,685$84,215Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Summary Did we meet our data center energy challenges?Cloud enabled us to keep our on-premise energy requirements flat

Dynamic provisioning enabled us to more closely match infrastructure & demand for energy

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Hybrid models can suffer an increase in response time due to the Cloud instance interactions with the on-premise servers

There are two factors that affect response time: speed of the Cloud instances and additional network latency

Network latency can have a significant affect on client response timeSummary Did we meet our performance requirements?

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Summary Did we meet our data center budget requirements?Growing into the Cloud requires less up-front (CapEx) investment

Cloud recurring cost can end up exceeding traditional data center cost

Leveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Summary Capacity Planning QuestionShould we expand our on-premise infrastructure to handle the expected growth, or should we leverage the Cloud to support the increased workload volume?Grow into the CloudUtilize the on-demand Cloud to handle the expected 2x workload growthOn-Premise energy usage will be effectively cappedDefers need for data center expansionEliminates CapEx for required On-Premise infrastructure

ButCloud monthly expenses (OpEx) are larger than On-Premise: $7,018 vs. $3,098Cumulative cost of Cloud may overtake on-premise solutionCloud causes increase in average transaction response timeCapacity plan developed for 12-month a planning horizonLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#Recommendations A Formal Methodology is RequiredFocus your analysis on the Cloud providers pricing model(s)Evaluate data transfer cost & any other miscellaneous costs carefully

Dont ignore performanceCloud response times must meet business requirements

Manage your energy footprint by leveraging the Cloud Utilizing Cloud resources effectively caps your on-premise energy cost & consumptionData center power efficiency can be managed with the Cloud

Balance CapEx & OpEx based on your business requirements Cloud allows you to shift large upfront infrastructure investments into predictable recurring monthly costsLeveraging the Cloud for Green IT: Predicting the Energy, Cost and Performance of Cloud Computing#

Blind Adoption Can Be ExpensiveMitigate Your Risk With Proven Methodology & Best PracticesLeveraging the Cloud for Green IT:

Predicting the Energy, Cost & Performanceof Cloud Computing