How to Measure and Report PUE and DCiE

7/30/2019 How to Measure and Report PUE and DCiE

1/42

SMSM

Power Usage Effectiveness (PUE)& Data Center Infrastructure

Efficiency (DCiE) Progress

Dan Azevedo, Symantec

Jon Haas, Intel

Jud Cooley, Sun Microsystems, Inc.Mark Monroe, Sun Microsystems, Inc.

Pam Lembke, IBM


2/42

SMSM

Copyright 2009, The Green Grid The Green Grid Technical Forum

Agenda

PUE / DCiE Background & Next Steps

DCiE Detailed Analysis PUE / DCiE Usage & Public Reporting Guidelines

PUE / DCiE Calculation Tool

Free Cooling Map Power Configuration Calculator

22


3/42

SMSM


PUE / DCiE Background & NextSteps

3

3


4/42

SMSM


DCiE Detailed AnalysisDan Azevedo, Symantec

4


5/42

SMSM


Executive SummaryThe DCiE Detailed Analysis is to support and

strengthen the Data Center infrastructureEfficiency (DCiE) metric. The intent is to enabledata center managers collectively to derive anduse DCiE as a global standard metric.

55


6/42

SMSM


DCiE Detailed AnalysisThis White Paper represents the first in a series that will

provide a more detailed analysis of the PUE / DCiEMetric and represents the Basic level in the below tablewith the assumption of a dedicated data center facility:

Level 1(Basic) Level 2(Intermediate) Level 3(Advanced)

IT Equipment PowerMeasurement From

UPS PDU Server,.

Total Facility PowerMeasurement From

Data Center inputpower

Data Center inputless shared HVAC

Data Center inputless shared HVACplus buildinglighting, security

Minimum Measurement

Interval

Monthly/Weekly Daily Continuous(xx min)

66


7/42

SMSM


DCiE Detailed Analysis

77


8/42

SMSM



88


9/42

SMSM



Table of Contents

Introduction Type of Data Center

Background and Assumptions Climate and Location

DCiE Overview Data Center Design and Operation

DCiE Subcomponents Measurement Period

Obtaining Required Data Sometimes DCiE Seems To Go The

Wrong Way

Estimating Power Consumption Driving DCiE Efficiency

Measuring Power Consumption DCiE and Future TechnologyAdvancements

Power Metering Requirements Multiuse Facilities

Factors Affecting DCiE Summary

Dynamic Data Center Conclusion

99


10/42

SMSM


SummaryThis paper provides:

Prescriptive information on how to calculate the

efficiency metrics Multiple levels of implementation which enables a

very simple basic approach to as much depth and

complexity as desire Equipment categorization: infrastructure vs. ITequipment

Power metering requirements

Guidance on interpreting the metrics High-level guidance on multi-use facilities

1010


11/42

SMSM


Usage And Public Reporting Guidelines forThe Green Grids Infrastructure Metrics

Jon Haas, Intel

11


12/42

SMSM


Reasons for Guidelines PUE/DCiE have become commonly used metrics for data center efficiency

Factors such as environmental conditions, a data centers physicalcharacteristics, and timing and frequency of measurements can play a

significant role in final results In addition, some individuals and organizations have used these metrics to

promote design ideas that, while valuable, can provide misleading results

Standard guidelines for the use and reporting of these metrics will:

Enable a common language and nomenclature to compare results

provide a process to support accurate, consistent results

Provide additional transparency and accountabilitly in the process of measurementfor public claims

In addition, these guidelines will support The Green Grid in:

develop an auditing/certification process for the industry around these metrics

develop a recognition program for those organizations showing strong resultsand/or improvements in data center energy efficiency

1212


13/42

SMSM


Publicly reporting your Data

The Green Grid will provide a means for organizations to publicly report theirmeasurements

record their PUE/DCiE measurement data to The Green Grid

provide background information about the data center, reporting the results andthe manner in which, and conditions under which, that data was collected

provide a means to report any issues or difficulties in following TGGs proscribeprocesses and guidelines

The Green Grid will also provide a portal through which organizations canview summary details on publicly reported PUE and DCiE results

This portal will provide summary data on all registered reported results

All reported results meeting TGG guidelines will be given a registration number that canbe referenced

A subset of provided data will be publicly visible (see appendix 2 of WP or consent form)

TGG will offer members the opportunity to provide a link to additional informationabout their result or data center via additional optional reporting

Organizations reporting results have the option to participate in TGG awards orrecognition programs by complying with additional requirements

1313


14/42

SMSM

Copyright 2009, The Green Grid The Green Grid Technical Forum14

Classes of Measurement Results

Class Description Benefit to Reporting Organization

Unrecognized A publicly reported result with noclaims of following TGGs guidelines.TGG will not comment on unrecognized

results.

Reported A publicly reported result by thereporting organization claiming theyfollowed TGGs measurementrecommendations and nomenclature

guidelines. TGG will not comment onReported results.

Reporting organization canuse standard materials fromThe Green Grid to explainprocess and results to

audience.

Registered A publicly reported result, with keyreport contextual data provided to TGGby the reporting organization to TGGsdata center performance database.

Official registration ofreported result. Receipt of aregistration number from TGG.Link to public report data fromTGGs website.

Certified A publicly reported result, with keyadditional data required for third-partyvalidation or certification of results,provided to TGG by the reporting

organization.

All benefits applicable toregistered results, plus,consideration of reportedresults in future TGG award or

recognition programs.


15/42

SMSM


Usage and Reporting

GuidelinesTo receive a PUE or DCiE registration number from The Green Grid: Follow The Green Grids measurement guidelines in the most recent revision of DCiE

Detailed Analysis

Report the process through which the data was collected (L1, L2, L3) using the

nomenclature in the most recent revision of Usage and Public Reporting Guidelinesfor The Green Grids Infrastructure Metrics

Report your measurement data and input the required information into the GreenGrids Metrics Data Collection Database (www.thegreengrid.org)

Agree to The Green Grids metrics public reporting consent form

If requesting to be considered for a TGG award, provide the extended dataset information into the Green Grids Data Collection Database forcertified measurements

Additionally

Report to The Green Grid any issues or difficulties in following TGGsproscribed processes and guidelines

(optional, co-promotion) send the PUE or DCiE registration number, along with alink to any original source material or publication, to TGG [email protected]

1515


16/42

SMSM


PUE/DCiE Nomenclature

Structure All PUE and DCiE measurements should be reported with subscripts that

identify:

The accuracy level of the measurement

See The Green Grids Metrics: Data Center Infrastructure Efficiency Detailed Analysis The timeframe of the measurement

E.g. yearly, monthly, weekly, daily

The granularity of the measurement

Frequency with which the data was collected

E.g., monthly, weekly, daily, continuous Official PUE/DCiE reports will provide these information with subscripts

appended to the Metric

i.e. PUEx,y or DCiEx,y, where

x describes the Level of the measurement (L1, L2, L3) L1, L2, and L3 are defined in the TGG White Paper: The Green Grid Metrics: Data Center

Infrastructure Efficiency (DCiE) Detailed Analysis

y describes the Timeframe and Granularity of the measurement

y = timeframe identifier + frequency identifier

1616


17/42

SMSM


Measurement Accuracy Reporting

(from DCiE Detailed Analysis WP)Level 1(Basic) Level 2(Intermediate) Level 3(Advanced)

IT Equipment PowerMeasurement From

UPS PDU Server,.

Total Facility PowerMeasurement From

Data Center inputpower

Data Center inputless shared HVAC

Data Center inputless shared HVACplus buildinglighting, security

Minimum Measurement

Interval

Monthly/Weekly Daily Continuous(xx min)

1717


18/42

SMSM


Measurement Timescale and

Granularity Reporting

The y subscript on PUE or DCiE denotes the Timeframe and

Granularity of the measurement y = timeframe identifier + frequency identifier [M, W, D, C]

Frequency identifier:

M for measurements taken monthly

W for measurements taken weekly D for measurements taken daily

C for measurements taken continuously (with frequency one hour orless)

Except for those measurements collected with continuous data, alldata points that are averaged in the final measurement must betaken at the same time of day

Single measurements are reported with no frequency identifier

1818


19/42

SMSM


Example Reported Results

0.45 DCiEL1,-- Single DCiE measurement (0.45) taken using a Level 1 meter placement

0.51 DCiEL1,YM Yearly average DCiE (0.51), using data points gathered monthly with aLevel 1 meter placement

1.6 PUEL1,MWMonthly average PUE (1.6) using data points gathered weekly with a Level

1 meter placement

0.43DCiEL1,WDWeekly average DCiE (0.43), using data points gathered daily with a Level

1 meter placement

1.8 PUEL2,WC Weekly average PUE using data points gathered continuously with a Level2 meter placement.

2.1 PUEL3,YCYearly average PUE (2.1) using continuous measurements with a Level 3

meter placement.

19


20/42

SMSM


Specific Reporting Issues

PUEs of < 1.0 and DCiEs of > 1.0 are *not* allowed

Elements that go into the calculation

Power consumed by IT equipment

Power lost in distribution

Power consumed by cooling equipment

These elements are always 0

Accounting for re-use of waste heat

Waste heat re-use *does not* get included in either PUE or DCiE

TGG will look into creating an additional metric to cover this

Accounting for power generated on site PUE / DCiE is meant to cover areas of energy use in the data center

Generation of power on-site is not incorporated into either the powerdistribution losses or cooling equipment requirements

As such, it should not be considered in the PUE/DCiE calculation2020


21/42

SMSM


Conclusion We are driving the right behaviour!

The Green Grid Metrics for data center efficiency are

gaining widespread adoption, use and visibilityOrganizations are publicly reporting theirmeasurements and claiming highly efficient operations

The Green Grid is implementing public reportingguidelines that includes standard processes andnomenclature to make the measured resultsmore transparent and consistent

Stay away from PUEs of < 1.0 and DCiEs of >1.0, they are not viable

2121


22/42

SMSM


PUE Calculation Tool

Jud Cooley, Sun Microsystems, Inc.

2222


23/42

SMSM


Rationale and Objectives

Sponsor: Container Assessment Task Force to allow casestudy comparisons

Easily and accurately compute PUE In a consistent manner

Allowing for apples-apples comparisons

Container boundaries

Building or room boundaries

Web based One sheet printed report

Data archival/retrieval

2323


24/42

SMSM


PUE with Physical boundaries

Management reporting to visualize overhead

Power: Transfer Switch, UPS, Transformer, Generator, Lighting, etc.

Cooling: Tower, Condenser, Chiller, Pumps, etc.

Other: Fire Supression, Control, Security, etc.

IT Equipment: Servers, etc.

Facility BoundaryContainer or RoomBoundary

Facility equipment: air movers, powerdistribution, UPS, etc.

IT Equipment: Servers, etc.

2424


25/42

SMSM


Web screen shot example(Spreadsheet Prototype, artificial data)

Seq Class Type Detail

1 Facility Power Transfer Switch

2 Facility Power UPS 5.0

3 Facility Power DC Batteries / Rectifiers (non UPS Telco Nodes)

4 Facility Power Generator

5 Facility Power Transformer (step down) 5.0

13 Facility HVAC Chillers 25.0

19 Facility HVAC Return Fans 2.0

...30 IT Equipment Compute Devices Servers 50.0

31 IT Equipment Network Devices Switches

32 IT Equipment Network Devices Routers40 IT Equipment Other Other 2.0 2.0

...Total Facility + IT Power 32.0 59.0

Total IT Power 2.0 52.0

Total Facility Power (kW) 91.0

Total IT Power 54.0

PUE 1.69

DciE 0.59Total Power (kW) at Container Boundary 59.0

Total IT Power in Container 52.0

Partial PUE (Container Boundary) 1.13

Partial DciE (Container Boundary) 0.88

Facility(kW)

Container(kW)

2525


26/42

SMSM


Output

Single page PDF output Fileable report identifying configuration, date, data

Useable for direct apples-apples comparisons

Data saved in csv or a Data Base format TBD based on development discussion

Consistent with other Green Grid tools

Importable into spreadsheet

Re-loadable

2626


27/42

SMSM


Controversy over air movers

Fan-less servers with rack fans rely on those fans

Rack-based air movers might be considered either IT or

facility depending on your point of view Proposed position is that the air mover power is part of

the IT equipment

Needs to be discussed in Committees

PUE Calculator Tool will allow a separate line to enter airmover power that is not included inside the physicalboundary of the server, yet is required for the IToperation (to expose the ambiguity). That power will beallocated to IT, but will be left visible in the tool and theoutput.

2727


28/42

SMSM


Status and Timing

Consultants hired

In development now

Alpha version to be tested by Green Grid Task Forcemembers in Q1 2009

Beta and release target is for Q2 2009

2828


29/42

SMSM


Free Cooling Map/Web Tool

Mark Monroe, Sun Microsystems, Inc.

2929


30/42

SMSM


Concept and Features

Estimate the number of hours of free cooling that maybe possible based on weather data at any location in

the U.S. Consider European and APAC data in the design so that data

can be added in the future without major changes to theapplication or database.

Climate data will be analyzed to determine the numberof hours per year that either fresh air or evaporativecooling might be used in a data center.

30


31/42

SMSM


Concept and Features (contd)

Two colorful maps must be produced; one showing the U.S. color-coded to show the number of hours

of fresh air cooling possible,

the second map will show the U.S. color-coded to show thenumber of hours of evaporative cooling possible.

31


32/42

SMSM



32


33/42

SMSM



A web tool must be produced which allows auser to enter their own location, via zip code,

and the data center set points for temperatureand humidity that they which to examine forhours of free cooling

33


34/42

SMSM



35/42

SMSM


RFP Responses

weatherbank.com selected to implement

Response within budget estimates

Approved by Board 21 Jan 09

Prototype ready now

Seek approval from TC and Board in Feb Release in March

35


36/42

SMSM


Roadmap/Futures

Individual maps available for $150 direct fromweatherbank.com

Feedback page allows users to consult directly

Review in 3 months, determine enhancements

Possibilities: European and APAC data/locations/calculations

Simple model for water used by evaporative cooling

Input location by latitude/longitude Redisplay map with user-input parameters

Connect with DSIRE and other incentive databases

More complex models, more accurate results36


37/42

SMSM


Power Distribution ConfigurationsOnline Efficiency Estimator Tool

Pam Lembke, IBM

37


38/42

SMSM


Tool Purpose

The tool:

Is for use as a companion to

Qualitative Analysis of Power Distribution Configurations forData Centers, TGG WP #4 and

Quantitative Efficiency Analysis of Power DistributionConfigurations for Data Centers, TGG WP #16

Reduces the need for paper rewrites, as the tool can beeasily updated regularly

Allows readers and users to test their own components

and proposed system architectures


39/42

SMSM


Features

Users are able to:

Compare two topologies at a time

Input data points (load vs efficiency) of their own componentsfor the calculations

Create their own topologies based on their components or pre-defined TGG components

Save components and topologies Print input and results in PDF

Tool will automatically calculate full efficiency curves for

components

end-to-end efficiency curves for the two topologies

T l


40/42

SMSM


Tool

Mock Up


41/42

SMSM


Availability

The tool is scheduled to be available around Q22009

It will be accessible to members only via TheGreen Grid website


42/42

SMSM


Thank you for attending

The 2ndAnnual Green Grid Technical Forum

For more information, please visitwww.thegreengrid.org

How to Measure and Report PUE and DCiE

Documents

Transcript of How to Measure and Report PUE and DCiE