WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the...
Transcript of WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the...
![Page 1: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/1.jpg)
03WHITE PAPER
Tips & Tricks for the professional use of PUE as a management tool
By Niek van der Pas
![Page 2: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/2.jpg)
2 WHITEPAPER 03AN AEGIDE COMPANY
Tips & Tricks for a professional use of PUE as a management tool
![Page 3: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/3.jpg)
3 WHITEPAPER 03AN AEGIDE COMPANY
Tips & Tricks for a professional use of PUE as a management tool
In this whitepaper PUE specialist Niek van der Pas, working at the R&D department of
Minkels, will share his knowledge. He will point out tips and tricks for the correct use of a
PUE metric, in order to reach a certain level of operational excellence within your own data
centre environment. This whitepaper is intended for use at the level of corporate computer
rooms as well as commercial data centre level.
Throughout the years, Minkels’ employees have acquired considerable knowledge and
experience in the Held of data centre infrastructure solutions. Therefore, Minkels was ap-
proached by the European Commission’s Joint Research Centre (EU-JRC) in 2008, to assist
in the process of drafting the EU Code of Conduct for Data Centres. Niek van der Pas repre-
sents the NEN standardization committee for Data Centres in The ISO/IEC Study group on
Energy EUcient Data Centres (SG-EEDC). One of the goals of this group is to create an ISO /
IEC standard for PUE.
Introduction
Energy eUciency will become a major issue within data centre environments. Setting up a
new computer room or refurbishing an existing one without taking into consideration the
operational energy consumption most likely means the set-up is not future proof. Having
profound knowledge of the PUE (Power Usage EXectiveness) of a server room or data cen-
tre is a must for making energy-eUciency corrections and a prerequisite for a professional
approach towards energy eUcient data centre management. A good understanding of
PUE will help you move forward in a quest for Operational Excellence in your data centre
environment.
Current developments in IT infrastructure are strongly driving the need for operationally
excellent and therefore energy eUcient lay-outs of data centre design. Consolidation of
existing IT infrastructures is one of those drivers, a very important one. Virtualization and
cloud computing are the facilitators of consolidated infrastructures. Contemporaneously
it implies an increased use of medium and high density computing. That, combined with
the continuous rise of electricity prices, makes energy consumption a signiHcant and still
growing part of the Total Cost of Ownership (TCO) of a server room.
![Page 4: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/4.jpg)
4 WHITEPAPER 03AN AEGIDE COMPANY
Tips & Tricks for a professional use of PUE as a management tool
![Page 5: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/5.jpg)
5 WHITEPAPER 03AN AEGIDE COMPANY
CONTENTS
Tips & Tricks for a professional use of PUE as a management tool
1. Basic principles of PUE ................................................................................................................... 6
2. The value of a PUE ............................................................................................................................ 7
3. The PUE components ..................................................................................................................... 9
4. PUE measuring: from Basic to Master Level .......................................................................10
5. Using the right measuring equipment .................................................................................. 14
6. Embedding PUE in your organization ....................................................................................16
7. PUE recommendations by Minkels ..........................................................................................19
About data centre supplier Minkels ........................................................................................... 24
![Page 6: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/6.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 036AN AEGIDE COMPANY
The Power Usage EXectiveness (PUE) of a data centre is a metric that is used by engineers
and project managers of data centre supplier Minkels to deHne the energy eUciency of a
data centre (over time) and to specify in what areas and through the use of which tech-
nologies certain improvements to the energy eUciency could be made.
Although a mature level of PUE information gathering is preferable in the end (see para-
graph 4c about Master PUE), one could easily start oX with Basic PUE principles (see para-
graph 4a) and gradually move towards an Advanced PUE (see paragraph 4b) and then a
Master PUE level. Basic PUE monitoring principles can be implemented using simple tools
that are low on initial investments, for example with an instrument like a Current Clamp
Meter, which is just a general electrician tool (see paragraph 5a).
First we will share some basic PUE knowledge, with information about the metric and the
speciHc values of it for your own organization. Later on in this whitepaper we will elabo-
rate on how you can pave your own individual path towards Operational Excellence using
PUE information. Also, we will give you some tips and tricks brought to you by Minkels en-
gineers, including the picking of some low hanging PUE fruits (see paragraph 7d and 7e).
1a. DeInition
A PUE is an index number. Generally speaking a traditional server room design will gener-
ate a PUE of about 2.0, sometimes even higher. The closer to 1.0 it gets, the more energy
eUcient a server room set-up will be. However, a result of 1.0 is hardly possible as it would
imply an absence of overheads such as lighting and so on. An overall PUE Hgure can be
subdivided into several location speciHc sub Hgures, so adequate and prioritized measure-
ments can be taken in locations that need attention.
The deHnition of a PUE is as follows:
PUE = Total Facility Power
IT Equipment Power
1b. Initiated by The Green Grid
PUE has been introduced in the market by The Green Grid (www.thegreengrid.org). The
Green Grid is a worldwide consortium of companies within the ICT sector, founded by In-
tel, AMD, VMware, Dell, HP, IBM, Sun Microsystems and Microsoft, amongst others. Since
the foundation in 2007 quite a number of companies worldwide have joined the con-
sortium. The aim of combined eXorts is to seek energy eUciency maximization in server
rooms and a signiHcant reduction of energy use in the data centre environment. This is
conducted by the exchange of knowledge and insights into energy eUciency issues.
Chapter 1: Basic principles of PUE
![Page 7: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/7.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 037AN AEGIDE COMPANY
Nowadays the PUE is a broadly and worldwide accepted metric that clearly visualizes the
energy eUciency of a server room or data centre. For data centre managers, IT managers
and general management executives it is not only an eye opener to the importance of en-
ergy consumption awareness. It also provides them with a detailed grip on the energy use
in a server room and informs them how to manage server rooms in the most eXective way.
DCiE (Data Center infrastructure EUciency) is another metric launched by The Green Grid.
It has the same purpose and characteristics as a PUE, only with a diXerent conclusive Hg-
ure and another way to judge it’s outcome. The higher a DCiE Hgure is, the more eUcient
the facilities are. For a PUE the reverse is true. A low PUE Hgure will regect high eUciency
in a data centre. DCiE was launched to replace PUE, however PUE has since become widely
accepted in the market as the preferred metric to show data centre eUciency.
A PUE Hgure will not only give you detailed grip on the energy use in a server room. At
the same time it is an important indicator for the level of professionalism and eUciency
regarding your business and technical processes.
2a. Structuring of processes
A low PUE Hgure means that the business processes as well as the technical processes in
your data centre operations are well organized. The lower your PUE gets, the better opti-
mized your data centre operations will be. The reverse is also true. When there is no aware-
ness and knowledge on how the processes in a data centre environment are established,
then it will be very diUcult to realize and maintain a good PUE Hgure.
Gathering information about the PUE of your data centre environment - whether it is a
corporate server room or a commercial managed carrier neutral data centre - will be a
good starting point for an operationally excellent approach towards the overall manage-
ment of your server rooms. Provided that a PUE Hgure is used appropriately, then it will
be a good management tool to judge the operational eUciency of a certain data centre
design and to take managerial measures for improvement.
2b. Management tool for uptime
Even when it comes to the subject of availability, having profound knowledge of PUE will
be a prerequisite to achieving the desired uptime of every data centre manager, namely
around 99,999 to 100 percent. That’s because a PUE Hgure will be able to give you infor-
mation on the energy loads in your systems and to predict whether these loads are reach-
ing their limits in certain locations. If they exceed certain parameters, failure of the server
room or data centre as a whole would be the result.
Chapter 2: The value of a PUE
![Page 8: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/8.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 038AN AEGIDE COMPANY
Also, the cost-eXectiveness of a speciHc data centre solution can be managed more eas-
ily if you know about your PUE and the processes within your operations. In that case it
would be possible for example to even build certain parts of your data centre in a less
redundant and less capital intensive way. Only because all the management info and in-
formation about peak loads are available to make such decisions, so risks of failure can be
minimized. Furthermore, PUE data can be of interest to Service Level Agreements (SLA’s) in
contracts, depending on your business model of course.
In fact, using the PUE metric as a management tool in your data centre is one of the basic
management principles to implement and maintain high levels of eUciency in your data
centre design. As a data centre manager you have to know what is happening in your sys-
tems, otherwise you can’t control and improve. PUE knowledge can help. It’s is an integral
part of the road towards Operational Excellence - with cost eUciency, high availability,
gexibility and scalability as key ingredients - a goal every professional data centre man-
ager should aspire to. A good PUE result is an indicator for good management and having
the right knowledge about data centre processes at the right levels in your organization.
2c. Road towards operational excellence
The gathering of PUE data is an important and integral part of the road to Operational
Excellence in data centre environments. The road towards Operational Excellence is actu-
ally a continuous process in which you’ll have to determine step by step what actions
are necessary to improve the PUE in your individual situation. If one parameter is under
control you’ll have to focus on the others one after another.
In case of brand new server room development, there is another basic management
principle next to PUE improvement that might help you on the road towards Operational
Excellence. It is called the Volumetric Dimension and it is described in a previous whitepa-
per from Minkels, called: “New dimensions in Data Centre Design - Professionalizing the
data centre by striving for Operational Excellence.”
The traditional approach, based on the number of square metres available, often leads to
inappropriate choices during the initial phase, which unfortunately implies protracted im-
plementation projects and an increased continuity risk during the life span of a data cen-
tre. The ‘Volumetric Dimension’, as explained in this whitepaper, is an approach devised by
Minkels as one of the basic principles for the design and layout of ‘Operationally Excellent’
data centres and server rooms.
This previous whitepaper from Minkels is available in English from:
www.minkels.com/whitepaper
![Page 9: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/9.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 039AN AEGIDE COMPANY
To get the right outcome of your PUE deHnition it is important to have a good understand-
ing of the varying components in the metrics.
3a. Total Facility Power
This is the PUE metric component which includes the total energy load or power con-
sumption of a data centre facility or server room. A control room for purposes of data
centre management should be seen as part of the Total Facility Power, but in a ‘mixed use
situation’ the energy load of the IT equipment in the oUces and the energy used for the
oUces should be subtracted.
To the data centre facilities as a whole one should consider things like Uninterruptable
Power Supplies (UPS), chillers, pumps, CRACs, generators, stand by systems as well as
lighting and for example elevators. In fact, all power distribution components and IT
equipment should be part of the Total Facility Power metric.
3b. IT Equipment Power
This is the metric component that represents the energy consumption of all the IT equip-
ment inside your server room or data centre. One should not only take into account the
energy consumption of server equipment for general computing purposes. Also, the
energy loads of storage and networking equipment (including routers, switches and load
balancers) are part of this metric, along with peripheral equipment like monitors, laptops
and workstations, plus all kinds of rack gear like KVM switches.
3c. Where to measure
Generally speaking, Total Facility Power can be measured at - or close to - the utility meter
of a facility. Of course this should be a relatively easy job for a commercial data centre,
whereas for a corporate server room possible adjustments in the outcome Hgure might
have to be made. For example when it comes to shared CRACs and/or chillers in the oUce
buildings.
The right place to measure IT Equipment Power, again - generally speaking - would be at
the output of the Power Distribution Unit (PDU) at cabinet level in your server room. At
this point tasks such as switching and power conversion are completed already. After this
point power consumption applies speciHcally to your IT equipment.
To these general assertions at Master PUE level of measurement, various deviations could
be deHned in line with diXerent levels of maturity in PUE measurement or type of busi-
nesses. For these deviations, also have a look at chapter 4.
Chapter 3: The PUE components
![Page 10: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/10.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0310AN AEGIDE COMPANY
It is quite easy to get started measuring the PUE of your facilities. By taking into account
three levels of ascending granularity, you can just start with a basic level and develop the
right level of granularity in measurement instrumentation at your own pace regarding
time and cost investments. Having profound knowledge of the PUE of your facilities will
become an indispensable instrument in managing your server room in the near future.
The more you measure the greater the eXect. A phased implementation of PUE measure-
ment however will provide space for creating organizational support and a spreading of
necessary PUE investments.
4a. Basic PUE
A basic PUE can be measured at the levels of your UPS output (IT Equipment Power) and
data centre input power (Total Facility Power). This would result in a snapshot measure-
ment of your electric demand at one speciHc point in time. Therefore, the energy con-
sumption in this metric is measured in kW, not kWh (kilowatt-hour) as is the case with a
Master PUE measurement.
Positive: a Basic PUE could be a good starting point for facility managers, IT managers and
general managers of a data centre facility, mainly for the sake of creating PUE awareness
within the own organization. It also gives you a very broad idea of how good or bad your
data centre is achieving in terms of energy consumption.
Negative: the outcome of a Basic PUE measurement is not so reliable. It’s just a snapshot
in time. It doesn’t give you insight into PUE development over time, neither does it give
you the right information for developing eXective directions of improvement. For exam-
ple, it still doesn’t give you a clue whether it is your UPSs, your CRACs, or other facility or
IT equipment that’s wasting energy and spoiling a good PUE outcome. Also, a snapshot
measurement can be misleading due to seasonal diXerences in PUE outcome (in case of
Free Cooling being used). And you still won’t know whether or not having your main cool-
ing compressor or humidiHer in operation at the time of measurement could make a big
diXerence in the PUE end results.
Chapter 4: PUE measuring: from Basic to Master level
![Page 11: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/11.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0311AN AEGIDE COMPANY
4b. Advanced PUE
Within an Advanced PUE the IT load (IT Equipment Power) can be measured at UPS output
level as well, just the same as with a Basic PUE. The energy consumption measurement
of your data centre facility as a whole can be done at data centre input power level (Total
Facility Power). In this case the energy consumption is measured in kWh (kilowatt-hour),
because it is a continuous measurement on a periodical basis .
Continuous measurement of PUE periodically, monthly or weekly, will require some
investments. Only a small number of UPS’s currently available are capable of continuous
measuring at output level. In case you do have a UPS with such capabilities, even then it is
not certain that the UPS will deliver you the right Hgures. The quality of measurement by
those UPS’s diXer, but large deviations are not uncommon.
To build in a more reliable way of continuous measurement one should install a separate
kWh (kilowatt-hour) electricity meter in a cabinet behind the UPS and connect it to the
switchboard.
Many organizations however don’t have a data centre solution in place in which PUE
measuring is such a clearly deHned operation as mentioned. In practice lots of deviant
situations are possible, especially when it comes to corporate data centre environments.
For example, one can have CRACs behind a UPS. Sometimes also water cooling solutions
are situated behind a UPS, or even the lighting of a data centre. In that case additional
Figure 1: Basic PUE
![Page 12: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/12.jpg)
12 WHITEPAPER 03AN AEGIDE COMPANY
Tips & Tricks for a professional use of PUE as a management tool
electricity meters have to be installed for the equipment that doesn’t belong to the IT
load. If you don’t, then the PUE outcome will be an incorrect Hgure. The results of these
separate measurements have to be deducted from the IT load in order to get a detailed
and reliable PUE Hgure.
Positive: continuous measuring will give you a more reliable PUE outcome than an ad hoc
and individual Hgure. It will give you an average of PUE measuring over time. A one year
measurement will give you an accurate insight in the energy consumption
Negative: although an Advanced PUE is far better than a Basic PUE regarding the reliabil-
ity of your PUE Hgure, the outcome will not be as detailed and segmented as is needed
for composing solid energy eUciency plans. For that you need to opt for a Master PUE.
With an Advanced PUE it is still not possible to deHne a detailed plan of improvement. Ef-
Hciency improvements still have to be made subjectively rather than based on hard facts,
because the information feed is not yet complete.
Figure 2: Advanced PUE
![Page 13: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/13.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0313AN AEGIDE COMPANY
4c. Master PUE
When your organization is ready to go for an implementation of the most comprehensive
level of PUE measurement, in terms of time and costs that’s involved but also the ma-
turity of your organizational processes and data analyzing power, a Master PUE is what
you should strive for. A Master PUE requires a set up of several instrumentation points,
at the level of a cabinet. Depending on the size of your data centre this could be quite a
step to take.A Master PUE can be measured at the levels of your Power Distribution Unit
(PDU) output of a cabinet (IT Equipment Power) and data centre input power (Total Facility
Power).
Depending on your business model, whether you’re an ISP, a managed services provider or
a corporate organization, you can choose a measuring point either inside or outside a cabi-
net (e.g. on a Busbar). It would literally be only a cable length diXerence, so there shouldn’t
be a diXerence in the eXectiveness or reliability between these types of measurement. If
you don’t have a Busbar system, then measuring rack load on an individual basis in the
server room PDU board - the power distribution panel where the rack feeds are centred
- would be an option. In case you do have a Busbar system in place, then measuring at
cabinet level either at or near the Busbar system should be the location for installing PUE
sensors. If you’re an ISP for example, with no access to the cabinet, then power monitoring
in the Busbar Take oX boxes is the best option. If rack access is an option, rack PDU’s with
monitoring can be installed.
Generally speaking, in an optimum situation, PUE information should be gathered as
close as possible to the power consuming equipment. On the other hand it is wise to cre-
ate independency in acquiring data from possible fast changing parameters in the data
centre infrastructure. Therefore, gathering PUE information at server (or network equip-
ment) level might be not the best option to go for. Of course this could be handy to trace
hotspots in a very detailed manner, but summing the power readings of servers could also
mean high risk for disrupting and unavailable power data in case of changes in the server
operating system. Not to mention incompatible operating systems or inaccessible systems
because of security or availability reasons. Also, don’t underestimate the extra eXort which
is needed to match the load with the correct outlet per server, especially when the servers
are A/B fed and both feeds are energized If you don’t match all this data you might end
with an inaccurate result.
Positive: a Master PUE will continuously give you very detailed and segmented informa-
tion about the energy eUciency of your data centre or server room. On the basis of this
information possible energy ineUciencies can be identiHed and one can develop an overall
plan of improvement and make targeted modiHcations to the data centre environment.
![Page 14: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/14.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0314AN AEGIDE COMPANY
Negative: in the beginning, a Master PUE will require quite some investments in time and
money. In the end however it will deHnitely pay oX. It’s good to know that PUE measure-
ment can be automated to the fullest, so after your Hrst investments the measurement of
your PUE should be quite an easy task.
Gathering PUE data inside your data centre facilities will require the use of some basic
PUE equipment. Here we shall mention the ones that you will probably need most.
5a. Current Clamp Meter (general electrician tool)
This is a quite handy tool for everyone who’s involved in day-to-day operations of a data
centre or server room. An RMS Current Clamp meter can be used for individual and mobile
electricity measurement. This hand held clamp meter is very useful for indicative energy
eUciency surveys and targeted eUciency analysis.
Figure 3: Master PUE
Chapter 5: Using the right measuring equipment
![Page 15: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/15.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0315AN AEGIDE COMPANY
This is a tool that should be available in every Data Centre and is of low cost In fact, this
instrument should be a standard tool in the tool box of every electrician.
This product is a particularly good solution to be used in retroHt situations, in existing
data centre environments (this product is suitable to start with PUE measuring right away,
without infrastructural modiHcations).
On the other hand it could also be a handy instrument to be used in the latest designs of
next generation server rooms, for individual and targeted electricity measuring. A Current
Clamp Meter is very useful for indicative energy eUciency surveys and targeted eUciency
analysis during the process of PUE eUciency improvement.
Current Clamp Meters have their drawbacks. Only skilled personnel can work with them
because of the necessity of working in open switch boards. Also, it is not possible to
measure current on a standard power cord. The magnetic Helds of the phase and neutral
line will cancel out so no reading can be accomplished. With a Current meter no voltage
or power factor is being measured. The result will therefore give you an indication, not an
absolute result.
If available, an alternative tool like the Fluke 430 or the LEM Analyst3P can also help to
measure the PUE. Both are hand held tools that can give you accurate power measure-
ment reporting.
5b. Current Transformer (CT)
This tool is meant for electricity measuring at PDU level outside the rack. This is an energy
monitoring system which may be installed into a live data centre environment.
Minkels has a CT measuring tool available, it is called Varicontrol-C . Varicontrol-C is a
stand-alone monitoring and reporting application which provides kWh, W, V, A, and pf, and
the possibility to transfer alarm-condition alerts via e-mail server, or via SNMP traps to a
network management system. This system includes voltages and power factor measure-
ment and will give you very accurate results.
Varicontrol-C can be integrated to the Minkels Varicontrol Data Centre Infrastructure
Management (Varicontrol DCIM) platform (see also 7b), an overall software suite that is
able to manage all the data (PUE data, amongst other data) gathered in your data centre.
![Page 16: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/16.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0316AN AEGIDE COMPANY
5c. Intelligent Rack PDU
Depending on your business model, it could be possible that you have full access to the
equipment in data centre racks. If that is the case, like in corporate business environments,
it is possible and desirable to install intelligent Rack PDU’s to measure electricity con-
sumption inside the cabinets.
For this purpose Minkels has developed a product called Varicontrol-P. These are intelligent
PDU’s which are able to deliver you the PUE data needed.
A rack PDU can be connected to the Minkels Varicontrol data centre infrastructure man-
agement platform (see also 7b), an overall and vendor independent software suite (based
on open source) that is able to manage all the data (PUE data, amongst other data) gath-
ered in your data centre.
The nature of your business model has quite a lot of inguence on the type of PUE measur-
ing you are able to choose.
6a. InZuence of business model on measurement options
As previously stated, PUE information should be gathered as close as possible to the
power consuming equipment. But you also need to create independency in acquiring data
from possible fast changing parameters in the data centre infrastructure. Plus your busi-
ness model will dictate to you on which levels you should measure and on which level you
are able to gather PUE data.
The level of granularity should match the business needs of a speciHc data centre. For a
large data centre facility very detailed information about a cooling system is more valu-
able than would be the case with a relatively small corporate server room. Information
about which part of the cooling system (including pumps) is using what part of the en-
ergy supply could be very informative PUE data for a large data centre. Such data can only
be quantiHed by installing individual power metering devices at pump level.
6b. Data Centre Decoupling Point (DCDP)
A good starting point in investigating which measurement options you have in your own
data centre environment, is to determine what your speciHc Data Centre Decoupling Point
Chapter 6: Embedding PUE in your organization
![Page 17: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/17.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0317AN AEGIDE COMPANY
(DCDP) is. Determining your DCDP is a Hrst step in understanding the level of inguence
you have on the Hnal PUE measurement layout. To learn about this subject, please have
a look at our previous whitepaper: “New dimensions in Data Centre design; Profession-
alising the Data Centre by striving for Operational Excellence”, written by Patrick Timmer,
business development engineer with Minkels.
The following scheme will give you an impression of your unique DCDP, the instrumenta-
tion points for PUE data gathering and the products Minkels has available for that.
6c. Distribution of PUE information
Electricity measurement and electricity data monitoring used to be something only for
technical people. Not anymore. With the urge at management level to improve energy
eUciency and the availability of modern web based management software (see 7b), all the
stakeholders in data centres can get access to this information.
With the higher level of use of PUE information and more segmentation in usage (general
management, data centre management, server room management, goor management),
data Hltering and the way PUE data is represented at technical level as well as lower and
higher management levels becomes more and more desirable.
The higher in an organization chart the PUE data should be analysed, the less technically
detailed this information needs to be. A general manager probably wants to know about
the overall PUE and have some arguments for investments to improve the PUE in the
future. A facility manager probably will need more detailed information to do his job, like
the PUE of a cooling system, the PUE of a UPS and the PUE of power distribution, to name
a few. A data hall manager on the other hand will need PUE information at rack level.
Therefore, it is necessary to subdivide an overall PUE in several decentralized PUE Hgures. A
good PUE management system will help you out (see 7b).
Figure 4: Data Centre
Decoupling Point
![Page 18: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/18.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0318AN AEGIDE COMPANY
6d. Incorporating PUE in quest for Operational Excellence
Operational excellence within your data centre environment is a very important goal to
strive for. Not only for purposes of energy-eUciency, but also when it comes to having
your data centre processes well organized. This of course will improve the uptime and reli-
ability of your IT infrastructure.
6e. Practical examples PUE measuring
The gathering of PUE information is an important tool to improve your processes and
trying to approach a situation of Operational Excellence. The next two practical examples
will illustrate how PUE information can help you with this.
These examples describe the individual approaches of two organizations towards a
situation of Operational Excellence, that is to say, an optimum use of their resources for
(energy) eUcient day-to-day data centre operations.
A data centre striving for Operational Excellence is using an energy-eUcient concept in
which hot and cold air is separated and outside air is being used for direct cooling of the
equipment inside, both on account of creating energy eUciency. It seems that the im-
plemented systems are functioning well. For the sake of PUE measurement several PUE
measuring tools are being installed. The PUE information however shows that the PUE
result Hgure is higher than initially expected. After having the systems analyzed it ap-
pears that the cooling equipment is sucking back the blown warm air gows. Adding an air
separator turned out to be the solution to Hx this problem. So PUE information laid the
foundation for Hxing this issue, helping this data centre get one step further in its quest
for Operational Excellence.
7. An organization has multiple data centres on several locations. This organization at one
time decides to implement PUE gathering tools in all of the premises in order to make its
Hrst steps in the direction of Operational Excellence. By doing this it is suddenly possible
for the organization to compare and explain diXerences and analogies in computer room
issues and to share best practices. PUE in this case is a tool to create an overall KPI (Key
Performance Indicator), to speak the same language in diXerent computer rooms and to
analyze and judge improvements being made in a structured manner. A completely dif-
ferent situation than the Hrst example, but again PUE is also helping this organization to
![Page 19: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/19.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0319AN AEGIDE COMPANY
take the next step in optimizing the use of its resources for (energy) eUcient day-to-day
data centre operations.
Optimal PerformingDC PUE<1.2
Data CentreToday
PUE > 2.0
Operational Excellence
Measure the PUE
Technological Developments
People:IT end-users, DC StaA
Market/Competition/Availability
Environment/sustainability
Apply Best Practices
RetroIt the DC
Implement a
Managment system.
Start with PDCA. ISO
72 or EU CoC.
Implement kWh
metering of IT and
Facilities. Involve all
steakholders. Use
basic PUE. Implement
Master PUE.
Implement changes
quick wins first.
Seperate hot and
cold air. Install Cold
Corridor.Use blanking
pannels. Increase UPS
Utilization. Optimize
cooling system
settings. Close the
PDCA loop.
Redesign the
cooling system.
Max use free cooling.
Modulairize your UPS
sytem. Optimize for
high efficientie in
changing load
conditions. Fine tune
system control
The DC is running
Operational Excelent.
To stay in pace with
changing IT, keep
managing and
continue improving.
Biggest win in is now
lowering IT power
consumption.
A PUE can be measured with diXerent types of granularity. Our advice is to do a PUE sys-
tem implementation gradually, taking it step by step.
7a. Gradual implementation
Start oX with a Basic PUE, to create awareness within your organization. By doing this you
will be able to create a positive atmosphere towards the necessity of energy eUciency
within your organization. Not only for environmental purposes, also regarding the level of
availability of your server room(s), and regection on the maturity of your processes and the
cost saving options PUE data will bring.
After that you can go a bit further and opt for an Advanced PUE. It will ask for some more
investments in terms of time and money, but your organization is convinced that PUE
knowledge will pay oX, so that hurdle is already being taken. The PUE data gathered is still
not as detailed as you probably would have wanted, but it will give you enough data to Hx
some energy ineUciencies and improve your PUE by a fair amount.
The Hnal step should be to go for a Master PUE. In this phase your PUE measurement sys-
tem is measuring on a full continuous basis, with a level of granularity built in according
to the type of your business. The overall PUE Hgure and subdivided PUE Hgures for diXer-
ent segments of your systems will give the diXerent levels in your organization the speciHc
PUE data they individually need. In this phase, with this information supply, you’re able to
make targeted modiHcations and improve your PUE Hgure to the fullest.
Figure 5: Path to an Operational Excellent Data Centre
Chapter 7: PUE recom-mendations by Minkels
![Page 20: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/20.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0320AN AEGIDE COMPANY
Keep in mind that a PUE-system implementation will cost some time and money in the
start-up phase, but the gathering of PUE data can be a fully automated process in the end.
So, PUE gathering on a continuous basis should Hnally be an easy task for every organiza-
tion.
7b. PUE management software suite: Varicontrol DCIM
To have PUE data gathered continuously, analysed and distributed amongst the right
persons within your organization, Minkels has a management platform available. The
software product is called Minkels Varicontrol DCIM. This is a fully integrated, brand-
independent data centre management system, which uses sensors in the data centre
environment to measure, analyse and manage all diXerent aspects in order to achieve and
maintain maximum eUciency. Not only regarding your PUE, but also incorporating power
consumption, cooling, environment and access control.
Minkels developed the data centre management system in cooperation with the Univer-
sity of Antwerp and leading customers. The monitoring system comprises all the Key Per-
formance Indicators (KPIs) required to manage the entire infrastructure of a data centre
environment cost-eXectively and energy eUciently. The system accesses all the real-time
data required from the various types of infrastructural equipment in a data centre, includ-
ing PDUs, chillers, CRAC units, UPSs, coolers, cameras and Hre detectors.
Thanks to the open source nature of the platform, it readily enables the integration of ex-
isting management software – such as an access control system, a Network Management
System (NMS) and a building management system (BMS) – in Varicontrol DCIM.
7c. Deliverables on PUE investments
During the process of adjusting your data centre infrastructure and trying to lower your
PUE Hgure, you will ultimately reach a point where the investments won’t be fully oXset
by the Hnancial beneHts of a targetted PUE result. In other words, there is a break-even
point within every achievement towards lowering your PUE Hgure. A break-even point
diXers from situation to situation. Basically, there are mainly three parameters with which
you can determine your own personal break-even point.
![Page 21: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/21.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0321AN AEGIDE COMPANY
These 3 parameters are:
Level of PUE investment
BeneHts of lowering your energy cost
Required payback time
The closer you get to the level of ‘PUE=1.0’, the more eXort it will take to further improve
your PUE results. The asymptotic eXect means that you will eventually come to a break-
even point where further investments in PUE improvement won’t pay oX anymore. Where
the break-even point lays, is diXerent for each and every situation. It also depends on the
intended payback time. The longer this scheduled period is, the more investments you
are able to make and the more chances you get to lower your PUE any further. Generally
speaking, stretching the payback time a bit will pay oX in terms of energy eUciency and
energy cost reduction.
7d. Low hanging fruits
There are some quick wins you can make when it comes to lowering your PUE Hgure.
These quick wins are relatively low on investment, potentially gaining high energy cost
reduction. By making some quick wins it is possible to even lower your PUE from 2.0 to a
Hgure of 1.6, with exact Hgure statements diXering in each and every situation.
Figure 6: PUE and ROI
![Page 22: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/22.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0322AN AEGIDE COMPANY
Monitoring Hrst of all is a prerequisite to start lowering your PUE Hgure, otherwise you
will never know where to start your quick win eXorts and what results it will bring. After
having a PUE monitoring system installed one can start picking the low hanging PUE
fruits. Not every low hanging fruit will be applicable for every data centre in the market,
but generally speaking the following actions could be taken to have some quick wins.
Complete separation of hot and cold airgows, achieved by enclosing the roof section
between opposing data centre cabinets on the cold aisle with glass panels. Both ends of
the cold aisle are sealed oX using sliding doors to contain the air. Installing Cold Corridors
together with other measures will lead to signiHcant eUciency improvements.
The use of Free Cooling is not applicable for every data centre environment. Especially
within existing and full operational data centre environments installing Free Cooling
would be a tough job to realize. For new data centre development however one should
deHnitely have a look at this option. When Free Cooling is actually being installed it is very
important to have the system tuned correctly. It happens quite often that Free Cooling
is being installed but not tuned the way it should, with the result that the investment in
Free Cooling doesn’t pay oX.
Cabinets within a Cold Corridor system can be easily equipped with blanking panels, so
cooling air is not wasted at spots where no equipment is being installed yet. The use of
blanking panels makes sure the only route for air gows is through the equipment. Another
way to reduce leaks is by using air sealed racks.
Especially when one is using Cold Corridors, the fan speed of cooling equipment can be
set at lower levels than one is probably used to. That’s because cool air is more equally
and eUciently being divided within a Cold Corridor system. Fan power usage follows a 3th
power curve with the airspeed. So reducing the fan speed by 25% will more than half the
fan Power.
![Page 23: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/23.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0323AN AEGIDE COMPANY
Separation of hot and cold air avoids hotspots and therefor temperature set points can be
higher without compromising the server inlet temperature.
Setting CRAC units at supply air temperature instead of return air temperature Before the
introduction of hot and cold aisles data centre CRAC units were set at room temperature
i.e. 22˚C. This is return (hot) air temperature. In a Cold Corridor DC the supply air tempera-
ture to the servers should be controlled, not the return air temperature. Get in contact
with the CRAC unit manufacturer or Installer to check whether this is possible.
7e. Low hanging fruits – The next step
There are some other quick wins you can make, but these eXorts will probably cost you a
bit more energy and they’ll ask for some intensive data centre engineering knowledge and
experience. The following actions can probably help you taking the next step in picking
some low hanging fruits in PUE improvement.
Improve load eUciency of UPS
Improve power factor of UPS
Use clean air Hlters
7f. Conclusions
To conclude this whitepaper, I would like to stress that measuring your PUE, analyzing
PUE data and using it for eUciency corrections in your data centre environment is always
a continuous process that should be integrally embedded into your organization. Only
continuous eXorts in PUE measurement and eUciency corrections will help you optimise
the use of your data centre resources, thus leading you towards a situation of Operational
Excellence.
As a prominent contributor to drafting the EU Code of Conduct for Data Centres - for
the European Commission’s Joint Research Centre (EU-JRC) in 2008, Minkels hopes this
whitepaper about the professional use of PUE as a management tool will foster a further
professionalization of the data centre market. I also hope it will inspire your organization
to take it to the next step and use PUE as a management tool for creating and maintaining
data centre eUciency. The engineers of Minkels are always willing to assist you on this and
give advice regarding PUE, eUciency improvements and server room solutions for speciHc
situations.
![Page 24: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/24.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0324AN AEGIDE COMPANY
Minkels B.V. (www.minkels.com) is a European manufacturer of total solutions for data
centre infrastructure, whose headquarters, R&D department and assembly lines are in
the Netherlands (Veghel). The Hrm also has branch oUces in the UK, Switzerland, Belgium
and France. Minkels’ product portfolio is subdivided into cooling (Varicondition®), housing
(Varicon®), and monitoring (Varicontrol®) solutions. The following are signiHcant products
in the Minkels portfolio: Data centre water-cooling solutions (Varicondition H2O); hybrid
cooling solutions, using both air and water; and Cold Corridor systems, which are used to
segregate hot and cold air gows in the data centre.
As a data centre supplier, Minkels has a client base which comprises prominent organisa-
tions, including Swisscom (Switzerland), Radboud University Nijmegen and EvoSwitch
data centre (the Netherlands), as well as De Persgroep media Hrm (Belgium). In view of
the considerable knowledge and experience Minkels has acquired throughout the years in
the Held of data centre infrastructure solutions.
Minkels is a subsidiary of the Aegide Group (www.aegide-group.com), a major European
player in the Held of integrated development, manufacturing and marketing of high-
quality housing solutions for the ICT and high tech OEM industries. Minkels also won the
‘Brabantse Economieprijs 2010’ last year. This prize, which is awarded once every three
years, was set up by the Dutch Province of Noord-Brabant with the intention of applaud-
ing the eXorts of successful companies who dare to invest in innovation and innovative
products, thereby providing dynamism and economic growth.
For more information on Minkels or some further help with the PUE metric in your speciHc
business situation, please visit www.minkels.com, or contact one of our oUces.
![Page 25: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/25.jpg)
Tips & Tricks for a professional use of PUE as a management tool
WHITEPAPER 0325AN AEGIDE COMPANY
Minkels Netherlands
Eisenhowerweg 12
P.O Box 28
5460 AA Veghel
tel. +31 (0)413 311 100
www.minkels.com
Minkels Belgium
Remysite
Remylaan 4C - Bus 12
3018 Wijgmaal (Leuven)
tel. +32 (0)16 44 2010
www.minkels.com
Minkels France
Parc d’activités de Malnoue
28, Rue Vlad. Jankelevitch
77184 Emerainville
tel. +33 (0)164 61 61 91
www.minkels.com
Minkels Switzerland
Riedstrasse 3-5
CH-6330 Cham
tel. +41 (0)41 748 4060
www.minkels.ch
Minkels United Kingdom
Unit 4
M40 Industrial Centre
Blenheim Road
Cressex Business Park
High Wycombe
Bucks, HP12 3RS
tel. +44 (0)1494 451706
www.minkels.com
![Page 26: WHITE PAPER - Technische Unie · plementation projects and an increased continuity risk during the life span of a data cen-tre. The ‘Volumetric Dimension’, as explained in this](https://reader033.fdocuments.us/reader033/viewer/2022060306/5f09ad147e708231d427fab9/html5/thumbnails/26.jpg)