we’re used to. To protect the planet, and your money (i.e ... · 15 years, that’s a lot of...

This presentation is about opportunities. And looking for them “outside the box”

we’re used to.

This presentation is about opportunities. And looking for them “outside the box”

we’re used to.

Whether you’re looking at new build, legacy retrofit, fitout of existing space.

Opportunities to do better than the benchmarks we’ve been focused on for the past

10-15 years.

To protect the planet, and your money (i.e. Your business).

At a recent US conference I attended, a LEED Platinum DC from Canada was

honoured, and presented their design.

A question asked was “how much extra did it cost to achieve Platinum?”

The answer – “not as much as we thought it would, once we analysed it fully”

NEA Singapore review in 2010-2012 found:

• DCs could reduce energy use by mainly air management and plant loading

• Small & Medium DCs – payback < 2 years (12% energy reduction)

• Large DCs - payback 4.2 years (16% energy reduction)

2

The concept “One Planet Living” is based on the simple proposition that we only have

one planet earth, whereas Ecological Footprinting analysis (Link) shows that if

The concept “One Planet Living” is based on the simple proposition that we only have

one planet earth, whereas Ecological Footprinting analysis (Link) shows that if

everyone on earth lived like the average Australian, we’d need more than 3 planets to

support us (Link1, Link2).

Planets

SG 3.141176

MY 2.858824

TH 1.394118

For Australia, its an extra Planet!!

AU 4.023529

4

Zero carbon Making buildings more energy efficient and delivering all energy with

renewable technologies .



Zero waste Reducing waste, reusing where possible, and ultimately sending zero

waste to landfill .

Sustainable transport Encouraging low carbon modes of transport to reduce

emissions, reducing the need to travel .

Sustainable materials Using sustainable healthy products, with low embodied energy,

sourced locally, made from renewable or waste resources .

Local and sustainable food Choosing low impact, local, seasonal and organic diets

and reducing food waste .

Sustainable water Using water more efficiently in buildings and in the products we

buy; tackling local flooding and water course pollution .

Land use and wildlife Protecting and restoring biodiversity and natural habitats

through appropriate land use and integration into the built environment .

Culture and community Reviving local identity and wisdom; supporting and

participating in the arts .

Equity and local economy Creating bioregional economies that support fair

employment, inclusive communities and international fair trade. 6

LEEDLEED

BREEAM

GreenMark:

Carbon / Energy 83 points

Water 12 points

Sustainable Materials and Waste 2 points (a bit soft though)

Health (IEQ) 8 points

“Other” could include Transport, Land Use, more of above (10 points)

7





Renewable Energy Sources – Wind?

And Solar?

Don’t forget that they have to be BUILT somewhere.... And that the land use is a

factor overall. Shared use or co-existent use with natural habitat is a good balance.

8





Renewable Energy Sources – Hydro?

Don’t forget the real impact of valleys of forest drowned by dams, and the equipment

manufactured to make it all work.

But it’s still much better than the “baseline” alternatives......

9





Mostly we’re stuck with what we can get from the grid. Coal, Oil, gas or whatever it

might be.

So we’ve focused in the past, and will continue to in the foreseeable future, on

Energy (hence Carbon emissions, in most locations). That still matters, and always

will......

10





For good reason....

Green, orange, red lines vs Yellow line – IT efficiency impact up the chain.

% losses consistent in all four as we move back towards grid. Look at the impact it

has....

Energy Use & Efficiency

Lighting, Daylighting

Heat recovery

Building Fabric, orientation

You can see, and will already be aware - Cooling system is the biggest non-IT

component DC load (usually).

Let’s look at some cooling opportunities you might not have seen.

11

Indirect Evaporative (or Adiabatic) CoolingIndirect Evaporative (or Adiabatic) Cooling

Air cycle within the Data Centre.

Evaporative system cools the circulating air

Some form of backup coil that can be staged on to supplement cooling from

evaporation.

Works well where water is readily available, and humidity is low. Not so well here in

Singapore (but workable and worthwhile – still better than a water cooled system).

Water use is OK with very low humidity, and can be used with Salt water (in theory).

A variant on this is the Air-Air Heat Exchanger – no evaporation, use outside air temp

to cool recirculating air.

12

How does it work?How does it work?

•Hot aisle containment

•Hot aisle high level coil PLUS back of rack coil

•Close coupled fans

•Adiabatic cooling of condenser water using Fluid Coolers

•CDU with compressor when ambient requires

13

E-Comb - New Builds and Fit-Outs

Up to 50kW per rack

E-Comb - New Builds and Fit-Outs

• Up to 50kW per rack

• Look and feel of traditional facility

• Installed as a modular building or into an existing building utilizing only the

interior components of the pod.

• Rapid density scalability

• Highly flexible and customizable for specific size and IT requirements

Also available as retrofit solution

14

How does it work?How does it work?

•Hot aisle containment

•Hot aisle high level coil PLUS back of rack coil

•Close coupled fans

•Adiabatic cooling of condenser water using Fluid Coolers

•CDU with compressor when ambient requires

•Predicted annualised pPUE in Singapore = 1.12 (peak 1.15).

15

Uses a certain set of assumptions which might not match your scheme. Weighted to

common loadings:

Uses a certain set of assumptions which might not match your scheme. Weighted to

common loadings:

1% of time 25%

40% 50%

45% 75%

12% 100%

16

At a steady 75% loading, the water cooled system performance and Adiabatic

performance is better. Does not make much difference to the Inertech e-Comb

system.

17

Will this be your Data Centre at the end of its life?Will this be your Data Centre at the end of its life?

Materials are scarce, expensive, limited. And can be reused if selected right to start

with.

Waste can be collected

How do we minimise WASTE? And control the selection of materials?

Selection of materials and their embodied energy – steel, concrete – huge energy to

create them. How much sense does this make?

A cubic metre of concrete requires about 240 tons CO2 to produce (and then you

have to transport, mix, and install it.....)

A ton of steel requires about 1.9 tons of CO2 to produce.... And likewise to transport,

treat, install....

18

How do WE minimise WASTE? And control the selection of materials?How do WE minimise WASTE? And control the selection of materials?

How did THEY minimise waste, and control material quality and selection – 100 years

ago

Learn from other industries!

Whether we’re talking about toasters, TVs, or cars...

When there are hundreds, thousands, hundreds of thousands......

19

How do we minimise WASTE?How do we minimise WASTE?

Learn from other industries!

Build Data Centres like we build cars...... They figured it out long ago.

The PRODUCT MENTALITY....

Does it seem expensive? Check Youtube for Fortrust story on “Adopting a Modular

Approach” how they moved from a conventional build facility to complete the fitout

with prefab modules, at lower cost than their original scheme and all the “improved”

schemes they could develop. They knew they could do better.

And they did.

20

A side note.......A side note.......

Another benefit of mass production is DEPENDABLILITY:

• Availability

• Reliability

•Maintainability

• Safety.

But it doesn’t solve some of the biggest Data Centre risks:

• complexity...

<CLICK>

• Promotes risk of HUMAN ERROR

21

How do we minimise WASTE in Energy?How do we minimise WASTE in Energy?

We can co-exist with other industries! And use excess heat to generate power as well

as get “free” cooling.

Use an “industrial Ecology” scheme.

<CLICK>

LNG Distribution Terminals – need heat input to vaporise gas for distribution, and

generate excess cooling.

<CLICK>

Build Data Centres adjacent to source of COLD from industry. Done so far in:

China • 2012: Air separation and liquefaction

Japan • 1977: 1.45 MW expansion turbine - clean power

• 1982-2000: Clean power capacity expands to 14 MW

• 1979: Air separation and liquefaction

• 2000: Cooling for 435 MW co-gen plant

• 2005: Frozen foods, cold warehouse, dry

ice & chemical manufacturing

S. Korea • 2006: Air separation, cryogenic grinding

Taiwan • 1996: 3 MW expansion turbine - clean power

• 2005: Water cooling for aquaculture22

How do we minimise WASTE?How do we minimise WASTE?

Industrial Ecology -Teracool

There’s a location near you waiting for your waste heat.

23





Cooling Towers / Water Cooled systems are not too good for this.

And in some locations, water is a SCARCE resource.

24





Cooling Towers on this site are watered by rainwater collection.

Rainwater off roof, ground water not collected due to possible pollutants. These are

treated by Gross Pullutant Trap in bottom corner.

Rainwater Harvesting manages local runoff in high flow, plus retains site water for

cooling usage.

Future tanks installed when towers and load growth demands.

25

Equity and local economy Creating bioregional economies that support fair employment, inclusive communities and international fair trade.inclusive communities and international fair trade.

Data Centre opportunities?

Local employment

Local industry supply sources

26

Maybe not strictly on topic, but if the Data Centre is going to be an ongoing business, then yes.....then yes.....

Chris Crosby, Compass Data Centres – a US based prefabricated Data Centre developer:

Myth = Size drives out cost.

Truth – product mentality drives out cost

<CLICK>

• Ability to deploy capital on demand

• Adaptable and flexible deployment options

• 140 days from Order to Install vs. traditional custom built 18-36mth time frame

• High resiliency to market and technology trends

• Build once the customer is contracted vs. “build and they will come” mentality

• DC 2.0 software provides greater control over energy consumption and allocation decreasing energy OPEX

27

Land use and wildlife Protecting and restoring biodiversity and natural habitats through appropriate land use and integration into the built environment .through appropriate land use and integration into the built environment .

What’s the existing use?

What’s the possible RE-use opportunity?

What’s the best use for the local economy and community?

28





Local and sustainable food Choosing low impact, local, seasonal and organic diets

and reducing food waste .

Culture and community Reviving local identity and wisdom; supporting and

participating in the arts .

What can a Data Centre contribute to these?

Transport

• site selection – near transport links – freight and people

• how much freight movement goes on? For an ENTERPRISE DC we designed

recently, forecast truck movements in stable operation were TWO / week. Over 10-

15 years, that’s a lot of trucks.

Culture and Community

• community connections, Local and sustainable food

• open space?

• share waste heat

• staff facilities?

– waste heat use? It’s been done in Canada, where Bastionhost converted a cold war

nuclear bunker to a DC, uses waste heat for Hydroponics (and as an primary producer,

avoids local fuel taxes!) 29

Culture and community Reviving local identity and wisdom; supporting and participating in Culture and community Reviving local identity and wisdom; supporting and participating in the arts .

Health and happiness Encouraging active, sociable, meaningful lives to promote good health and well being.

When we look at the enviromental impact of Data Centres, its a “too much energy” story.

But there is hardly ever an accounting of the resources SAVED through the use of IT. What’s this guy doing?• saving a trip to the bank across town?• checking on public transport status – bus locations by GPS, timetables?• telecommuting (working)?• ordering a take-away meal? Or anything else online?

All of these activities SAVE resource – significant resource – and save TIME for people.

Disruptive Technologies that are coming, or here (McKinsey Disruptive Technologies: that will transform life, business, and the global economy):

They name 12 – a few of these with major sustainability impacts ENABLED by the DATA CENTRE:•Mobile (above)• The Internet of Things• Automation of Knowledge work• 3D Printing• Autonomous Vehicles

Potential for greater health and happiness, enhanced culture and community. There’s a gap in the social media landscape which to many is disconnecting people, not connecting them. Real time phone-phone Video is one shift that may change that.

30

The uptake of cloud computing is gaining pace. The uptake of cloud computing is gaining pace.

Although the communication between data centre and facilities personnel has much

improved over recent years, the development of cloud computing will place an

increased importance of these teams working together.

This presentation discusses how cloud computing impacts the data centre and

discusses some actions that can be taken to manage these challenges.

1

Although cloud uptake in the Asia Pacific region is not at the levels of some other

parts of the world, the rate of uptake is gaining pace.

Although cloud uptake in the Asia Pacific region is not at the levels of some other

parts of the world, the rate of uptake is gaining pace.

Cloud offers many opportunities to consolidate, reduce energy and provide flexibility

and scalability.

2

Cloud computing is implemented in different data centre environments as follows:Cloud computing is implemented in different data centre environments as follows:

Dedicated custom built mega-data centre

3

Co-location data centre with multiple tenants.Co-location data centre with multiple tenants.

Some tenants may be operating there own private cloud in the data centre

Some tenants may be providing public cloud services out of the data centre

4

Private cloud hosted in an owner occupier data centre.Private cloud hosted in an owner occupier data centre.

These data centres present their own challenges in the transition of conventional IT

infrastructure to a cloud based solution.

This talk focuses mainly on loads within co-location environments although the basic

concepts apply to each of the types of data centre environment.

5

Implementing cloud in an existing data centre is very different to implementing cloud

in a new environment (eg new co-location space)

Implementing cloud in an existing data centre is very different to implementing cloud

in a new environment (eg new co-location space)

This slide shows how these two implementations differ.

Where cloud is implemented in an existing data centre, due to reduced server count

and lower load due to the virtualised environment, infrastructure may now be over-

sized for the load and hence run very inefficiently.

In moving to a co-location environment, control of the power and cooling is with the

data centre operator. This change in operational environment is often one of the

causes of transitional difficulties. Processes have to be adapted to this new model

(particularly from a change management perspective)

6

This slide represents a stylised data centre environment.This slide represents a stylised data centre environment.

The white coloured racks indicate relatively low load with nominally a uniform power

density.

The examples used are provided for demonstration the points and in some cases

represent relatively extreme, yet realistic, cases.

7

Generally, cloud environments will lead to higher rack loads.Generally, cloud environments will lead to higher rack loads.

Red racks indicate higher IT loads.

8

As virtual servers can move across physical servers, the load has the potential to

move around the data centre

As virtual servers can move across physical servers, the load has the potential to

move around the data centre

9

The virtual servers can also move across physical servers in different data halls or

even different data centres.

The virtual servers can also move across physical servers in different data halls or

even different data centres.

10

Due to the ability of the virtual servers to move across physical servers, the load has

the potential to change quickly.

Due to the ability of the virtual servers to move across physical servers, the load has

the potential to change quickly.

11

Load can also grow quickly by public cloud provider winning new contracts.Load can also grow quickly by public cloud provider winning new contracts.

12

This slide summarises how these features of cloud can prove challenges to a data

centre operator.

This slide summarises how these features of cloud can prove challenges to a data

centre operator.

Co-location data centres are designed to average power densities with provision to

service higher loads – generally all scenarios of increased power densities cannot be

modeled prior to the tenant requirements being known.

Data centres are typically optimised around steady load growth. Although the cooling

solutions operate in a more dynamic way than previously, they cannot necessarily

adapt to large load changes whilst maintaining both resilience and energy efficiency

as effectively as many people believe.

Consider whay may happen in a “Cloud” Load growth – a server can be purchased

and installed in 1 week…. whereas if a new generator or UPS is required, the lead

time may be 6 months.

Data centres are designed for long lifecycles. Although flexibility and modularity is

normally built into data centres, some physically constraining factors are likely to

remain. Server refresh cycles are typically 3-5 years with software on even shorter

lifecycles. Hence IT technology changes much faster and the physical data centre

needs to support this.

13

Data centres are typically built for 1500-2000w/m2 average power densityData centres are typically built for 1500-2000w/m2 average power density

Typically no aisle containment is needed at the lower loads although containment will

improve energy efficiency.

Higher power densities (above the designed average power density) can be

supported in localised areas but all scenarios not necessarily modelled when data

centre was designed

Simple A + B distribution is used for the purposes of the examples.

14

If only the capacity allocated to that data hall were to be used, you could just space

the racks out.

If only the capacity allocated to that data hall were to be used, you could just space

the racks out.

This solution could potentially compromise any containment solution and may result

in sub-optimal energy efficiency.

Cooling solutions may also be able to support the higher power density in a

compressed space but power may not be available. In this case, part of the data hall

would be left un-occupied.

15

Spare capacity from other floors or overall spare capacity in the infrastructure could

be utilised.

Spare capacity from other floors or overall spare capacity in the infrastructure could

be utilised.

This would required some infrastructure to be sized for the increased average power

density from day one (such as chilled water pipework).

16

Utilising capacity from other floors may require additional plant space (eg

transformers if distribution is at HV , additional riser space, additional PDU and

Utilising capacity from other floors may require additional plant space (eg

transformers if distribution is at HV , additional riser space, additional PDU and

cooling unit space)

17

As power density increases in an area, different cooling solutions will need to be

implemented.

As power density increases in an area, different cooling solutions will need to be

implemented.

18

Planning of the infrastructure to scale to the maximum power density is vital.Planning of the infrastructure to scale to the maximum power density is vital.

Modelling the environment at different power densities based on the rack layout is

important.

Rack solutions and containment solutions will impact power densities that can be

supported

Environment neutral solutions with direct water cooling reduce load on air-based

cooling solutions.

Understanding the limitations of capacity is essential in business and infrastructure

planning

Performance testing prior to installation of real IT load is recommended to validate

modeling

19

This slide represents a typical data hall with some high density and some low density

racks.

This slide represents a typical data hall with some high density and some low density

racks.

The data hall is fed from four electrical distribution paths.

20

As load moves around the data centre the potential issues are as follows:As load moves around the data centre the potential issues are as follows:

The load control is no longer by physically switching distribution paths (ie the load

migration control has moved from the physical infrastructure to the IT space)

The area to which the load has moved could now be overloaded. Even if the PDUs in

that area are not over-loaded, distribution system A and B could be feeding other

data halls and their total capacity could be exceeded

The area from which the load has moved now has excess cooling and UPS capacity

and is likely to be operating less efficiently.

21

The supplies to racks are generally over-sized (upstream supply capacity is less that

distribution capacity) – ie distribution does not limit the load

The supplies to racks are generally over-sized (upstream supply capacity is less that

distribution capacity) – ie distribution does not limit the load

In this example, the load has migrated across the data centre, but with all distribution

paths operating, the load can still be supported.

However this load migration may cause the redundancy in the distribution system to

be lost such that the load swing caused by the failure of one PDU could mean that the

alternative distribution path would overload.

The load migration has in effect made the PDU a single point of failure without the

total load in the data centre being increased or any distribution paths being physically

switched.

22

A similar scenario can exist when reduced capacity is available due to maintenance

activities – this can be a particular issue when the IT environment is controlled by one

A similar scenario can exist when reduced capacity is available due to maintenance

activities – this can be a particular issue when the IT environment is controlled by one

group (the tenant), the infrastructure is controlled by another group (the co-location

provider), and the change management process (and the contract) is not set up to

cater for this eventuality.

If no link is in place between the IT environment and the infrastructure environment,

the load could be migrated onto part of the distribution system that does not have

the capacity to support it.

23

Whether energy efficiency is important may depend on contract conditions and

service levels (eg if a tenant is paying for power multiplied by a fixed PUE there is no

Whether energy efficiency is important may depend on contract conditions and

service levels (eg if a tenant is paying for power multiplied by a fixed PUE there is no

financial incentive to be energy efficient – although this may be a factor when

contracts are due to be renegotiated)

Load migration limitations can be applied to limit load swing.

Dynamic cooling solutions will maintain better energy efficiency but their

effectiveness will reduce for large load changes.

To maintain resilience, oversized infrastructure could be installed to deal with all

eventualities. This strategy however, would be very costly and would most likely

result in a less energy efficient solution.

The strategies that are more likely to be employed are:

• restricting load migration,

• implementation of DCIM solutions, and

• rigorous change management such that restrictions are placed on load migration

when infrastructure is not available.

The use of shared upstream infrastructure can also mitigate load migration issues

from an overall capacity perspective, but this needs to be carefully managed so as to

avoid single points of failure.

24

DCIM is a very large topic that will not be discussed in detail here.DCIM is a very large topic that will not be discussed in detail here.

The DCIM system is the link from the IT environment to the infrastructure.

The DCIM solution will need to have a link to the Virtual Machine Manager such that

load is not migrated into equipment that does not have capacity available.

Modeling of failure scenarios is available on some solutions but not yet in real time

(i.e. “what if “ scenarios)

25

It is not economical (or energy efficient) to provide the full data centre capacity at day

one.

It is not economical (or energy efficient) to provide the full data centre capacity at day

one.

The above model shows a typical installation designed with an allowance for future

additional power modules.

26

The IT load can scale in a very short time (weeks)The IT load can scale in a very short time (weeks)

The addition of another power module (if not pre-planned) is likely to take several

months.

The infrastructure then has the potential to restrict growth and flexibility.

27

The fully populated facility may look like this – but was it upgraded in time ?The fully populated facility may look like this – but was it upgraded in time ?

28

The potential to migrate virtual machines across physical machines means that it may

be more cost effective to migrate the IT load across sites rather than provide resilient

The potential to migrate virtual machines across physical machines means that it may

be more cost effective to migrate the IT load across sites rather than provide resilient

infrastructure in one site.

Taking this to the next level, some larger multi-site organisations are removing UPSs

and generators altogether.

Simple sites, designed for specific services, rolled out in a uniform way may provide

other options to reduce infrastructure or challenge the accepted ways of delivering a

data centre

31

we’re used to. To protect the planet, and your money (i.e ... · 15 years, that’s a lot of...

Documents

Transcript of we’re used to. To protect the planet, and your money (i.e ... · 15 years, that’s a lot of...