Grid Heating Managing Thermal Loads with Condor
description
Transcript of Grid Heating Managing Thermal Loads with Condor
![Page 1: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/1.jpg)
Grid HeatingManaging Thermal Loads with Condor
Paul Brenner
University of Notre DameCenter for Research Computing
![Page 2: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/2.jpg)
Motivation• Utility costs for US Servers to grow from
4.5 billion in 2006 to 7.4 billion in 2011
2Ref: US EPA 2007
![Page 3: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/3.jpg)
Motivation• Power Requirements in Context
Typical AMD/Intel CPU 60-120 W1U Server 300 WAir Cooled Comp Rack 5-25 kWWater Cooled Comp Rack 25-50 kWCRC load at Union Station 150 kWND Data Center load 250 kWNCSA PetaScale Facility 25 MWMicrosoft Facility (Unpublished) 125 MW7.4 Billion Dollars in 2011 11.4 GW
![Page 4: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/4.jpg)
Challenges
local distribution lines
to the building, 480 V
HVAC system
lights, office space, etc.
UPS PDU computer racks
backup diesel generators
Electricity Flows in Data CentersElectricity Flows in Data Centers
computerequipment
uninterruptible
load
UPS = Uninterruptible Power Supply
PDU = Power Distribution Unit;
Ref: William Tschudi LBNL
![Page 5: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/5.jpg)
Challenges
Ref: Michael Patterson, Intel Corporation & William Tschudi LBNL
![Page 6: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/6.jpg)
Challenges• Key operational considerations
– Physical• Temperature• Humidity• Particulate
– Practical• Security• Bandwidth• Reliability/Redundancy/Disaster Recovery• Access• Acoustics
![Page 7: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/7.jpg)
A New Framework• Grid Heating
– Design and deploy the IT infrastructure in correlation with target industrial and municipal heat sinks
– Reduce or remove operational and capital IT cooling costs
– Provide thermal benefit to industrial/municipal partner at a shared economic savings
– Direct environmental through reduction in thermal waste
![Page 8: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/8.jpg)
Deployment• Must address operational IT considerations
– Physical• Temperature, Humidity, Particulate
– Practical• Security, Bandwidth, Access, Acoustics• Reliability/Redundancy/Disaster Recovery
• Utilization relative to hardware capital costs– 365 x 24 designs preferred– Select granularity of grid distribution accordingly
![Page 9: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/9.jpg)
Two Example Models• High Granularity Grid Heating Appliances
• Coarse GranularityGrid Heating Clusters
![Page 10: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/10.jpg)
Experimental Results• Fine Grained Temperature Control
![Page 11: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/11.jpg)
Experimental Results
# Grid Heating machine config template
CLUSTER_ADMIN_MACHINES = normalmodes.cse.nd.edu
MachineOwnerUnquoted = pbrenne1MachineGroupUnquoted = crcMachinePreferredUsers = "pbrenne1"
Temperature=curTemp
START=(Owner=="pbrenne1") && ($(Temperature)<startTemp)SUSPEND=($(Temperature)>targTemp)CONTINUE=($(Temperature)<targTemp) && ($(ActivityTimer)>60)PREEMPT=($(Temperature)>maxTemp)
MaxSuspendTime= 3600
![Page 12: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/12.jpg)
Experimental Results• GHC and GHA in the South Bend Greenhouse
and Botanical Garden (SBG)– SBG struggles to retain sufficient funding. Annual
heating costs are a primary factor (over 100K in 2005 & 2006, forced closure of some sections in 2007).
![Page 13: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/13.jpg)
![Page 14: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/14.jpg)
Greenhouse Factors (Physical)• Temperature
– Louvered Outside Air Vents and Exhaust Fan
• Humidity– Existing Steam Humidification for Plants
• Particulate– Under Investigation
![Page 15: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/15.jpg)
Temperature and Humidity
ASHRAE Allowable Maximum
ASHRAE Allowable Minimum
ASHRAE Recommended Maximum
ASHRAE Recommended Minimum
ASHRAE TEMPERATURE GUIDELINES
40
50
60
70
80
90
100
Deg
rees
F
ASHRAE Allowable Maximum
ASHRAE Allowable Minimum
ASHRAE Recommended Maximum
ASHRAE Recommended Minimum
ASHRAE HUMIDITY GUIDELINES
0
10
20
30
40
50
60
70
80
90
100
% R
elat
ive
Hum
idity
ASHRAE Allowable Maximum
ASHRAE Allowable Minimum
ASHRAE Recommended Maximum
ASHRAE Recommended Minimum
Ref: ASHRAE & William Tschudi LBNL
![Page 16: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/16.jpg)
ParticulateOutdoor MeasurmentsFine Particulate Matter
0
20
40
60
80
100
120
140
160
12:00PM
6:00PM
12:00AM
6:00AM
12:00PM
6:00PM
12:00AM
6:00AM
12:00PM
6:00PM
12:00AM
6:00AM
12:00PM
6:00PM
12:00AM
6:00AM
12:00PM
6:00PM
12:00AM
Part
icle
Con
c. (
mg/
m3 ) LBNL
NERSC
Center 3
Center 4
Center 5
Center 6
Center 7
Center 8
IBM Standard
EPA Annual Health Standard
EPA 24-Hour Health Standard
and ASHRAE Standard
Ref: William Tschudi LBNL
![Page 17: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/17.jpg)
Greenhouse Factors (Practical)• Security
– Public facility open daily– Monitored/Paid admission– Hardware locked in compute rack– Power and network cable into rack, exposed
• Network– Cyberlink wireless broadband 4-15MB– Ownership… VPN in hindsight– Security
• Firewalls everywhere: clients, routers, servers
![Page 18: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/18.jpg)
Greenhouse Factors (Practical)• Reliability/Redundancy/Disaster Recovery
– SPF secured against accidental interruption– Need power backup (battery)– Susceptible to public vandalism– Provides decentralized of resources for DR
• Access– 10min drive from CRC offices (~distance to US)
• Acoustics– Significant echo in the dome. Sustained white noise
is not magnified.
![Page 19: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/19.jpg)
Phase 1 Complete
![Page 20: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/20.jpg)
Phase 1 Complete
![Page 21: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/21.jpg)
Grid Heating Appliance• No data persistence
– Transmit, compute, transmit, forget– Appliance OS in ‘Firmware’
• Rugged– Minimal components: No hard drive
• Mobile– Wireless networking
• Invisible– Small and Quiet (Special fan/heat sink)
![Page 22: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/22.jpg)
Grid Heating Appliance
![Page 23: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/23.jpg)
Acknowledgements• City of South Bend
– Steve Luecke (Mayor), Tom LaFountain, Gary Gilot, Bob Monroe
• ND Center for Research Computing– Dewitt Latimer, Rich Sudlow
• ND Dept of Computer Science and Engineering– Doug Thain (CCL)– Jesus Izaguirre & Christopher Sweet (LCLS)– Curt Freeland– Mike Kelly and Mike Lammie (ND CSE Undergrads)
![Page 24: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/24.jpg)
Questions?
![Page 25: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/25.jpg)
Energy Conversions• Power and Energy
– 1 kWh = 3.6 Megajoules– 1 Therm (100,000 BTU) = 105.5 Megajoules– 1 Therm = 29.3 kWh
• What does it cost?– $0.086 /kWh (US DOE EIA commercial)– $0.013 /cubic ft ~ $ 1.30 /therm
• Resolve Unit Cost into MJ– $23.89 /1000 MJ (electric)– $12.32 /1000 MJ (natural gas)
![Page 26: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/26.jpg)
Energy At The Greenhouse• Annual heating costs are a primary factor
– over 100K in 2005 & 2006, closed some buildings in 2007 due to heating costs
• Strong seasonal dependence– 18,000 therm natural gas load in Jan 08
• 527,400 kWHr → 732.5 kW Max Seasonal Load• Not practical to size for maximum load• Select optimal baseline, supplement with nat gas
– Desert Dome ~8% of sqft → 59 kW
![Page 27: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/27.jpg)
Related Work (Data Centers)• Lawrence Berkeley National Lab– High-Performance Buildings for High-Tech Industries– http://hightech.lbl.gov
• NCSA– Building the Data Center of the Future, 2008 Symposium
• Uptime Institute– Green Enterprise Computing, 2008 Symposium
• ASHRAE TC 9.9– Mission Critical Facilities, Technology Spaces & Electronic Equip
• Green Grid– Global consortium to advance energy efficiency in data centers
![Page 28: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/28.jpg)
28
References • US EPA Tech Report 109-431
– Report to congress on server and data center energy efficiency
• 24x7 Energy Efficiency Presentation– William Tschudi Lawrence Berkley Nat Lab
• ASHRAE TC9.9– Thermal Guidelines for Data Processing Equipment
• Condor High Throughput Computing– www.cs.wisc.edu/condor
![Page 29: Grid Heating Managing Thermal Loads with Condor](https://reader035.fdocuments.us/reader035/viewer/2022062315/56815d68550346895dcb71d7/html5/thumbnails/29.jpg)
Related Work (Grid Arch)