Cold Air Containment Green Networking Workshop at SIGCOMM 2011 - PowerPoint PPT Presentation

Cold Air Containment Green Networking Workshop at SIGCOMM 2011 Friday, August 19th, 2011 Mikko Pervilä and Jussi Kangasharju www.helsinki.fi/yliopisto

Reseach goals 1) Reduce cooling requirements (this talk) 1) A/C performance 2) Chilling plant performance 2) Produce cooling for free (GreenNet 2010) 3) Harvest exhaust heat (future work) ...With minimal rebuilding = cheaply Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 2

72% source: Urs Hoelzle, European DC Summit 2011 * source: GeSI/The Climate Group: SMART 2020 ** source: NRDC Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 3

Materials: Steel and plastics source: Joe Kava, European DC Summit 2011 Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 4

Cold Air Containment VanGilder's patent filed in 2005: ● Cold Aisle Isolation ● HP's white paper: ● Hilss and Iyer, Improved data center efficiency — ● incorporating air stream containment, 2009 (URL) Emulation-based, details omitted ● 14% to 41% “efficiency improvements” ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 5

Mixed air flows Raised floor CRAC Rack Rack Side view Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 6

Separate air flows CRAC Rack Rack Plastic wrap Side view Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 7

Case: CERN “Flagship” installation ● Video from visitor area of CERN's DC ● http://www.youtube.com/watch?v=x5rmtSpuSGA ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 8

Just buy it? Too much rebuilding ● New racks, reinstall everything ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 9

Just build a CFD? Computational Fluid Dynamics model ● Complex = expensive ● Google's modelling several (4+) iterations ● Cost: 5-10 k$ ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 10

Real implementation Our costs 120.65 € in total: ● Plastic covers 29.50 € ● PVC tubes 37.14 € ● Duct tape 54.01 € ● Built in 3 hrs by ● three persons Some corners ● were cut Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 11

Before changes Typical DC evolution → Inefficient placement? Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 12

Computer Room A/C (CRAC) Engineering solution: add more power Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 13

Chilling plant And more chilling plants. Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 14

Two chilling plants Dedicated chilling plant Shared chilling plant Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 15

CRAC CS Dept. HIIT CRAC Data Center BK117 CRAC storage Ukko CRAC CRAC Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 16

Power draws 75 kW max power draw of Ukko cluster ● 55 kW cooling equipment installed in 2010 ● 6,9 kW of Computer Room A/C (CRAC) units ● 44,7 kW chilling plant ● 3,8 kW rooftop radiator ● IT + CRAC load ● 85 kW typical ● 115 kW sustained peaks ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 17

Week before 26.3.2011 1 hour Total Ukko cluster Storage, HIIT, CRAC, UPS CS Dept. Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 18

Rising ambient temperature Inlet temperatures from one host Absolute values suspect, relative change correct Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 19

Finished installation ﾧ after_CAC_installation.mp4 http://www.youtube.com/watch?v=jZIuJIVYsDs Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 20

Effects on Ukko Two 16 h periods before and after ● Before: 7 hrs normal, 9 hrs peak load ● After: 9 hrs peak, 7 hrs normal load ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 21

Less cooling needed Same time periods as before ● Two CRAC:s kept on same set point ● Two CRAC:s adjusted up by 7 C ● One CRAC shut off completely! ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 22

But power... Total Ukko cluster Storage, HIIT, CRAC, UPS 2 kW drop CS Dept. Real savings at the chilling plant(s)? Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 23

Cooling fluid measurements Set point raised by 7 °C Set point unchanged Cooling fluid measured here. Valves (W, S) Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 24

Before change, valve W Periodic drops of temperature Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 25

After change, valve W Almost stable temperature Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 26

Before change, valve S Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 27

After change, valve S Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 28

Pressure differences Inefficient placement ● strikes back Less aisles is better ● sock_video.mp4 ● YouTube link ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 29

“Finalized” version Switch to hard plastic sheets (video) ● http://www.youtube.com/watch?v=8-uybY91f4o ● Extra cost: ~260 € ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 30

Reseach goals 1) Reduce cooling requirements (this talk) 2) Produce cooling for free (GreenNet 2010) 3) Harvest exhaust heat (?) ...With minimal rebuilding = cheaply Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 31

Last year at GreenNet Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 32

Helsinki Chamber (HC) - rack servers - much more heat - improved air flow - more reflective + CAC prototype! Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 33

…And then we built that Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 34

Summary Cold Air Containment optimizes cooling ● Can now install 20% more load ● A/C can take it ● Chilling plants can take it(?) ● Tent and HC demonstrate free cooling ● Next project: Harvesting exhaust heat ● Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 35

Questions? Pictures by Janne Ahvo ● Clear plastics are safe! Tuomas ● Puikkonen Sebastian ● Siikavirta Thanks! Mikko Pervilä & Jussi Kangasharju www.helsinki.fi/yliopisto 18.8.2011 36