Energy and Digitalization: M.Sc. Sustainable Systems Engineering - Control and Integration of Grids
Energy and Digitalization: M.Sc. Sustainable Systems Engineering - Control and Integration of Grids
https://uptimeinstitute.com/tiers
E. Oró et al., „Energy efficiency and renewable energy integration in data centres. Strategies and modelling review “, link
• Modern server racks consume up to ~40 kW, single servers up to ~10 kW.
• Big data centers with >100‘000 servers consume more than 100 MW, even exceeding 1 GW of electrical power for the IT equipment.
• Most electricity is dissipated as heat and must be cooled away. The cooling equipment (fans, chillers etc.) contributes the most
important additional electrical consumer in addition to the IT equipment itself.
• Additional power requirements due to lighting, backup power supply, UPS etc.
• Power usage effectiveness (PUE): most common ratio to describe the efficiency of a data center
Power usage effectiveness PUE: ratio of the total amount of energy used by a data center to the energy delivered to computing equipment
(Note: Sometimes power instead of energy is used. In most cases, only an average PUE over a relevant time scale is useful.)
PUE rating
1.0 ideal, but hypothetical
<1.2 very efficient
1.2 – 1.5 efficient
1.5 – 2.0 average
2.0 – 2.5 inefficient
>2.5 very inefficient
Global average PUE Average PUE for all Google data centers
A. Lawrence (Uptime Institute), „Data center PUEs flat since 2013“, link Google Rechenzentren, „Effizienz“, link
Current world record (according to my knowledge): Cloud&Heat data center in Frankfurt with a PUE of 1.014 (link)
~40 kW rack
~67 kW rack
eventually unfeasible
• This limit is somewhere between a 30 – 50 kW server rack.
• Liquid cooling with (typically) water
– Direct-water cooling (DWC) of active server components
allowing for water inlet temperatures of up to 50°C
➔ PUE ~ 1.1 ASHRAE Technical Committee 9.9, „Water-Cooled Servers – Common
Designs, Components, and Processes“, link
– Indirect water cooling with rear-door heat exchanger (RDHX)
and cooling of the servers with air
➔ PUE ~ 1.3
• Active research:
– Microchannel cooling in the chip die
– Two-phase cooling
– Transforming heat with adsorption chillers
electricity
Notes:
• For low-temperature heating networks („anergy grids“), a central heat pump for raising the temperature of the waste heat is not required.
• Cooling of the data center may also be achieved if the district heating networks provides for a cooling line as well.
PUE in a first approximation when waste heat is reused with a heat pump:
Typical COP = 2 – 7 for heat pumps in such an application: E.g. COP = 4 ➔ PUE > 1.25
Better metric: Energy reuse effectiveness
Even a perfect PUE = 1 does not consider that the waste heat is dissipated into the environment – or even reused.
• ERE is an alternative metric, designed for that purpose.
• ERE = 0: all the dissipated energy is reused ➔ even for a bad PUE, an ERE = 0 is possible
• ERE = PUE: no energy is reused
➔ Pilot cases demonstrate profitability Configuration for a waste heat recovery system for a remote air-
cooled data center, which utilizes waste heat in DH.
➔ No standard/established business models From: M. Wahlroos et al., „Future views on waste heat utilization
– Case of data centers in Northern Europe“, link
• Only limited experience, modelling/simulations not straightforward Underground seasonal heat storage
• Case-by-case analysis Central energy plants
• Maybe an essential building block for the energy transition, in with heat pumps
particular in colder countries Anergy network Friesenberg of the Family Cooperation Zurich, Switzerland: “Using waste heat from
data centers for heating an existing neighborhood throughout an anergy network and heat pumps”, link
More information in German: link
Since operating costs of data centers are mostly electricity costs, operators are strongly incentivized to
• Use lowest-cost electricity → more and more renewables
• Increase efficiency (e.g. of cooling) → moving to cold climates, e.g. Scandinavia, to increase the hours with free cooling
• Explore DR methods
• However, this strongly depends on the business model of the data center operator:
– Hyperscalers (Google, Amazon, Microsoft…) are trailblazers because they operate the data centers for their purpose.
– Co-location data center operators must be more conservative (no liquid cooling or DR methods initially).
The possibilities of DR with data centers are quite obvious; however, implementations are rare:
• Academic studies with proof-of-concepts demonstrators on server level
• Some pioneering hyperscalers (e.g. Google) implement first pilots only very recently (Google‘s blog entry dates back to April 22, 2020)
• Potential of DR with data centers has not been quantified yet in demonstrations and/or not published
• Business model unclear for co-location data center operators
• Data centers constitute a (rather new) electricity-intensive industry and with potentially sharp rising electricity consumption requirements.
• Moore’s law and Dennard scaling led to tremendous increases in energy efficiency.
• (High) electricity consumption is mainly and fundamentally due to the physics of the semiconductor building blocks (e.g. transistors) and to the
computing architecture (i.e. von-Neumann architecture) as well as algorithmic requirements.
• Almost all energy in a data center is dissipated as low-grade heat
• Efficient cooling is, thus, key: air cooling with containment aisles, free cooling, and liquid cooling (in particular for hyperscalers)
• The next step is to embed the data center into the wider energy system:
– Sector coupling by reusing waste heat
– Integration of renewable generation
– Demand response
– Hyperscalers are trailblazers in these fields because their OPEX is mainly determined by electricity costs and they own and operate the data
centers (in contrast to co-location data centers)
– All these are rather new developments (<10 years) and many questions are still open:
• Business models
• Quantification of benefits of DR/integration into DHN etc.
• More generally: will data centers/ICT industry pose an underestimated risk to a successful energy transition?
• What is the data center energy/electricity consumption globally/in Europe/in Germany? How will this develop?
– Strongly diverging predictions
– Bottom-up model for prediction is required, not just extrapolation of historic data
– Benchmarking with existing data center operators
• Quantification of demand-response potential of a data center and development of business models
• Development of EMS/DR software for data centers
• Business-model analysis for reuse of waste heat of data centers: low- vs. high-T district heating networks
• Sizing of H2-electrolyzers/fuell cells and (on-site) renewable generation for reliable data-center operation
Questions?
Proposals?
Feedback?
J. Niemann et al., „ Hot-Aisle vs. Cold-Aisle Containment for Data Centers, White Paper 135“, link