Data Center Power Infrastructure - Basic File
Data Center Power Infrastructure - Basic File
Disclaimer:
This document is based on publicly available information from multiple sources and is intended for
educational purposes. While every effort has been made to ensure accuracy, errors are possible.
Readers are encouraged to verify details with official standards and guidelines. The purpose of this
document is to share knowledge and promote a better understanding of the subject matter.
I|Page
Contents
Data Center Power Infrastructure ...................................................................................................................... 1
1.0 Electrical Power System Overview ............................................................................................................ 1
1.1 From Generation to Data Center .......................................................................................................... 1
1.2 Increasing Energy Demands of Data Centers ......................................................................................... 2
2.0 Data Center Rating Levels Overview ......................................................................................................... 3
2.1 Definitions of ‘N’ in Data Center ........................................................................................................... 3
2.2 Rating Levels Overview ......................................................................................................................... 3
3.0 Power Redundancy Strategies for Data Centers ........................................................................................ 4
3.1 Rated-1 Data Center: General Power System Designs ........................................................................... 4
3.2 Rated-2 Data Center: General Power System Designs ........................................................................... 5
3.3 Rated-3 Data Center: General Power System Designs ........................................................................... 6
3.4 Rated-4 Data Center: General Power System Designs ........................................................................... 7
3.5 Substations and Power Feed Requirements .......................................................................................... 8
3.6 Choosing the Appropriate Rating Level ................................................................................................. 8
3.7 New Approaches to Redundancy and Rating ........................................................................................ 9
3.8 Redundancy Level Design and Risk Management ................................................................................. 9
4.0 Backup Power System: UPS .................................................................................................................... 10
4.1 UPS Types: Dynamic UPS vs. Static UPS .............................................................................................. 10
4.2 Types of Static UPS System ................................................................................................................. 12
4.3 UPS Modes VFI ................................................................................................................................... 14
4.4 UPS Parallel Configurations ................................................................................................................ 15
4.5 UPS Energy-Efficiency & Green Options .............................................................................................. 18
5.0 Backup Power System: Batteries ............................................................................................................. 19
5.1 Battery Types for UPS ......................................................................................................................... 19
5.2 Battery Design Criteria........................................................................................................................ 20
5.3 Battery Bank Calculation..................................................................................................................... 22
5.4 Battery Charging Methods and Management ..................................................................................... 24
5.5 Battery Configuration and Paralleling ................................................................................................. 25
5.6 Battery Maintenance and Monitoring ................................................................................................. 26
5.7 Battery Safety and Compliance ........................................................................................................... 26
6.0 Backup Power System: Generator........................................................................................................... 27
II | P a g e
6.1 Importance of Generators in Data Centers.......................................................................................... 27
6.2 Types of Generators Used in Data Centers .......................................................................................... 27
6.3 Generator Principles and Components ............................................................................................... 28
6.4 Generator Redundancy ...................................................................................................................... 29
6.5 Generator Paralleling and Synchronization ......................................................................................... 29
6.6 Generator Room Requirements .......................................................................................................... 30
6.7 Generator Sizing ................................................................................................................................. 31
6.8 Generator Principles and Compliance ................................................................................................. 31
6.9 Generator Principles and Practices ..................................................................................................... 31
6.10 Generator Monitoring and IoT Integration ........................................................................................ 31
6.11 Automatic Transfer Switch (ATS) ....................................................................................................... 32
6.12 Static Transfer Switch (STS) ............................................................................................................... 33
7.0 Power Redundancy Strategies for the Rack............................................................................................. 34
7.1 Common Techniques for Power Availability ........................................................................................ 34
8.0 Power Distribution Within the Data Center ............................................................................................ 36
8.1 Standard Cabling vs. Busbar Trunking (BBT) ........................................................................................ 36
8.2 Three-Phase / Single-Phase Usage ...................................................................................................... 38
8.3 Cable Distribution Methods ................................................................................................................ 38
8.4 Grounding in the Data Center ............................................................................................................. 39
9.0 Power Distribution: PDU & DB ................................................................................................................ 40
9.1 Isolation Transformer ......................................................................................................................... 41
9.2 Bonding of Natural & Ground ............................................................................................................. 41
9.3 Data Center Power Distribution .......................................................................................................... 42
9.4 Form Factors ...................................................................................................................................... 43
10.0 Power Supply Quality ........................................................................................................................... 44
Power Quality Standards (EN 50160) ........................................................................................................ 44
Common Mode Noise (CMN) ................................................................................................................... 44
10.1 Harmonics ........................................................................................................................................ 45
10.2 CBEMA / ITI© Curves ....................................................................................................................... 46
11.0 Protection Devices ............................................................................................................................... 47
11.1 Basic Single-Line Diagram ................................................................................................................. 47
11.2 Protection Devices in Power Systems................................................................................................ 47
III | P a g e
11.3 Over-current Protection Devices ....................................................................................................... 48
11.4 Residual Current/Earth Leakage Protection ...................................................................................... 51
11.5 Sizing of Breaking Components ........................................................................................................ 52
11.6 Surge Protection ............................................................................................................................... 53
12.0 Electromagnetic Fields (EMF) ............................................................................................................... 55
12.1 Common Sources of EMF in Data Centers ......................................................................................... 55
12.2 EMF Effects on Data Center Components ......................................................................................... 55
12.3 Best Practices for EMF Mitigation in Data Centers ............................................................................ 56
12.4 EMF Compliance and Measurement Standards ................................................................................ 56
12.5 EMF Shielding Performance & Attenuation ....................................................................................... 57
13.0 General Power Knowledge in Data Centers ........................................................................................... 58
13.1 Real Power vs. Apparent Power ........................................................................................................ 58
13.2 Labeled vs. Actual Power Consumption ............................................................................................ 58
13.3 Data Center Power Density Guidelines ............................................................................................. 58
13.4 Light ................................................................................................................................................. 59
13.5 Thermographic scanning .................................................................................................................. 62
14.0 Data Center Power Efficiency ................................................................................................................ 63
14.1 Power Usage Effectiveness (PUE) ...................................................................................................... 63
14.2 Factors Influencing PUE .................................................................................................................... 63
14.3 Understanding PUE Values ............................................................................................................... 64
14.4 Issues with PUE ................................................................................................................................ 64
14.5 PUE Measurement Classes by The Green Grid .................................................................................. 64
14.6 Additional PUE Considerations ......................................................................................................... 65
14.7 Mixed-Source Environments ............................................................................................................. 65
14.8 Additional Metrics for Measuring Sustainability ............................................................................... 65
IV | P a g e
"Mastering data center power infrastructure is not a destination but a journey —
the more you learn, the stronger your foundation becomes."
V|Page
Data Center Power Infrastructure
1.0 Electrical Power System Overview
1.1 From Generation to Data Center
Ensuring a reliable and high-quality power supply is critical for data center operations. The power journey
begins at the generation source and follows a structured path through multiple stages before reaching IT
equipment. Below is a breakdown of this journey:
1. Power Generation
Electricity is generated from various sources, including:
• Primary Power Feed: The data center receives power from the utility grid at medium voltage.
• Step-Down Transformers: Reduce medium voltage to low voltage levels required for IT and facility
loads (typically 400V Three Phase / 240V Single Phase).
5. Backup Power System & Redundancy
• Uninterruptible Power Supply (UPS): Battery-based systems that provide temporary power during
short outages or switching delays.
Additionally, several pieces of equipment, such as ATS, STS, and batteries, support power backup and
redundancy. We will explore each of these in detail in the following chapters.
1|Page
1.2 Increasing Energy Demands of Data Centers
Data center power consumption has been rising significantly, driven by increasingly power-intensive IT
equipment and the rapid expansion of artificial intelligence (AI) technologies. This surge in energy demand has
led to overloading in many facilities, accompanied by increased heat loads that pose substantial cooling
challenges.
• Higher transistor density and faster clock speeds increase power consumption, leading to greater heat
dissipation.
• Power consumption in data centers is projected to double approximately every four years.
• Higher equipment density due to more compact hardware designs results in increased power demand
per square meter.
• Rising heat loads and greater Delta-T intensify cooling challenges, requiring more efficient thermal
management solutions.
2|Page
2.0 Data Center Rating Levels Overview
The Data Center Rating Levels, defined by the TIA-942 standard, classify data centers based on their
infrastructure reliability. These levels range from basic systems with single paths to fault-tolerant setups with
full redundancy, ensuring minimal downtime. This chapter will explain each rating level in detail.
N+1 Redundancy means there is one extra unit, module, path, or system beyond the minimum required for
normal operation. This ensures that if any single component fails or needs maintenance, the system can
continue running without disruption.
2N Redundancy means that the system has two fully independent units, modules, paths, or systems for every
essential component of the base system. This ensures that if one unit fails or needs maintenance, the other
can take over without disrupting operations.
2(N+1) Redundancy means that there are two fully independent units, modules, paths, or systems, each with
an extra unit (the "+1"). Even if one unit fails or needs maintenance, the additional capacity ensures that
redundancy is maintained, and operations continue without disruption.
3|Page
3.0 Power Redundancy Strategies for Data Centers
3.1 Rated-1 Data Center: General Power System Designs
A Rated-1 data center features a single power distribution path with no redundancy, making it vulnerable to
multiple points of failure and human errors. Power is supplied from the national grid through a transformer. To
ensure continuity during a grid failure, a standby generator is in place, remaining off under normal conditions.
If the grid fails, a sensing circuit detects the outage and automatically starts the generator to restore power.
Both power sources—grid and generator—are routed through an Automatic Transfer Switch (ATS), which
seamlessly switches between them to maintain power availability. However, since there is only one UPS
serving the IT load, any maintenance or failure requires a complete shutdown.
Key Characteristics:
• Power switching: Grid and generator operate through an ATS for automatic transition.
• Use case: Suitable for small enterprises with internal server rooms that have a low criticality index.
4|Page
3.2 Rated-2 Data Center: General Power System Designs
A Rated-2 data center improves power uptime by introducing redundancy for critical components like UPS and
generators. However, it still has multiple points of failure and remains susceptible to human errors.
To enhance reliability, two UPS systems are deployed in a parallel redundant mode, operating concurrently,
and sharing 50% of the load. If one UPS system fails or is taken out of service for maintenance, the other
seamlessly takes over 100% of the load, ensuring continuous power protection. Similarly, generators are
connected to the same bus, each sharing 50% of the load and providing backup power in case of a grid failure.
Key Characteristics:
• Partial redundancy: UPS and generators operate in parallel, allowing for seamless load transfer in case
of failure.
• Availability: 99.75% uptime, allowing for 22 hours of downtime per year.
• Maintenance schedule: Three planned shutdowns every three years, each lasting 12 hours.
• Use case: Suitable for small to medium-sized enterprises requiring improved reliability.
5|Page
3.3 Rated-3 Data Center: General Power System Designs
A Rated-3 data center provides full redundancy for all power components, including UPS, generators, and
distribution paths. In case of a failure in the main distribution path, an alternate path ensures uninterrupted
power to the IT load, minimizing single points of failure (SPoF).
To further enhance resilience, a Tier III data center can incorporate two independent power feeds from the
national grid. However, not all IT systems are designed with dual power supplies. For such systems, a Static
Transfer Switch (STS) can be deployed, automatically switching between the primary and backup power
sources when needed, similar to an Automatic Transfer Switch (ATS).
Key Characteristics:
• Full redundancy: UPS, generators, and distribution paths ensure high availability.
• Concurrent maintenance: Two independent distribution paths allow maintenance without downtime.
• Power distribution:
o Critical mechanical loads (e.g., drain pumps, fans) are backed by UPS for continuous operation.
• Static Transfer Switch (STS): Ensures seamless switching for IT systems with a single power supply,
preventing disruptions.
6|Page
3.4 Rated-4 Data Center: General Power System Designs
A Rated-4 data center features the most robust power distribution design, ensuring the highest uptime of
99.99%, with a maximum of 48 minutes of downtime per year. It is designed for full fault tolerance, eliminating
single points of failure (SPoF) by incorporating complete redundancy across generators, grids, and distribution
paths.
In this setup, two independent power feeds (Feed A and Feed B) remain active at all times, supplying power
simultaneously. Under normal conditions, IT equipment in the computer room draws power from both feeds
concurrently, ensuring continuous power availability. This architecture enhances resilience, making the data
center capable of withstanding faults, human errors, and fire incidents without impacting operations.
Key Characteristics:
• Full fault tolerance: Generators, grids, and distribution paths are fully redundant, eliminating SPoF.
• Simultaneous power feeds: IT equipment receives power from both Feed A and Feed B under normal
operation.
• Concurrent maintainability: Supports maintenance and repairs without service disruption.
• Availability: 99.99% uptime, with a maximum of 48 minutes of downtime per year.
• High cost: The extensive redundancy increases construction and operational expenses
7|Page
3.5 Substations and Power Feed Requirements
1. Power Feed Redundancy Ratings
• Rated-3: Allows a single substation to supply both the active and passive power paths to the data center.
• Rated-4: Requires two separate active power feeds, each coming from different substations.
o Note: Onsite generation can be considered as a replacement for one of the substations in Rated-4
configurations.
• Separate Routing: Power feeds must follow distinct paths (e.g., using separate trenches for each feed is
essential). A single trench for both is not acceptable.
• Building Entry: Feeds should enter different parts of the data center building to further ensure
redundancy.
• No Requirement for Multiple Power Companies: ANSI/TIA-942 does not mandate using multiple power
companies for data center power feeds.
• Cost of Downtime: Consider the revenue lost per hour and the annual operational hours (8760 hours in a
year).
• Risk Tolerance: Assess the acceptable level of risk for business continuity.
• Budget: The available budget will influence the level of redundancy and rating that can be realistically
achieved.
o Some organizations may not be able to fully meet the desired rating level due to budget
constraints. In such cases, compromises may be necessary.
• For TIA-942 compliance, it's possible to target different rating levels for different categories. For
example, Rating-2 for architectural elements and Rating-3 for other infrastructure components.
However, the overall data center rating will be based on the lowest rating level across all categories.
8|Page
3.7 New Approaches to Redundancy and Rating
ICT Layer Redundancy
• Modern Technologies: Advances in ICT (Information and Communication Technology) have made it
possible to achieve high redundancy at the ICT layer rather than at the physical facilities layer.
o Example: Mirroring systems, applications, databases, and storage between two Rated-2 data
centers can provide a Rated-4 level of availability from the end-user perspective.
• Lower Physical Layer Ratings: Some containerized and virtualized solutions may have lower ratings at
the physical (facilities) layer but can achieve high redundancy and availability at the ICT layer, meeting
or exceeding higher rating standards from a functional perspective.
• Rating Levels and Availability: While rating levels are important, they do not guarantee high
availability on their own. The performance and uptime of a data center depend significantly on how
it is maintained and operated.
• Operational Processes: Well-defined operational processes, continuous skills development, and
regular maintenance are essential for ensuring high availability in the data center.
To minimize the risk of IT system failure and breakdown, focus on the following key areas:
• Avoiding Human Error: Implement systems and processes that reduce the likelihood of human mistakes.
• Maximizing Maintenance: Invest in proactive and regular maintenance to keep systems in optimal
working condition and prevent unexpected failures.
9|Page
4.0 Backup Power System: UPS
Uninterruptible Power Supplies (UPS) are crucial in data centers for ensuring continuous, stable power. UPS systems
protect against power outages, surges, and other disruptions that could cause downtime and loss of data.
• Power flows through the UPS, and the alternator maintains stable frequency and voltage at the output.
• The diesel engine continuously drives the alternator to supply consistent power to the load.
• The diesel engine is monitored and digitally controlled to maintain stable output voltage and frequency.
• After a few minutes of operation, the diesel engine cools down and then return to standby mode.
10 | P a g e
Static UPS Systems
• Composed of electronic components such as rectifiers, inverters, control logic, and batteries.
Key Features:
• Offline UPS
• Other types include Delta Conversion, Hybrids, High-frequency transformer-less, Eco/smart mode UPS, and
Compressed Air systems.
• VFI-Class (Voltage & Frequency Independent) – True Online Double Conversion UPS
Note:
• Only VFI-class UPS systems are ideal for mission-critical data centers.
• "V" stands for Voltage, "F" stands for Frequency, "D" means Dependent, and "I" means Independent.
11 | P a g e
4.2 Types of Static UPS System
1. Offline / Standby UPS (VFD) Desktop Level
Overview:
Cons:
Overview:
Pros: Cheap
Cons:
12 | P a g e
3. True Online Double Conversion (VFI) Data Center
Overview:
• The only suitable option for mission-critical facilities, such as data centers.
• Provides continuous power without interruption, even when internal issues like high temperature or overload
occur.
• In case of a problem inside the UPS, the microprocessor activates the static bypass to protect the UPS
electronics, ensuring no disruption to the load.
• When in bypass mode, raw utility power is supplied to the load, which is not ideal but ensures availability until
the issue is resolved.
• The maintenance bypass, activated by service personnel, allows power to bypass the UPS for service and repair.
Pros:
• Isolates Load from Input AC: Completely isolates the load from incoming utility power.
• Rectifies Input AC: Converts incoming AC power to DC, providing better regulation.
• True Sine Wave Output: Generates a true sine wave output via the inverter, ideal for sensitive equipment.
• Always Full Load on Inverter: Designed to maintain a full load on the inverter, ensuring efficient operation.
• Long Runtime Capability: Designed to support long runtimes, making it reliable during extended power outages.
• Regulated & Isolated Voltage & Frequency: Provides regulated and isolated power to the load, ensuring stability.
• Synchronizes to Input Phase: The system synchronizes with the input phase when online, ensuring smooth
operation.
• Bypass Functionality: Includes both static and maintenance bypass options for flexibility in operation.
• Redundant Power Input: In most cases, the bypass/reserve power line input is connected to the same source as
the main input. (Rated 3-4 units may require a separate input for redundancy).
Cons: More Expensive: Higher cost due to the complexity and reliability required for mission-critical applications.
VFD VI VFI
Grid problem
Off-line UPS Line Interactive UPS On-line UPS
Surge Indefensibility Limited defense Full Defense
High voltage pulse Indefensibility Limited defense Full Defense
Transient over voltage Indefensibility Limited defense Full Defense
Voltage falls Limited defense Limited defense Full Defense
Noise Limited defense Limited defense Full Defense
Deviation of frequency Indefensibility Indefensibility Full Defense
Continuous low voltage Full Defense Full Defense Full Defense
Interruption of the utility Full Defense Full Defense Full Defense
13 | P a g e
4.3 UPS Modes VFI
UPS in Normal Mode
14 | P a g e
4.4 UPS Parallel Configurations
Benefits of Paralleling UPS Systems:
• Parallel Redundant
• Multiple UPS systems connect to the same battery bank to reduce costs.
• Not Advisable: Sharing a centralized battery bank between multiple UPS systems is generally not recommended
due to reliability concerns.
• When a high KVA rating is required, paralleling UPS systems becomes necessary, as a stand-alone UPS has a limit
on the KVA it can deliver.
• Ideally, each UPS system should have its own dedicated battery bank for maximum availability and reliability.
Overview:
How It Works:
• The redundant UPS is feeding the bypass line of one or multiple UPS
• If the active UPS fails, it switches to bypass, drawing power from the standby UPS.
• Conditioned power is still supplied from the backup unit when the active UPS is in bypass.
Key Concerns:
• Requires the standby UPS to have the same capacity as the entire cluster.
• A failure in the active UPS (e.g., system card or static switch issue) can cause a total cluster failure.
• Overload risk: If the active UPS cannot handle the load and fails over to the standby UPS, the standby unit may
also overload, leading to a complete system collapse.
15 | P a g e
Parallel Redundant UPS (50% Good)
Overview:
How It Works:
• Each UPS has its own rectifier, inverter, and battery bank.
• Only one single static and manual bypass cabinet is used for maintenance.
• All UPS units must be synchronized to ensure matching output sine wave and frequency.
Key Concerns:
• Single Point of Failure (SPOF): Each of these UPS has control over this cabinet and if errors appear they could
instruct to go to bypass. This particular bypass cabinet is now a SPOF.
• If errors occur, multiple UPS units may instruct the system to switch to bypass, potentially causing system failure.
Overview:
• Easy to scale.
How It Works:
• The output sine wave and frequency must be identical for the configuration to function properly.
16 | P a g e
Requirements for Parallel Configurations
Key Principles:
o Avoid centralized control, bypass cabinets, or components that could cause a SPOF, including:
o If the master unit encounters issues, control will automatically transfer to one of the slave units, which
will then become the master, preventing SPOF.
o Any UPS unit can take on the master role at any time.
Load Distribution:
• Load difference between each UPS module should not exceed 5-10%.
• Cabling Requirements:
o Input cables and output cables must be of the same length for each UPS to avoid balance regulation
issues.
o While input and output cables don’t need to be of the same length, both input cables and output cables
for each UPS must match in length.
Communication Cabling:
• The total number of units in a cluster should be kept low (fewer than 4 units) in a cluster to reduce risks such as
rotating currents.
• The output sine wave of the UPS inverter is synchronized to the bypass input voltage (not the rectifier).
• This synchronization ensures that in the event of a problem with the UPS (e.g., high temperature on the
inverter), the system can switch to bypass without interrupting the load.
• Since both the bypass and inverter are in sync, a make-before-break switch over can occur seamlessly, preventing
any disruption to the load.
17 | P a g e
4.5 UPS Energy-Efficiency & Green Options
As data centers consume significant energy, optimizing UPS systems for efficiency is critical for both cost savings and
environmental sustainability. Energy-efficient UPS systems are now available, offering improved performance while
minimizing energy waste.
Energy-Friendly Options
Energy-Efficient UPS Features
• Eco-mode: Automatically switches to a more energy-efficient mode when power quality is good, saving energy.
• Smart-mode: Adjusts to optimize efficiency based on the load and input power.
• Enhanced Eco-mode: Allows the UPS to switch from high-efficiency VFI mode to a lower-efficiency VFD mode
when conditions allow, providing additional savings.
However, these modes are less effective in areas with poor power quality, where energy savings may be minimal or
unavailable.
• UPS Class (VFI, etc.): Check IEC-62040-3 for the classification (e.g., VFI for mission-critical applications).
• Efficiency & Efficiency Modes: Look for Eco-mode or Smart-mode for energy savings.
• Crest Factor (Peak vs. Nominal): Aim for 3:1 or better for handling high transient loads without overloading.
• Power Factor (Input/Output): Higher power factor = more efficient, ensuring minimal energy loss.
• Input Total Harmonic Distortion (THDi): Lower THDi = better performance and less stress on the system by
minimizing harmonics.
• Output Total Harmonic Distortion (THDv): Lower THDv ensures clean output, especially for nonlinear loads.
• Rectifier Technology: Look for 6/12 pulse rectifiers and IGBT or SCR/Thyristor technology, which ensure efficient
conversion of AC to DC power.
• Inverter Bridge Technology: IGBT technology is ideal for efficient DC to AC-conversion, and isolation transformers
improve protection and noise reduction.
• Fault Logging & Measurements: The UPS should be capable of logging faults and providing measurements to
help with monitoring and troubleshooting.
• Isolation Transformer: Adding a K-13 or higher isolation transformer to the bypass line or output improves
power isolation and enhances protection.
18 | P a g e
5.0 Backup Power System: Batteries
Batteries are a crucial component of Uninterruptible Power Supply (UPS) systems in data centers, providing
backup power during outages and ensuring continuous operation of critical equipment. They bridge the gap
between utility power failure and backup generator activation. Without reliable batteries, UPS systems cannot
perform their primary function of maintaining power during short disruptions. As data centers grow in size and
complexity, the need for efficient, durable, and easily maintainable battery systems has become even more
important to ensure minimal downtime and maintain uptime reliability. This section will outline the role and
importance of batteries in supporting UPS systems for data center operations.
• Pros:
- Long lifespan (15-20 years)
- Can operate at high currents
• Cons:
- Must be stored in vented rooms to safely expel hydrogen gas, which is highly explosive when mixed
with air.
- Needs maintenance, including regular water replacement
- Electrolyte handling is hazardous (can cause burns)
- Must be used upright for safety and performance
2. Sealed Lead Acid (SLA) / Valve Regulated Lead Acid (VRLA)
(Suitable for Small-Medium Data Centers)
• Design Life: 5 or 10 years (Note: Design life does not equate to service life)
• Service Life: 5 years design: Approx. 3-4 years, 10 years design: Approx. 7-8 years
• Service life depends on factors like discharge frequency, UPS ripple factor, and ambient temperature.
• Pros:
- Cost-effective
- No memory effect
- Low self-discharge rate
• Cons:
- Slow recharging time (+8 hours)
- Requires constant charge to prevent sulphate-destroying plates
- Can’t stand high temperature
19 | P a g e
3. Lithium-ion (Li-ion)
• Pros:
o Long lifespan (>10 years)
o Smaller footprint and lighter weight
o 10x more discharge cycles than SLA
o Faster charging capability
• Cons:
o Expensive (approximately 3 times more than SLA)
o Requires a battery management system (BMS) to ensure safe charging/discharging
o Stricter transportation regulations due to safety concerns
4. Nickel-Cadmium (Ni-Cd)
• Pros:
o Long lifespan (20 years)
o Can operate in high ambient temperatures
o Reliable and predictable performance
o Fast charging capabilities
• Cons:
o Requires special chargers in UPS systems
o Susceptible to memory effect (needs to be fully discharged before fully charging)
o Expensive (4-6 times more than SLA)
o Disposal is costly due to high chemical content
2. DC Bus Voltage: Determined by the UPS manufacturer and influences the number of battery blocks in a string.
4. Service Capability: Batteries must meet operational needs, including charge/discharge cycles.
5. Recharge Time: The faster the battery recharges, the quicker the UPS can restore full protection.
7. Ambient Temperature: Affects battery performance and lifespan; higher temperatures reduce battery life.
8. Expected Lifespan: Batteries typically come with 5-year or 10-year design life options.
9. Fireproofing: Standard ABS casings are not fire-rated; fire-resistant enclosures may be needed.
10. Weight Load: Autonomy time and battery arrangement (floor-spread or rack-stacked) affect structural planning.
11. Cost: All the above factors influence overall system cost and budget considerations.
20 | P a g e
Battery Bank Terminology
• A battery bank consists of all the batteries connected to a UPS system. It provides the necessary backup power
and is designed to meet capacity and redundancy requirements.
• Battery String: A battery bank contains at least one string, but most UPS systems have multiple strings connected
in parallel to enhance capacity or redundancy.
• Battery Block: Each string is made up of individual battery blocks connected in series.
• Battery Cell: Each battery block contains at least one cell. For example, a 12V SLA/VRLA battery consists of six
cells (each cell providing approximately 2V).
• UPS systems are primarily used to bridge the gap between power loss and generator startup.
• Longer autonomy times are usually unnecessary and can introduce issues such as:
o The need for multiple parallel battery strings, which can create balancing challenges.
• Too many parallel strings lead to unequal charging/discharging, reducing battery efficiency and lifespan.
• To mitigate this, keep parallel battery strings to 2-3, and preferably do not exceed 4.
3. Charging Limitations
By maintaining a balanced battery bank design, you ensure optimal UPS performance, reliable recharging, and minimal
system risks.
21 | P a g e
5.3 Battery Bank Calculation
To calculate the battery bank, the following factors must be determined:
• Inverter Efficiency
Calculation Steps
Step 1: Determine UPS Required Load Capacity
• Identify the correct battery type based on required autonomy and power per cell.
22 | P a g e
Example: Battery Bank Calculation
Given:
• Load: 60 kVA / 48 kW
• Inverter Efficiency: 93%
• DC-Bus Minimum Discharge Voltage: 336V
• Number of Cells in Series: 192
• Required Autonomy: 30 minutes
The closest match is 303 W/Cell at 1.75V, which corresponds to a 180 Ah battery .
23 | P a g e
5.4 Battery Charging Methods and Management
Calculating the Charger Current
• Charger current determines the speed of charging up to 85%.
• A typical recharge cycle takes up to 8 hours.
• Charging from 85% to 100% can take up to 16 hours, prolonging battery lifespan.
• Large battery banks may exceed the UPS rectifier’s charging capability, requiring additional external chargers.
• Issues with external chargers: Lack of control over external charger cards may cause unreliable battery tests
unless additional measures are taken.
24 | P a g e
5.5 Battery Configuration and Paralleling
Handling Insufficient Capacity in a Single Block
• If required W/Cell is not in the discharge table, consider parallel strings:
o Example: If 750 W/Cell is needed:
▪ 2× 230Ah batteries in parallel provide:
2 × 387 W/Cell = 774 W/Cell (sufficient capacity).
25 | P a g e
5.6 Battery Maintenance and Monitoring
• UPS battery monitoring is basic, often based on string monitoring instead of block-based monitoring:
o Voltage-based monitoring provides limited insights (UPS reading).
o Impedance/resistance-based monitoring offers better early failure warnings (manually handheld tester
every 3-6 months at block level).
• Test under different conditions:
o Floating: Normal UPS mode (measure voltage before)
o Under Load: Input power off, UPS running on batteries (measure voltage after)
• Testing Approaches: Spot checks and Continuous monitoring
26 | P a g e
6.0 Backup Power System: Generator
6.1 Importance of Generators in Data Centers
Generators provide backup power to maintain the seamless operation of data centers during utility power outages.
Without generators, the cooling systems in data centers would cease to function, leading to overheating and potential
hardware failures. To prevent such risks, data centers employ redundant generator sets, ensuring that power remains
available even if one generator fails.
1. Standby Generators
o Designed for use when utility power is generally reliable but may experience occasional outages.
o Typically rated for a maximum of 80% average load factor and around 200 hours of operation per year.
2. Prime Generators
o Provide variable load power for an unlimited number of hours per year.
o Should not exceed 70% of the prime power rating over any 250-hour operational period.
o If the engine is running at 100% prime power, yearly hours should not exceed 500 hours.
o Have a 10% overload capability available for 1 hour within a 12-hour cycle.
3. Continuous Generators
o Used where grid power is unavailable, making them suitable for off-grid data centers.
Additionally, high-power generators with high-voltage ratings and lower RPMs (1,500 RPM for 50Hz, 1,800 RPM for 60Hz)
offer cost savings and durability. These generators experience less wear and tear, resulting in a longer lifespan and lower
maintenance costs.
Furthermore, environmental factors impact generator performance and must be considered during selection. Extreme
weather, altitude, air quality, and natural disasters all play a role. Cold climates cause fuel to gel, while hot climates risk
overheating; altitude reduces oxygen, requiring engine adjustments. Pollutants damage components, and natural
disasters demand disaster-resistant generator rooms for reliable operation.
27 | P a g e
6.3 Generator Principles and Components
Generators function based on the principle of electromagnetic induction, where a rotating coil within a magnetized
environment produces electrical energy.
1. Combustion Engine: The prime mover that drives the alternator to generate electricity, using diesel or gas as
fuel. While diesel is the standard in data centers, natural gas is gaining traction for its cleaner emissions.
2. Alternator: The alternator is responsible for converting mechanical energy into electrical energy.
o Proper Sizing – Prevents glazing and operational inefficiencies from low-load operation.
o Future Growth – Allows for increased load capacity without performance issues.
o Electronic governors: ±0.25% speed variance, enabling better efficiency and synchronization in parallel
configurations.
4. Fuel Storage:
o Fuel is stored in separate day tanks and storage tanks for redundancy (Tier3/4).
o Fuel refuel points must be secure, above flooding area, and easily accessible.
6. Starter motor and Battery: cranks the engine using battery power to initiate operation until it runs
independently.
7. Control & Monitoring System: Oversees generator performance and automates operations.
8. Air Intake, and Exhaust System: The air intake supplies oxygen for combustion, while the exhaust system
removes combustion gases for safe operation.
Effective load management, variable speed drives (VSDs), exhaust heat recovery, and fuel efficiency all contribute to
optimizing generator performance. Automatic load-sharing ensures generators stay within optimal load ranges for better
efficiency and longevity. VSDs adjust generator speed based on demand, improving fuel efficiency and reducing wear.
Exhaust heat recovery repurposes waste heat for building or water heating, enhancing energy efficiency. Using high-
efficiency engines and clean-burning fuels optimizes consumption and minimizes emissions.
28 | P a g e
6.4 Generator Redundancy
Redundancy ensures power continuity during generator failures, with varying reliability levels.
• N+1 Redundancy: One extra generator than needed. If one fails, the spare ensures sufficient power. Balances
cost and reliability.
• 2N Redundancy: Enough generators to fully backup the load if any generator fails. Ideal for mission-critical data
centers with no tolerance for downtime.
• 2N+1 Redundancy: Extra backup units for maximum reliability. Used in high-uptime data centers, though more
costly.
• Automatic Detection: Detects power loss from the main supply and activates the backup generator
automatically, ensuring seamless switching between primary and backup power sources
• Prevents Downtime: Essential in mission-critical environments like data centers and industrial facilities.
2. Synchronization Basics
• Purpose: Ensures multiple generators work together, they must be synchronized to avoid damage and ensure
smooth operation.
• Synchronization Parameters:
• The first generator reaching the correct voltage and frequency becomes the lead unit.
• Uses rotating schedules to evenly distribute generator usage and minimize wear.
29 | P a g e
3. Load Distribution and Balancing
• Objective: Evenly distribute the electrical load among multiple generators to prevent overloading.
• Key Mechanisms:
• Shared Power Bus: Connects all generators, allowing load sharing instead of being tied to just one.
• Automatic Load Sharing: Monitors generator load and redistributes power to prevent overloading.
• Dynamic Load Adjustment: Automatically adjusts load distribution in real-time based on demand.
• Essential Equipment:
• Paralleling Switchgear (PSG): Ensures generators operate together and share load efficiently.
• Automatic Load Sharing Controllers: Monitor and adjust load distribution dynamically.
• Benefits:
• Reduces Wear and Tear: Distributes load evenly, extending generator lifespan.
• Adequate Airflow: The room must have sufficient and unobstructed airflow to prevent overheating.
• Oil Trays: Oil trays should be installed to prevent oil spills on the floor.
• Exhaust Location: The exhaust should be positioned to prevent fumes from entering the data center.
• Security: The generator room should be secure, with access controlled via locks and monitored by CCTV.
30 | P a g e
6.7 Generator Sizing
Proper sizing of generators depends on multiple factors:
The total generator capacity can be calculated using the sum of the following:
Data centers must follow local fuel storage regulations and have refueling agreements to stay certified. A smaller fuel
reserve is usually acceptable if a refueling plan is in place. To ensure reliable backup power, generator sizing should be
based on full-load fuel consumption with extra capacity.
• Full load tests: At least quarterly using load banks or actual data center load.
• Fuel quality checks: Monitoring for contamination, microbial growth, and gelling.
• Predictive Maintenance: IoT helps predict failures by detecting early signs (e.g., unusual vibrations, temperature
spikes), reducing downtime and repair costs.
• Efficiency Optimization: Historical data helps optimize load distribution, fuel settings, and cooling systems for
peak generator performance.
31 | P a g e
6.11 Automatic Transfer Switch (ATS)
• A device that automatically selects power from one source or an alternate source (e.g., switching
between utility and generator power).
• Used in power redundancy designs to ensure continuous operation.
Operating Principle:
• Typically used when the two sources are not synchronized (e.g., utility power and generator power).
• Mechanically Operated:
o Uses electromechanical contactors or relays to perform switching.
o Switching time is slow (typically >50 ms), which requires UPS support to prevent power
interruptions.
ATS Considerations
• Switching Speed:
o Slower than STS; requires a UPS to cover transfer time.
• Redundancy:
o Used in N+1 or 2N power systems to enhance availability.
• Monitoring & Control:
o Intelligent ATS units can be monitored remotely via BMS or DCIM for fault detection and
automation.
32 | P a g e
6.12 Static Transfer Switch (STS)
Function of the STS Panel
• STS – Static Transfer Switch
o A device that electronically switches power from one source to an alternate source with very
fast response times.
o Used in critical applications where even a slight power interruption is unacceptable.
o Faster than ATS since it uses semiconductor components (SCRs, IGBTs) instead of mechanical
contacts.
• Operating Principle:
o Break Before Make (BBM) Operation:
▪ Similar to ATS, but operates electronically.
▪ Switching time < 4 ms – 20 ms, significantly faster than ATS.
o Seamless Switching:
▪ Can instantly transfer between power sources if they are synchronized (e.g., two UPS
systems).
▪ Typically used inside data centers at rack, row, or room levels.
STS Considerations
• Ultra-Fast Switching:
o Prevents power interruptions and eliminates the need for UPS intervention during transfers.
• Synchronization Requirement:
o STS requires both sources to be in sync to avoid voltage and frequency mismatches.
• Placement in Data Centers:
o Deployed at rack-level or row-level for critical IT loads.
• Efficiency & Redundancy:
o STS helps optimize redundancy (e.g., in a 2N power architecture, STS can alternate between
two UPS feeds).
33 | P a g e
7.0 Power Redundancy Strategies for the Rack
7.1 Common Techniques for Power Availability
To ensure high availability and minimize downtime in data centers, implementing power redundancy and
reliability is essential. The following best practices should be adopted to create a robust power infrastructure:
By following these practices, data centers can achieve a high level of power redundancy and reliability,
ensuring continuous operation even during failures or maintenance activities.
34 | P a g e
Option 1: Low Availability
This setup relies on a single power source, where all equipment is powered
through one UPS and a single PDU. If either the UPS or PDU fails, the entire
power system is disrupted, leading to downtime.
35 | P a g e
8.0 Power Distribution Within the Data Center
Effective power distribution within a data center is crucial to ensure consistent performance and uptime. It
should be designed to be:
Distribution Choices
• Location: The placement of power distribution systems can impact performance, especially in terms of
electromagnetic interference (EMI). To mitigate issues, ensure that power distribution systems are
appropriately spaced:
o Overhead: Distributing power cables above the ceiling, commonly used for large areas and easy access.
o Under Raised Floor: Running power cables below the floor, a common choice for data centers with a
raised floor design, facilitating easy cable management and airflow.
• Distribution Type:
o Standard Cabling: Conventional power cables used for standard power distribution, typically in smaller
setups or less complex environments.
o Busbar Trunking (BBT): A more advanced and flexible power distribution solution that uses a busbar
system to deliver power to various areas of the data center. It offers better scalability and reduced
losses compared to traditional cabling.
• Standard Cabling
o Less Flexibility: Once installed, it’s harder to reconfigure without disrupting the system.
o Fixed Power Rating: Typically, the power rating is fixed and can't be adjusted without replacing
components.
o Cost-Effective: Generally less expensive than busbar trunking, making it a good choice for
smaller or less complex installations.
• Busbar Trunking (BBT)
o Greater Flexibility:
▪ Supports both 1-phase and 3-phase power distribution.
▪ Adjustable power ratings to accommodate future growth.
▪ Allows for easy installation of breakers at each tap-off box for enhanced control and
maintenance.
o Higher Initial Cost: More expensive upfront compared to standard cabling.
o Reduced Electromagnetic Interference (EMI): BBT systems generally produce less EMI,
improving overall system reliability and minimizing potential interference with sensitive
equipment.
36 | P a g e
Busbar Trunking (BBT)
• Fully Enclosed Power Bars: Busbar trunking systems feature fully enclosed power bars, ensuring safe
and secure power distribution.
• Tap-Off Box: A tap-off box is connected to the busbar system, providing easy access for power
extraction.
o The tap-off box determines which phase(s) are supplied to the specific equipment.
o Circuit Breakers: Breakers are installed at each tap-off point to provide protection. If an
overload or short circuit occurs, the breaker will trip inside the tap-off box to prevent further
damage.
• Fixed Spacing Configurations: Most busbar systems come with fixed spacing between busbars, which
may not always align with rack spacing, especially in environments with mixed rack widths.
• Flexible Spacing Options: Some busbar systems offer non-fixed spacing, providing greater flexibility to
match specific rack or power distribution needs.
Power Cabling
Power cabling in a data center should be carefully selected based on factors such as material type (XLPE, PVC,
FR), power ratings (voltage and amperes), ambient temperature, physical protection, fire ratings, regulatory
requirements (e.g., fire rating, color coding), and ease of installation. Proper consideration should be given to
voltage drop, as cables have inherent resistance, leading to a drop in voltage over longer distances, which may
require compensation.
Installation Considerations
• Neutral Sizing: Use a neutral conductor appropriate for the system's needs:
o Double size (for high harmonics/imbalance, typically x1.7 live wire, to prevent overheating)
• Ground Wire: Should match the neutral wire to enhance safety and minimize electrical noise.
• Cable Routing: Use generous bend radii for power cables and ensure secure fixing and protection via
ladders, trays, or trunking.
• Flexibility & Safety: Allow for movement in seismic zones and ensure proper labeling for easy
identification.
37 | P a g e
8.2 Three-Phase / Single-Phase Usage
Three-phase power distribution within the building consists of five wires: three active (phases), one neutral,
and one ground, with the conversion to single-phase power typically carried out in the distribution boards
(PDU/DB/PPC).
Most data center UPS systems operate on three-phase power, while most ICT equipment is designed for single-
phase power.
Significant imbalances between phases can lead to power quality issues and may affect UPS performance.
Key Considerations:
38 | P a g e
8.4 Grounding in the Data Center
• Grounding/Earthing: The terms "grounding" and "earthing" are interchangeable, both referring to the
process of connecting electrical systems to the earth.
• Ground Wire Functions:
o Voltage Reference: Establishes a reference point for voltage levels.
o Fault Clearing: Facilitates the clearing of electrical faults.
o RF/ESD Discharge: Provides a path for radio frequency (RF) and electrostatic discharge (ESD),
often through a Single Reference Ground (SRG).
o Lightning Protection: Carries lightning currents safely to the ground.
• Grounding Requirements for Data Center Equipment:
o Low Impedance Earth Point: The ground should be at a low impedance, minimizing noise or
electrical interference that could affect the equipment.
o Bonding at Building Entry: Grounding should be bonded as the power enters the building to
establish a solid connection.
o No Unauthorized Taps: Ensure the ground point is dedicated and not tapped into by other
systems.
• Grounding Infrastructure:
o A separate ground bar is created within the data center, and all metal components (e.g., PDUs,
racks, raised floors) are connected to it.
o A separate grounding cable runs from this bar through the building and connects to the earth’s
ground system.
• Ground Resistance:
o The ideal ground resistance should be less than 1 Ohm, with a maximum allowable resistance
of 5 Ohms.
o Current Distribution: Electrical current will flow through the path with the lowest resistance, so
maintaining low resistance is essential for effective grounding.
• Bonding of Metal Objects: All metal parts in the data center, including:
o Cabinets
o PDUs
o Air Conditioning Units
o UPS Systems
o Raised Floors
Should be properly bonded to the ground to prevent electrical hazards and ensure system integrity.
39 | P a g e
9.0 Power Distribution: PDU & DB
Power Distribution Units (PDUs) and Distribution Boards (DBs) are critical components in the electrical system
of a data center, responsible for managing and distributing electrical power to various loads.
(EN60439-1)
• Isolators for maintenance and safety: Essential to disconnect parts of the system for servicing without
disrupting the entire infrastructure.
• Over-current protection devices: Safeguard against overloads and short circuits to prevent equipment
damage.
• Residual current leakage protection: Protects from electrical shocks and ensures personnel safety.
• Surge protection: Safeguards equipment from voltage spikes, protecting sensitive IT equipment from
damage.
• Compliance with form factors and standards: Ensures adherence to safety, operational, and reliability
standards.
• Internal isolation transformers: Minimize common mode noise (CMN) and harmonics, improving the
power quality delivered to sensitive equipment.
• Metering for monitoring power usage: Enables tracking power consumption for efficiency and load
management.
• Indicator lights and alarm interfaces for EMS/BMS integration: Allow real-time monitoring and
control, ensuring smooth operation.
• Spare breakers or expandable breaker slots for live additions: Ensure scalability of the power
distribution system as the data center grows.
This structured approach ensures reliable, scalable, and safe power cabling within the data center.
40 | P a g e
9.1 Isolation Transformer
Isolation transformers are crucial for enhancing the quality of power in a data center and protecting
equipment from electrical disturbances.
Key Functions:
• Galvanic isolation: Provides electrical isolation between input and output to prevent ground loops and
reduce electrical noise.
o Filtering of power disturbances: Helps reduce common power issues like surges, transients, and
harmonics, improving overall power quality.
o Reduction of Common Mode Noise (CMN): Helps in reducing noise that can affect sensitive
equipment.
• K-Factor Transformers:
o These transformers are specifically designed to handle high harmonic loads.
o K-13 transformers are the most common in data centers, as they can tolerate higher harmonic
content without overheating.
o Consider doubling the size of neutral conductors when there is a high harmonic load to prevent
overheating and improve safety.
When integrated with PDUs or at strategic points in the power distribution network, isolation transformers
provide the best performance in reducing electrical noise and maintaining system stability.
• Best Practices:
o Bonding should be done as close as possible to the ICT equipment to ensure the effective
operation of safety devices and minimize noise.
o Isolation transformers are based on delta-wye play a role in managing CMN and ensuring
effective grounding by separating neutral and ground at strategic points.
o Proper neutral-to-ground bonding enhances system performance and ensures that any stray
currents or noise are minimized, protecting sensitive equipment.
• Guideline: The IEEE recommends that the bonding point for the ground system be within 25 meters of
the ICT load, ensuring minimal impact from electrical noise.
41 | P a g e
9.3 Data Center Power Distribution
Good Performance:
• A centralized isolation transformer offers good performance for power distribution, depending on its
distance from the ICT equipment. The closer the transformer is to the load, the better the performance.
• In many data center setups, isolation transformers are used in conjunction with UPS systems. The
bonding point is typically located at the output of the transformer, with cables running from there to
various distribution panels throughout the data center.
• The UPS room should be positioned near the distribution boards (DB). IEEE standards recommend that
the bonding point should not be more than 25 meters away from the ICT load to ensure effective
power distribution and minimize voltage drop.
Best Performance:
• Power Distribution Units (PDUs) with built-in isolation transformers provide the best performance.
o These PDUs help achieve superior control over Common Mode Noise (CMN), ensuring better
power quality and reliability for sensitive IT equipment.
42 | P a g e
9.4 Form Factors
Form factors are important in ensuring the physical layout and safety of electrical systems, especially within
switchboards.
• Key Forms:
o Form 2 – Separation of busbars from other functional units: Separation ensures that a fault in
the switchboard does not affect all functional units, improving operational resilience.
o Form 3 – Separation between busbars and all functional units: Provides additional protection
by isolating functional units, ensuring that failure of one unit doesn't cause unacceptable
disruption.
o Form 4 – Complete Separation: Ensures that busbars, functional units, and their terminations
are fully separated, allowing for easy isolation and safe maintenance.
These forms help enhance safety by isolating faults and reducing the risk of widespread disruptions,
contributing to reliable and continuous power supply.
43 | P a g e
10.0 Power Supply Quality
The power supplied to data centers is not always stable, which can harm IT equipment and affect its
performance. Poor power quality can cause problems regularly, especially in areas with unreliable electrical
systems. These issues can lead to:
Common Mode Noise (CMN) is a voltage imbalance between neutral and ground, which can lead to heating in
power supplies and system inefficiencies. Keeping CMN low is important for maintaining equipment health,
and proper grounding and cable management are essential in minimizing this issue.
44 | P a g e
10.1 Harmonics
Harmonics are waveform distortions caused by non-linear loads that draw current in pulses rather than a
smooth sinusoidal manner. These distortions create unwanted frequencies that are multiples of the
fundamental frequency (50Hz or 60Hz), affecting power quality.
Total Harmonic Distortion (THD): THD measures harmonic distortion in a power system and is categorized as:
• THDi: Measured on the input side of devices like UPS systems, it represents the extent of harmonic
currents drawn by non-linear loads.
• THDv: Measured on the output side of a UPS system, it indicates how much the voltage waveform is
distorted due to harmonic currents in the system.
High THDi leads to THDv, causing voltage distortions, overheating, and reduced system efficiency. Excessive
harmonics may require oversizing power components such as generators and transformers to handle
additional losses.
Use inductors, capacitors, and resistors to block or absorb harmonics at specific frequencies.
Cons: Requires periodic component replacement, Less effective under variable load conditions.
Cons: Higher cost, requires regular maintenance, and has efficiency losses (~3%).
45 | P a g e
10.2 CBEMA / ITI© Curves
The CBEMA/ITI Curve defines the tolerance of Information Technology Equipment (ITE) to voltage
disturbances, such as sags, swells, and dropouts. It helps understand how equipment reacts to different levels
of voltage.
Key Points:
1. Prohibited Region: Voltage surges or sags in this range can damage IT equipment.
2. No Damage Region: Voltage variations here won't damage the equipment but may cause operational
issues (e.g., resets, malfunctions).
3. No Interruption in Function Region: Voltage changes in this region won't affect operation or cause
damage.
• Voltage Tolerance: IT equipment can typically handle a ±10% variation from the nominal voltage
without issues.
• 20 ms Tolerance: If the AC supply voltage drops to zero, the system can still run for 20 milliseconds,
allowing a smooth transfer between power sources (using a Static Transfer Switch (STS)) without
interrupting equipment operation.
The CBEMA/ITI curve ensures that IT equipment can tolerate minor voltage disturbances without damage, and
it’s used to design UPS systems and transfer switches that provide reliable power to IT systems in data centers.
46 | P a g e
11.0 Protection Devices
11.1 Basic Single-Line Diagram
• Purpose: Represents the power layout and flow within a facility.
• Essential Components:
o Overcurrent Protection Devices: Includes MCB, MCCB, and other circuit protection
mechanisms.
o Isolators (Switches): Used for safe disconnection of circuits (Note: Overcurrent protection
devices should not be used as isolators).
o Residual Current Protection Devices: Provides earth leakage protection to prevent electrical
hazards.
o Wrap-Around Bypass Switches: Enables maintenance and redundancy in critical systems.
o Cable Type and Size Indications: Ensures proper specification and selection for load handling.
o Metering: Monitors power consumption and system performance.
o Indicator Lights: Provides visual status updates on power distribution.
o BMS/EMS Connection Points: Allows integration with Building Management Systems (BMS) and
Energy Management Systems (EMS) for monitoring and control.
47 | P a g e
11.3 Over-current Protection Devices
Some definitions:
Over-current:
• The level of current at which the protection device will trip, thereby breaking the flow of energy to
prevent damage or overheating.
• The maximum electrical current that can flow through a system under short-circuit conditions.
• Determined by the voltage and impedance of the supply system.
• Typically, in the range of a few thousand amperes.
Breaking Capacity:
• The maximum current that a fuse or circuit breaker can interrupt without being damaged or causing a
harmful electric arc.
Fuses
Fuse (Fusible Link):
• A fuse is a safety device consisting of a metal wire or strip that melts when heated by an excessive
electrical current, breaking the circuit.
Protection of MCB:
• Fuses are sometimes placed in front of a Miniature Circuit Breaker (MCB) to provide additional
protection.
• Fuses react faster than MCBs in certain cases.
Current and Time-Dependent:
• Fuses are classified based on their current rating and time characteristics.
• Three common categories of fuses:
o Ultrafast, Fast Blow, and Slow Blow.
o Indicated by FF, F, and T.
Blow Sequence:
• When using fuses with similar current ratings, the blow sequence can be determined based on the
shortest time blow, typically near a branch in the circuit.
48 | P a g e
MCB/MCCB/VCB/ACB
MCB: Miniature Circuit Breaker
• Indicates the current at which the device will break or trip, typically specified in amperes (e.g., 16A – 32A).
Timings: The duration required for the device to trip under certain conditions.
Critical Settings:
• Settings must be performed by a licensed electrical worker as they are crucial for the safety and proper
functioning of the system.
• Incorrect settings can result in nuisance tripping or, conversely, inadequate protection for the electrical
installation.
49 | P a g e
Breaking Curve
• The breaking curve represents the maximum inrush current an over-current protection device can
handle within a defined time period.
• Inrush current is the initial surge of current when an electrical device starts, often much higher than
the normal operational current.
• Types of Breaking Curves:
o B – Curve: Handles 3 to 5 times the nominal current (for devices with low inrush currents).
o C – Curve: Handles 5 to 10 times the nominal current (commonly used for ICT loads).
o D – Curve: Handles 10 to 20 times the nominal current (typically used for motor loads).
• Important Considerations:
o Check the appropriate breaking curve for the application to prevent nuisance tripping.
o Inrush currents must be evaluated at both the branch and device level to ensure correct
protection.
Fuses vs Breakers
Fuses:
• Cheaper and cost-effective.
• Ideal for situations where no breaks are expected, such as in battery banks.
• Non-adjustable timing, set to a fixed value.
• Often cannot be replaced without power interruption.
• Once blown, fuses need to be replaced, except for PPTC fuses which are resettable.
Breakers:
• More expensive than fuses.
• Can be reset after an overload or fault, offering reusable protection.
• Some breakers offer adjustable timing to fine-tune protection.
• Inspect and replace breakers that have experienced multiple short-circuit events to maintain safety and
performance.
50 | P a g e
11.4 Residual Current/Earth Leakage Protection
Key Points:
• Earth Leakage protection is critical for human safety as current, not voltage, causes harm.
• Human body resistance varies based on conditions:
o Dry skin: Approx. 10,000 ohms (Ω)
o Moist skin: Approx. 1,000 ohms (Ω)
• Threshold limit for safety is generally 100V-AC.
• Measures the difference between phase current and the return current on the neutral. Normally,
the EMF fields of both wires cancel each other out.
• Trip mechanism: If a leakage occurs (e.g., when someone touches the phase), current will flow
through the human body to the ground, causing an imbalance in the EMF fields. The imbalance
increases the EMF field, and when it exceeds the preset threshold, the device trips to cut the
current.
51 | P a g e
11.5 Sizing of Breaking Components
Categories of Breaking Components:
• Isolators
Proper Configuration:
• From upstream to downstream, the ratings of MCB/MCCB and isolators must decrease.
o Carefully review timing settings and breaking speed (Fuses vs. Breakers).
• On a busbar, multiple breakers might exist, and the total theoretical rating could exceed the upstream
breaker rating.
o Ensure the ratio of main versus sub-breakers is realistic and compliant with local regulations.
o During normal operation, the sum of currents drawn by all devices should not exceed the
upstream breaker setting.
o Regular measurements should be conducted, especially after major load changes, to verify
proper operation.
• Ensure that Residual Current Breaker (RCB) devices have a rating equal to or higher than the upstream
breaking devices to maintain system protection.
52 | P a g e
11.6 Surge Protection
Surges are brief voltage spikes often induced by external factors such as lightning strikes or internal factors like
load switching and faults in the electrical supply. Effective surge protection is crucial to safeguard equipment
from these voltage increases.
• External factors: Lightning, power line crossovers, and other natural causes.
• Internal factors: Switching of electrical loads and faults within the electrical supply system.
• Surge immunity levels and testing methods are defined by standards such as ANSI/IEEE-C62.41 and
ANSI/IEEE-C62.45.
• TVSS (Transient Voltage Surge Suppressor) and SPD (Surge Protection Device) are the common terms
used for surge protection.
o TVSS has been replaced in modern standards by the term SPD (Type 1, 2, 3, and 4).
• Installation: Surge protectors should be installed at various levels within the electrical supply chain,
such as at each Distribution Board (PDU/DB).
o Telecommunication cables should also have surge protection if the equipment does not have
built-in protection, particularly for copper cabling.
53 | P a g e
Types of Protection Provided:
• Cascading surge protection involves placing SPDs at each level of the electrical system to ensure proper
protection from lightning strikes, transients, and switching loads.
o It also ensures better suppression closer to the critical loads.
• SPD placement: This should be installed as close as possible to the feed and on every distribution
board.
o Long or thin cables can reduce the effectiveness of the SPD, so they should be kept short.
o Integrated SPDs are the most effective, but if external SPDs are used, ensure short cable lengths
to maintain protection quality.
By adhering to proper installation and cascading strategies, surge protection ensures the safety and longevity
of critical equipment in the data center.
54 | P a g e
12.0 Electromagnetic Fields (EMF)
Electromagnetic waves are composed of two related fields:
• Electric Field (E-field): Created by voltage and measured in volts per meter (V/m).
• Magnetic Field (H-field or B-field): Created by electric current flow and measured in Gauss (G),
milligauss (mG), or Tesla (T).
• Wireless Communications:
• Microprocessor Chips: EMF interference can lead to erratic behavior and system failures.
o Magnetic flux from nearby power cables may disturb data transmission.
o Shielded Twisted Pair (STP) cables are effective for high-frequency alien crosstalk but not for
low-frequency EMF.
• Sources:
o Man-made via pumped flux compression generators and High Power Microwave (HPM) devices.
55 | P a g e
12.3 Best Practices for EMF Mitigation in Data Centers
During Design Phase
• Create distance between power equipment, cabling, ICT equipment, and personnel areas (e.g., NOC,
security rooms).
• Techniques:
o Avoid welding.
o HT-supply transformers
56 | P a g e
EMF Measurement Techniques
• Low-cost, single-axis meters: Measure composite EMF only.
▪ A = Attenuation (dB)
o Best time to test: During the Integrated Product Verification Test (IPVT) to ensure shielding
effectiveness at peak load.
57 | P a g e
13.0 General Power Knowledge in Data Centers
13.1 Real Power vs. Apparent Power
• Real Power (Watts): Actual power consumed by equipment.
• Apparent Power (VA): Combination of real power and power reflected back to the supply.
• Power Factor (PF): Ratio of real power to apparent power.
o Formula: W = VA × PF
o PF ranges between 0 and 1 (0 = no power, 1 = Real Power = Apparent Power).
o Example: A 100 kVA UPS with an output PF of 0.8 delivers 80 kW of real power.
Voltage Conversions
Power Formulas
Standards
• Various types of light fixtures are available, but protected types are preferred for durability.
• Lights should be placed:
o At regular intervals
o In all aisles
o With a focus on the back of the racks, as this area is typically more important than the front.
• Power Supply Considerations:
o Lights should be connected to the raw power supply with a backup power supply from the
standby generator set.
o Fluorescent lights should never be connected to the same UPS that powers the ICT equipment
to avoid interference.
59 | P a g e
Emergency Light
• Purpose: Emergency lighting is critical to allow personnel to safely evacuate during a power failure.
• The required lighting level ranges from 1 Lux to 15 Lux, which is equivalent to the light provided by a
candle in the dark.
• Regulations often specify that emergency lights should be installed at ceiling level, although this can be
difficult to see during a fire due to smoke.
• It is advisable to exceed local regulations to ensure sufficient lighting for safety:
o Provide adequate lighting in each aisle or at least at the end of each aisle.
o Install emergency lights at lower levels to assist with evacuation during a fire.
• Emergency Lights Should Be Installed At:
o All critical switchboards
o UPS
o Standby generators
o Cooling equipment
• Torch Lights:
o Use quality torch lights with proper light strength.
o Regularly check and replace batteries.
o Glow sticks are a useful addition.
60 | P a g e
Savings on Lighting Infrastructure
1. Power-Saving Lights
2. LED Fixtures
LED lighting is highly energy-efficient and offers multiple advantages for data center environments.
• Lights-Off Strategy:
o Motion Sensors: Automatically turn off/on lights based on movement in the data center.
o Access Control Integration: Lights can be tied to access control systems to turn off when no
personnel are in the area.
• ANSI/TIA-942 Lighting Protocol:
o Level-1: Unoccupied areas should have minimal lighting.
o Level-2: Initial entry areas should have moderate lighting.
o Level-3: Occupied areas should have full lighting levels.
o Optional override function: Allow for manual control when necessary.
4. Security Considerations
• Security Requirements: Ensure that light levels are sufficient for security cameras to function
correctly, even if low-level lighting is used for energy savings.
• Night CCTV: Even minimal lighting improves CCTV image quality, so a balance between energy
savings and security should be maintained.
61 | P a g e
13.5 Thermographic scanning
• Thermographic scanning is a technology used to detect heat by visualizing temperature variations.
• It enables proactive detection of high-resistance connections and high-current conducting wires,
which can develop heat and potentially cause:
o Breakdowns
o Fires
• Standards
• ANSI/NFPA 70B and SS507 recommend conducting a thermographic scan annually.
• Areas to Scan
• Main switchboards and PDUs
• Connections and breakers of high-power equipment, including:
o Isolation transformer
o UPS
o Generator sets (Gen-sets)
• Main power cables (three-phase) and bus bars, ensuring to include the neutral cable.
• Critical rack/equipment/breakers that require close monitoring.
62 | P a g e
14.0 Data Center Power Efficiency
Data center power usage is typically divided into three main sections:
1. Power Distribution for ICT Equipment: This part supplies power to the Information and
Communication Technology (ICT) equipment, often using an Uninterruptible Power Supply (UPS)
system to ensure clean and reliable power.
2. Cooling Infrastructure: A significant portion of power is dedicated to cooling systems, necessary to
maintain the ideal operating environment for the ICT equipment.
3. Auxiliary Systems: This includes power for lighting, monitoring systems, and other non-ICT related
components.
The total power consumed by ICT equipment is referred to as Total IT Power, while the total incoming power
required for all aspects of the data center, including distribution, cooling, and auxiliary systems, is called Total
Facility Power.
Since facility power is generally higher than IT power, the PUE value will always be a number greater than 1
(e.g., 1.x, 2.x). The closer the PUE is to 1, the better optimized the facility is.
Can PUE reach 1? Theoretically, a PUE of 1 means that all utility power is used exclusively for the IT equipment.
However, achieving a PUE of 1 is virtually impossible, as some energy will always be consumed by cooling,
lighting, and other auxiliary systems.
The location of a data center plays a significant role in its overall efficiency and sustainability. Factors such as
access to free cooling and the type of power generation source (e.g., nuclear, coal, hydro) can greatly influence
a data center's "green" footprint.
• Legacy vs. New Data Centers: New, optimized data centers typically have lower PUE.
• Location and Ambient Conditions: Data centers in cooler climates often perform better due to the
availability of free cooling.
• Redundancy: High levels of redundancy (such as N+1 or 2N configurations) can increase energy
consumption.
• Computer Room Utilization: Better utilization of the computer room leads to more efficient cooling
and energy use.
63 | P a g e
14.3 Understanding PUE Values
PUE values are indicative of how well a data center is optimized. Here’s a breakdown of common PUE values:
• PUE = 1: Theoretically all power is used for IT equipment (not feasible in practice).
Note: These values assume a tropical climate, which significantly impacts cooling needs.
• PUE Measures Power, Not Energy: Power measured over time is referred to as 'energy', but PUE does
not account for the duration or the energy consumed.
• PUE Alone Does not Reflect Full Sustainability: A data center might reduce its electricity consumption
for cooling but at the cost of increased water usage, making the data center less sustainable despite a
lower PUE.
• Confusion in Measurement: Despite the Green Grid's efforts to standardize PUE, different
interpretations and practices still lead to inconsistencies in measurements.
Measurement
Level 1: Basic Level 2: Intermediate Level 3: Advanced
Class
IT Equipment
UPS PDU Server
Power
Data center input minus
Data center input Data center input minus
Facility Power shared HVAC plus building,
power shared HVAC
lighting, and security
Measurement
Monthly/Weekly Daily Continuous
Interval
The data center input power is measured at the utility hand-off point, and different incoming power capacities
(e.g., voltage levels) may result in varying losses at onsite transformers.
64 | P a g e
14.6 Additional PUE Considerations
1. Carbon Footprint: The actual carbon footprint of a data center depends on the source of its power
generation (e.g., coal, nuclear, hydro).
2. Mixed-Use Buildings: In mixed-use environments, PUE is calculated in the same way as dedicated data
centers, but energy consumption for non-data center operations (e.g., office space, elevators) may be
excluded.
3. Alternative Power/Cooling Sources: PUE based solely on electricity consumption can be misleading for
data centers using alternative sources such as district cooling or renewable energy. Additional metrics
are required to assess the sustainability of these sources.
These metrics help provide a more comprehensive picture of the environmental impact of a data center,
especially when considering factors like free cooling and power generation sources.
65 | P a g e