RD100DSR1
RD100DSR1
Facility Power
Facility Power Block Diagram
Power Block
The facility power system supplies power to all components within the data center.
Utility A Utility B Utility C
In this concurrently maintainable electrical design, power to the IT rooms is
2.5 MW 2.5 MW 2. 5MW
supplied through three 2.5 MW powertrains. The three powertrains provide 2+1
2.5 MVA G 2.5M VA G 2.5 MVA G
MV/LV TX
Genset
MV/LV TX
Genset
MV/LV TX
Genset
distributed redundant UPS power to the IT space, backed up by diesel generators.
ATS ATS ATS Each powertrain consists of a 3000-amp QED-2 main switchboard feeding two
LV SWB. A LV SWB. B LV SWB. C
UPS UPS UPS UPS UPS UPS 1250 kW Galaxy VX UPS with 5 minutes of runtime in parallel and a 3000-amp
1A 2A 1B 2B 1C 2C
Facility Cooling
Facility Cooling Block Diagrams
The facility cooling design is based on the specified AI deployment scenarios.
For IT Room 1 (retrofit IT room scenario), a chilled water system with dual path
piping is implemented. Three Uniflair BCEF chillers with free cooling capabilities
deliver 68°F chilled water in an N+1 configuration.
The facility cooling design for IT Room 2 (new IT room scenario) is comprised
of two separate chilled water loops. A high temperature water loop, with two
Uniflair XRAF extra high temperature chillers with screw compressors and free
cooling capabilities, provides 88°F water to the IT room to cool the IT
equipment. A separate chilled water loop, with two Uniflair XRAF extra high
temperature chillers, provides 70°F water for the air handling units of the IT
room. Using Uniflair XRAF extra high temperature chillers for the chilled water
loop enables future-readiness for water temperature increase. Uniflair BCEF
chillers and standard Uniflair XRAF chillers are also good options at this
specified chilled water temperature.
A thermal storage system provides 5 minutes of continuous cooling after a
power outage or chiller restart. The Uniflair BCEF and Uniflair XRAF chillers
can fully restart within 3 minutes.
More information on fan wall and CDU cooling architecture is provided in the IT
room section of this document.
This design is instrumented to work with EcoStruxure IT Expert and AVEVA
Unified Operations Center.
Further design details such as dimensions, schematics, and equipment lists are
available in the engineering package.
Facility Cooling Attributes
Name Value Unit
4976 (Dallas)
Total max cooling capacity (chillers) 5450 (San kW
Francisco)
Input voltage 480 V
Heat rejection medium Chilled water
Chiller redundancy N+1
Packaged chiller
Outdoor heat exchange
Design Options with free cooling
CW supply temperature 68 – 70 °F
This reference design can be modified as CW return temperature 86 °F
follows without a significant effect on the CW supply temp (Room 2, to CDUs) 88 °F
design’s performance attributes: CW return temp (Room 2, from CDUs) 104 °F
Combined* storage tank size 989 ft3
• Add EcoStruxure IT Expert
Ride-through time 5 minutes
• Change storage tank size
Outdoor ambient temperature range 11.1 to 110.5 °F
• Use standard temperature chillers,
Economizer type Water-side
like Uniflair XRAF or Uniflair BCEF,
*Summation of all three chilled water loops
chillers for loop with fan walls in IT
Room 2
Cold Aisle
Cold Aisle
Cold Aisle
Hot Aisle
Hot Aisle
Hot Aisle
Hot Aisle
configured with four racks together and two 15 kW networking racks in the middle
of the row. The high-density pod shares an 8 ft. wide hot aisle to allow proper
airflow. Ducted hot aisles and a common ceiling plenum return hot air to the fan
RPPs RPPs RPPs
walls for cooling.
Six Uniflair FWCV chilled water fan walls deliver clean and conditioned supply air
Cold Aisle
Cold Aisle
Cold Aisle
Hot Aisle
Hot Aisle
NET
NET
NET
NET
NET
NET
PDU1 266kVA to the IT room in an N+1 configuration. The redundant piping system across the
PDU2 500kVA IT room provides an alternate path for chilled water in case of cooling equipment
RPPs 2x400A
PDU2 PDU2
PDU2 PDU2
IT Room 1A Attributes
Name Value Unit
IT load 2010 kW
Supply voltage to IT 415 V
Single or dual cord Dual
Number of 12kW air-cooled racks 80 racks
Number of 40kW air-cooled racks 24 racks
Number of 15kW networking racks 6 racks
IT floor space 4467 ft2
CRAC/CRAH type Fan wall
Design Options CRAC/CRAH redundancy N+1
CW supply temperature 68 °F
This reference design can be modified as CW return temperature 86 °F
follows without a significant effect on the Containment type Ducted hot aisle
design’s performance attributes:
CDU type N/A
• Use Uniflair FXCV fan walls CDU redundancy N/A
• CRAHs can be selected instead of TCS loop supply temperature N/A
fan walls TCS loop return temperature N/A
• Variations in AI cluster
configuration
IT Room 1B Attributes
Name Value Unit
IT load 1864 kW
Supply voltage to IT 415 V
Single or dual Dual
Number of 12kW air-cooled racks 80 racks
Number of 73kW liquid-cooled racks 8 racks
Number of 40kW networking racks 8 racks
Design Options IT floor space 4467 ft2
This reference design can be modified as CRAC/CRAH type Fan wall
follows without a significant effect on the
CRAC/CRAH redundancy N+1
design’s performance attributes:
CW supply temperature 68 °F
• Use Uniflair FXCV fan walls CW return temperature 86 °F
• CRAHs can be selected instead of Containment type Ducted hot aisle
fan walls CDU type L2A
• Variations in AI cluster CDU redundancy N
configuration TCS loop supply temperature 104 °F
TCS loop return temperature 122 °F
IT Room 1C Attributes
IT Room 2 Attributes
Name Value Unit
IT load 1808 kW
Supply voltage to IT 415 V
Single or dual cord Dual
Number of 73kW liquid-cooled racks 16 racks
Number of 40kW networking racks 16 racks
IT floor space 1711 ft2
CRAC/CRAH type Fan wall
CRAC/CRAH redundancy N+1
DESIGN OPTIONS CW supply temperature 70 °F
This reference design can be modified as CW return temperature 86 °F
follows without a significant effect on the Containment type Ducted hot aisle
design’s performance attributes:
CDU type L2L
• Use Uniflair FXCV fan walls CDU redundancy N+1
• CRAHs can be selected instead of CDU CW supply temperature 88 °F
fan walls CDU CW return temperature 104 °F
• Variations in AI cluster TCS loop supply temperature 104 °F
configuration TCS loop return temperature 122 °F
Lifecycle Software
High-density AI clusters push the limits of data center facility infrastructure, so it’s
critical to leverage advanced planning and operation tools to ensure safe and
reliable operations.
Planning & Design
Electrical Safety and Reliability: Due to the high amount of power supplied to an
AI cluster, design specifications such as available fault current, arc flash hazards
and breaker selectivity must be analyzed in the design phase. Applications like
Ecodial and eTAP simulate the electrical design and reduce the chance of costly
mistakes or even worse, injury.
Cooling: AI clusters are pushing the limits of what can be done with air-cooling.
Modeling the IT space with computational fluid dynamics (CFD) helps spot issues
including high pressure areas, rack recirculation, and hot spots. This is especially
true when retrofitting an existing data center with an AI cluster. Schneider
Electric’s IT Advisor CFD can quickly model airflow, allowing rapid iteration to find
the best design and layout.
Operations
EcoStruxure TM is Schneider Electric’s open, interoperable, integrated Internet of
Things (IOT)-enabled system architecture and platform. It consists of three
layers: connected products, edge control, and applications, analytics, and
services.
Design Attributes
OVERVIEW Value Unit
Target availability III Tier
Annualized PUE at 100% load 1.17 / 1.18 / 1.16 San Francisco, CA
(1A & 2 / 1B & 2 / 1C & 2) 1.22 / 1.23 / 1.21 Dallas, TX
Data center IT capacity 3672 – 3818 kW
Data center overall space 32,920 ft2
Maximum rack density 73 kW/rack
FACILITY POWER Value Unit
Total facility peak power (IT and cooling) 6500 kW
Total amps (IT main bus, each) 3000 A
Input voltage (IT main bus) 480 V
Switchboard kAIC 65 kA
Generator redundancy (IT main bus) Distributed redundant
IT Power path Dual
IT space UPS capacity, per powertrain 2500 kW
IT space UPS redundancy Distributed redundant
IT space UPS runtime @ rated load 5 minutes
IT space UPS output voltage 480 V
Total amps (facility cooling bus, each) 1600 A
Input voltage (facility cooling bus) 480 V
Switchboard kAIC (facility cooling bus) 35 kA
Generator redundancy (facility cooling
2N
bus)
FACILITY COOLING Value Unit
Total max cooling capacity (chillers) 4976 (Dallas), 5450 (San Francisco) kW
Input voltage 480 V
Heat rejection medium Chilled water
Chiller redundancy N+1
Outdoor heat exchange Packaged chiller with free cooling
68 – 70
CW supply temperature °F
68-70
CW return temperature 86 °F
CW supply temp (IT Room 2, to CDUs) 88 °F
CW return temp (IT Room 2, from CDUs) 104 °F
Combined* storage tank size 989 ft3
Ride-through time 5 minutes
Outdoor ambient temperature range 11.1 to 110.5 °F
Economizer type Water-side
*Summation of all three chilled water loops
Renew
How do I renew my solution?
Document
Email Number RD100DS
[email protected] for further assistance Revision 1