Documente Academic
Documente Profesional
Documente Cultură
www.siemens.com/tip-cs
1. Introduction: busbar trunking systems
Short innovation cycles in information technology and the Whereas the US-influenced part of the DaC market (DaC:
dynamics of changing customer requirements in the data data centre) prefers power distribution using point-to-point
centre market aggravate the operator's capacity planning. distribution boards (with PDUs – power distribution units –
Besides the call for high availability of the data centre, these and radially outgoing cables), the European-influenced DaC
factors significantly influence the planning of electric power market more and more frequently uses line distribution with
distribution. A technology that easily and quickly adapts to busbar trunking systems (BTS) and distributed tap-off units
varying spatial settings – using standardised modules is (Fig. 1). As we will demonstrate below, the use of busbar
becoming more and more important. In this situation, it trunking systems with tap-off units at variable positions is
shall be possible to gear the components, plants, and sys- the method of choice to implement a flexible and modular
tems for power distribution to changed room structures, kit system. In analogy to the PDU, this is here called an
new customer and task settings as well as requested load L-PDU.
management requirements. We will demonstrate below that
At first, we will present the advantages of power distribu-
busbar trunking systems for line distribution to data centre
tion using busbar trunking systems compared to cable-ori-
server rooms are very well suited to meet these demands.
ented solutions. Then, we will describe the framework
To simplify the description, they are referred to as L-PDUs
parameters of the server room and power distribution to the
(line power distribution units).
server racks. The functional concept for designing an L-PDU
In contrast to a costly and resource-consuming oversizing, a is then implemented for the server room acting as an exam-
modular concept with clear structures and few, well ple, and a type synopsis will be derived from it. Thus, the
matched components is the option of choice. The system- space requirements for different configurations will be esti-
atic design of the IT power supply catering for different rack mated and possible optional features of the L-PDU tap-off
configurations is exemplified by the typical power demand units will be listed up. Finally, implementation examples in
for a server room in the range of about 600 kW. SIMARIS design will be introduced and the technical back-
ground of selectivity and back-up protection for the pre-
The most important aspect of data centre operation is a ser-
sented solutions will be explained.
vice availability as high as possible. Increasing the IT availa-
bility can, for example, be achieved by curbing dangers in
the server room. This can be done by reducing fire loads and
improving the accessibility and change options of the power
supply system.
Distribution
busbar
Transmission busbar
Generator
Distribution
busbar
Generator
Fig. 1: Comparison of solutions for power distribution using cables or busbar trunking systems (BTS) in the data centre
2
2. Comparison of power supply solutions using BTS or cabling
Compared to conventional cable installation, BTS provides provide a much greater flexibility of rack connections during
many power system and plant engineering advantages, as ongoing service. The cost comparison between BTS and
illustrated in the synopsis in Tab. 1 and Fig. 1. Modifications cable solutions also reflects advantages of up to 30% (see
and conversions of the electric power supply system usually bibliographical note /1/) in favour of BTS. An important
mean a significantly higher time and cost expense if cable reason for this is the lower operating cost due to lower
installations are involved than in the case of a BTS solution. energy losses when using BTS.
Besides the considerable installation time saving, BTS also
Line-type topology using serial load feeders Cable agglomeration at the feed-in point due to the
Network topology
implemented with power tap-off units radial supply of loads
Freedom from Busbar trunking units are free from halogens as a Standard cables are not free from halogens and PVC;
halogens and PVC matter of principle halogen-free cables are expensive
3
Compared to cabling, a solution featuring BTS for power bled busbar trunking units, and by doubling transmission
supply in the server room is also beneficial in case of an busbar trunking systems, as shown in Fig. 2, the rack perfor-
intended subsequent performance increase of individual mance can easily and safely be doubled, in parts even with
racks. By splitting the distribution busbar trunking systems, existing material. In case of a cable solution, the entire
by means of the easy and fast replacement of pre-assem- power distribution system in the server room (all cables and
PDUs) must be replaced and connected again.
A typical situation in data centres is that servers and IT equip- • Power transmission to and in the server room is imple-
ment with different power requirements are connected to the mented by a transmission busbar trunking system, which is
power supply system. Moreover, frequent changes in the sometimes referred to as backbone distribution in the
structuring and use of the server room must be expected in server room (comparable to the backbone in the human
data centres, so that a variable and modular concept is nervous system, the core data line in IT is also called the
advantageous for power supply in the server room. The backbone). In a redundant supply system, two transmission
design of BTS and the standardized outfit of the tap-off units busbar trunking systems (A/B) are usually routed through
are ideally suited for use in such a concept. the server room.
In particular, the modules presented below can be integrated • Power distribution from the transmission busbar trunking
into power supply concepts for data centres. Such a concept system to the server racks is either performed using
which ranges from the medium-voltage level to the connec-
- 4 busbar lines
tion of the servers and other power consumers is described in
(standard BTS with 250 A operating current each)
the application manual /1/.
in case of a rack power demand of less than 10 kW
The framework parameters of the power supply modules are
or
as follows:
- 2 busbar lines
• For a server room an electric power demand in the range of
(standard BTS with 630 A operating current each)
600 kW is assumed.
in case of a rack power demand of equal to or greater
than 10 kW
4
Fig. 3 schematically shows power supply in the server room the typical components of the modules and the selected
for the two different power distribution systems. Tab. 2 lists product series.
1 1
2 2
..... .....
2 2
3 Distribution BTS: BD2A 630 A (2 x ca. 435 kW)
.....
3
4
.....
4
Distribution BTS: BD2A 250 A (4 x ca. 170 kW)
Fig. 3: Supply variants in the server room in case of a rack power of less than 10 kW, and equal to or greater than 10 kW
Protection of tap-off units on the transmission busbar MCCBs (e.g. 3VL or 3VA)
trunking system
Measuring / Monitoring in the tap-off units on the trans- 7KM PAC4200 measuring devices
mission busbar trunking system
Power distribution from the transmission busbar trunking SIVACON 8PS, BD2 system
system to the server racks
Measuring / Monitoring in the tap-off units in the distribu- 7KM PAC3100 measuring devices
tion board
5
4. Typical configurations for the selected power category of the server room
For a power demand in the range of 600 kW, typical outfits Matching the different configurations, Tab. 4 lists the devices
can be defined in dependency of the rack power. 3 kW, used as modules and summarizes some specific data. Fig. 4
4.5 kW, and 6 kW are chosen as typical rack power values for to 9 depict the modules schematically.
1-phase supply, and 10 kW, 15 kW, and 20 kW for 3-phase
The individual configurations of the tap-off units are summa-
supply.
rized in a sample file for SIMARIS design (DaC_tap-off_units_
In order to optimally utilise the distribution busbar tap-off versions_v1.sd) which is attached to this PDF file edition of
units, they are either equipped with 2 or 4 items of the the Technical Series.
3-pole, or 3 or 6 items of the 1-pole MCBs. For a better trans-
parency of the configuration, 6 or 8 tap-off units are used per
line (see Fig. 4 to 9). Together with the corresponding MCBs,
this results in different total power values, as given in Tab. 3.
2 lines 2 lines
Backbone BTS
LIA1000 LIA1000
Quantity 4 2
Quantity 8 6 8 8 6 8
6 x per ToU 6 x per ToU 3 x per ToU 4 x per ToU 4 x per ToU 2 x ToU
5SY8516-7... 5SY8525-7... 5SY8532-7... 5SY8616-7... 5SY8625-7... 5SY8632-7...
MCBs
or or or or or or
5SY7516-7... 5SY7525-7... 5SY7532-7... 5SY7616-7... 5SY7625-7... 5SY7632-7...
Tap-off units
(ToU) Nominal
16 A, 1-pole, 25 A, 1-pole, 32 A, 1-pole, 16 A, 3-pole, 25 A, 3-pole, 32 A, 3-pole,
current,
characteristic
C C C C C C
Measuring 1 x per ToU 1 x per ToU 1 x per ToU 1 x per ToU 1 x per ToU 1 x per ToU
device 7KM PAC3100 7KM PAC3100 7KM PAC3100 7KM PAC3100 7KM PAC3100 7KM PAC3100
7
Fig. 5: DaC module with 144 x 4.5 kW racks
8
Fig. 7: DaC module with 64 x 10 kW racks
9
5. Dimensioning with SIMARIS design and selectivity evaluations
Fig. 10 shows the configurations for the 6 different rack to the faulty circuit. Thus, the downstream device is pro-
power variants together with electric power distribution from tected by the upstream one (this is called "back-up protec-
the medium-voltage level to the busbar tap-off units (compa- tion"). This allows to attain a much more cost-effective
rable with the SIMARIS design sample file dimensioning.
DaC_tap-off_units_versions_v1.sd).
In the module example with the 6 kW racks (Fig. 11, top)
Fig. 11 comprises the SIMARIS network diagrams for the some of the MCBs in the tap-off units on the distribution bus-
1-phase example with 6 kW and the 3-phase with 20 kW rack bar trunking system are fully selective (green), since the max-
power. SIMARIS design allows to identify the selectivity of the imum short-circuit current Ikmax at the circuit "start point" is
individual protective devices by different colours. Green already below the selectivity threshold for the trip short-cir-
means full selectivity of the protective device, whereas yellow cuit current Isel-kurz of the combination of switching devices
indicates that the protective device is only selective to the (here: MCCB 3VL and MCB 5SY). The partial selectivity of the
upstream protective device up to a certain short-circuit cur- other MCBs (marked in light orange) becomes clear in the
rent Isel-kurz. The maximum short-circuit current Ikmax, which selectivity diagrams taken from SIMARIS design (exemplified
was calculated by SIMARIS design effective at the protective in Fig. 12). In the range between 14.7 kA and 19.7 kA, it is
device, may possibly be greater than Isel-kurz, so that under not reliably ensured that only the protective switching device
unfavourable conditions, the upstream protective device will assigned to the fault location will trip – here the MCB 5SY –
trip together with the protective device which was assigned but it is also the upstream protective switching device – here
the MCCB 3VL – which could respond simultaneously.
MS-LS 1.1A1
Circuit-breaker CB-f AR
In (switch) = 630 A
Transformer current = 50/1 A
UMZ: 7SJ8011
MS-K/L 1.1A1
50 m N2XS2Y, VPE 3 x 35
Trafo 1.1A1
Sn = 1,250 A, ukr = 6 %
20/0.4 kV Dyn5
4GB61673DY001AA0
30 m busbar
LI-AM20005H-55
NS-LS 1.1A1
Circuit-breaker
In = 2,000 A
3WL11202EB311AA2/LSIN
NS-LS 2.1A1
Circuit-breaker
In = 1,000 A
3WL12123EB311AA2/LSIN
Cable/line
5m
Cu 3(3x185/185/95)
TN-S Un = 400 V Server room with different rack power inputs
Transport busbar
25 m
LI-AM10005H-55 Rack 3kW, 1-phase Rack 4.5kW, 1-phase Rack 6kW, 1-phase
In = 13 A In = 19.5 A In = 26 A
Un = 230 V Un = 230 V Un = 230 V
1+N-pole 1+N-pole 1+N-polel
Distribution busbar
3VL37251DC360AA0/LI
10 m 10 m 10 m
Cu 1(3x120/120/70)
BD2A-2-250
MCB tap-off unit MCB tap-off unit MCB tap-off unit Dummy load
In = 250 A
Cable/line
25 m
5m 6m 7m 20 m
3VL57631SE60AA0/LSI
10 m 10 m 10 m
Cu 2(3x185/185/95)
BD2A-2-630
MCB tap-off unit MCB tap-off unit MCB tap-off unit Dummy load
In = 530 A
Cable/line
25 m
5m 6m 7m 20 m
Fig. 10: SIMARIS design sample for L-PDU configurations with different rack power values
10
MS-LS 1.1A1
Circuit-breaker CB-f AR
In (switch) = 630 A
Transformer current = 50/1 A
UMZ: 7SJ8011
MS-K/L 1.1A1
50 m N2XS2Y, VPE 3 x 35
Trafo 1.1A1
Sn = 1,250 A, ukr = 6 %
20/0.4 kV Dyn5
4GB61673DY001AA0
30 m busbar
LI-AM20005H-55
NS-LS 1.1A1
Circuit-breaker
In = 2,000 A
3WL11202EB311AA2/LSIN
NS-LS 2.1A1
Circuit-breaker
In = 1,000 A
3WL12103EB311AA2/LSIN
Cable/line
5m
Cu 3(3x185/185/95)
TN-S Un = 400 V
Server room with 96 x 6 kW racks
Transport busbar
15m
LI-AM10005H-55 Rack 1.1 Rack 1.2 Rack 1.3 Racks 1.4 to 1.21 Rack 1.22 Rack 1.23 Rack 1.24
In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A
Un = 400 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V
Distribution busbar 1
3VL37251DC360AA0/LI
10 m 10 m 10 m 10 m 10 m 10 m
Cu 1(3x120/120/70)
BD2A-2-250
MCB tap-off unit MCB tap-off unit MCB tap-off unit Dummy load MCB tap-off unit MCB tap-off unit MCB tap-off unit
In =250 A
Cable/line
Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker In = 156 A Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker
In = 32 A In = 32 A In = 32 A Un = 400 V In = 32 A In = 32 A In = 32 A
20 m
5m
4m 4.5 m 5m 12 m 18 m 18.5 m 19 m
Rack 2.1 Rack 2.2 Rack 2.3 Racks 2.4 to 2.21 Rack 2.22 Rack 2.23 Rack 2.24
In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A
Un = 230 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V
Distribution busbar 2
3VL37251DC360AA0/LI
10 m 10 m 10 m 10 m 10 m 10 m
Cu 1(3x120/120/70)
BD2A-2-250
MCB tap-off unit MCB tap-off unit MCB tap-off unit Dummy load MCB tap-off unit MCB tap-off unit MCB tap-off unit
In =250 A
Cable/line
Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker In = 156 A Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker
In = 32 A In = 32 A In = 32 A Un = 400 V In = 32 A In = 32 A In = 32 A
16 m
5m
4m 4.5 m 5m 12 m 18 m 18.5 m 19 m
Rack 3.1 Rack 3.2 Rack 3.3 Racks 3.4 to 3.21 Rack 3.22 Rack 3.23 Rack 3.24
In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A
Un = 400 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V
Distribution busbar 3
3VL37251DC360AA0/LI
10 m 10 m 10 m 10 m 10 m 10 m
Cu 1(3x120/120/70)
BD2A-2-250
MCB tap-off unit MCB tap-off unit MCB tap-off unit Dummy load MCB tap-off unit MCB tap-off unit MCB tap-off unit
In =250 A
Cable/line
Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker In = 156 A Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker
In = 32 A In = 32 A In = 32 A Un = 400 V In = 32 A In = 32 A In = 32 A
16 m
5m
4m 4.5 m 5m 12 m 18 m 18.5 m 19 m
Rack 4.1 Rack 4.2 Rack 4.3 Racks 4.4 to 4.21 Rack 4.22 Rack 4.23 Rack 4.24
In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A In = 26 A
Un = 400 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V Un = 230 V
Distribution busbar 4
3VL37251DC360AA0/LI
10 m 10 m 10 m 10 m 10 m 10 m
Cu 1(3x120/120/70)
BD2A-2-250
MCB tap-off unit MCB tap-off unit MCB tap-off unit Dummy load MCB tap-off unit MCB tap-off unit MCB tap-off unit
In =250 A
Cable/line
Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker In = 156 A Miniature circuit-breaker Miniature circuit-breaker Miniature circuit-breaker
In = 32 A In = 32 A In = 32 A Un = 400 V In = 32 A In = 32 A In = 32 A
16 m
5m
4m 4.5 m 5m 12 m 18 m 18.5 m 19 m
MS-LS 1.1A1
Circuit-breaker CB-f AR
In (switch) = 630 A
Transformer current = 50/1 A
UMZ: 7SJ8011
MS-K/L 1.1A1
50 m, N2XS2Y, VPE 3 x 35
Trafo 1.1A1
Sn = 1,250 A, ukr = 6 %
20/0,4 kV Dyn5
4GB61673DY001AA0
30 m busbar
LI-AM20005H-55
NS-LS 1.1A1b
Circuit-breaker
In = 2,000 A
3WL11202EB311AA2/LSIN
CB 1.1A.5a
Circuit-breaker
In = 1,000 A
3WL12103EB311AA2/LSIN
Cable/line
5m
Server room with 32 x 20 kW racks
Cu 3(3x185/185/95)
TN-S Un = 400 V
Transport busbar
12m
LI-AM10005H-55 Rack 1.1 Rack 1.2 Racks 1.3 to 1.14 Rack 1.15 Rack 1.16
In = 28.9 A In = 28.9 A In = 28.9 A In = 28.9 A
Un = 400 V Un = 400 V Un = 400 V Un = 400 V
Distribution busbar 1
Cable/line Cable/line
Input distribution busbar
Cable/line Cable/line
10 m 10 m 10 m 10 m
Cu 2(3x120/120/70)
BD2A-2-630
In = 32 A
5m
4m 4.5 m 10 m 14 m 14.5 m
Rack 2.1 Rack 2.2 Racks 2.3 to 2.14 Rack 2.15 Rack 2.16
In = 28.9 A In = 28.9 A In = 28.9 A In = 28.9 A
Un = 400 V Un = 400 V Un = 400 V Un = 400 V
Distribution busbar 2
Cable/line
10 m 10 m 10 m 10 m
Cu 2(3x120/120/70)
BD2A-2-630
MCB tap-off unit Dummy load MCB tap-off unit MCB tap-off unit
In = 630 A
In = 32 A
5m
4m 4.5 m 10 m 14 m 14.5 m
Fig. 11: Network diagram from SIMARIS design for server rooms with 6 kW racks and 20 kW racks
11
104
Rack 1.1
Enveloppe of upstream devices
MCB tap-off unit
Ikmax = 19.708 kA
6 kW, 1-phase Isel-kurz = 14.7 kA
Ikmax = 2,542 A 103 Ikmin = 1.788 kA
Ikmin = 1,788 A
102
101
t [s]
1
*)
MCB tap-off unit
Icu = 30 kA 10-1
5SY86327/C
Selectivity range
between Ikmin
and Isel-kurz
10 -2
Legend, left:
*) The diagram on the right shows the Ikmax value directly at the MCB.
For the further course of rack connection in the left part,
lower Ikmax values would be present, until selectivity is finally reached (green).
Fig. 12: Selectivity diagram for a partially selective MCB in the distribution busbar's tap-off unit for the 6 kW rack solution
Usually, the MCCB will act as back-up protection and limit the Faults in the PDU and the server power supply units will be
short-circuit current, so that the MCB trips without the MCCB selectively cleared by the MCB of the distribution busbar
tripping as well. Under unfavourable conditions, both break- trunking system. This becomes evident from the fault cur-
ers may also trip. rents at the cable end, as shown in Fig. 12:
In SIMARIS design, the relevant short-circuit current values Ikmin = 1.788 kA (relevant for the disconnect condition and
are given in the selectivity diagram – the maximum value at hence for personal safety)
the circuit start point and the minimum value at the circuit
Ikmax = 2.544 kA (relevant for the selectivity evaluation)
end point. Since the maximum short-circuit current values
continually decrease from the circuit start point to the rack Both values are far below the selectivity threshold of this
connection point, it can be expected that only a short circuit device combination (14.7 kA), so that faults occurring in real-
in the vicinity of the MCB inside the distribution busbar tap- ity will be disconnected selectively.
off unit will – in the worst case – result in an MCCB trip in the
Moreover, redundancies existing in the data centre must be
tap-off unit on the transmission busbar trunking system.
considered as well, which is why even a disconnection of one
Owing to the restricted access to server rooms in data cen- distribution busbar trunking system would not mean a fail-
tres, faults in the cable or in the tap-off unit itself can practi- ure. A far-reaching selectivity is ensured for the modules. A
cally be ruled out. Experience has shown that faults at the negligible remaining risk normally has no direct
final distribution level of a data centre almost always occur in consequences.
the power supply units of the IT equipment and the PDUs in
the racks.
12
6. Conclusion
Author:
Ingo Englert, Siemens AG
ingo.englert@siemens.com
Bibliography:
/1/ Siemens AG, 2013, Application Models for Power
Distribution – Data Centres
SIMARIS® design:
Network calculation and dimensioning
of short-circuit current
www.siemens.com/simaris
13
Siemens AG
Energy Management Division
Medium Voltage & Systems
Mozartstr. 31 c
91052 Erlangen
Germany
E-mail: consultant-support.tip@siemens.com
The information in this brochure only includes general All product names may be trademarks or product names of
descriptions and/or performance characteristics, which do Siemens AG or supplier companies; use by third parties for
not always apply in the form described in a specific applica- their own purposes could constitute a violation of the own-
tion, or which may change as products are developed. The er‘s rights.
required performance characteristics are only binding if they
are expressly agreed at the point of conclusion of the
contract.
14
www.siemens.com/tip-cs