Elastic Configuration Rules & Best PracticesV3

Elastic Configuration Rules
&
Best Practices
Dec. 2014
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 2
What changes with “Elastic” configurations?
• New Orders
– Customers will continue to have the option to purchase the
fixed Eighth, Quarter, Half, and Full rack configurations along
with a custom Elastic compute and Storage order.
• Upgrade Orders
– The legacy fixed “Quarter to Half” and “Half to Full” upgrades
will no longer be available. All upgrade orders from previous
rack generations will be flex.
Elastically Scale-Out from Eighth-Rack to
Multi-Rack
Eighth
Quarter
Half
Full
Multi-Rack
• Start with 2 Database Servers and 3 Storage Servers

- Add database or storage servers online as needed
• Can expand older machines with new generation servers
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. Oracle
| Confidential – Internal/Restricted/Highly Restricted 4
What’s new at the rack level
with an Elastic configuration?
• The Storage Expansion rack has been replaced with the “Exadata Expansion
Rack” supporting either all X5-2 database or all X5-2L storage.
– 22 Max Database servers
– 19 Max Storage servers
• Supported configures will include the mixture of High Capacity and Extreme
Flash servers.
• The top rack unit (U41/42) can be populated for specific configurations:
– The max configuration for a Storage Expansion rack increases from 18 to 19.
– ZDLRA will support a storage server in the top rack unit , for a total of 18.
– Some Exadata X5-2 configurations will also support populating the top rack unit with a
storage server
• Introduction of the cable trough (dual purpose)
– As a shipping support bracket if there is an empty slot below a
server.
– Used as an attachment point and storage for cables in empty
slots.
• Ability to order spine switch pre-installed at the factory.
• Support for higher capacity PDU’s
Introducing Exadata X5-2 Extreme Flash (EF) Storage
Server EF
Industry Leading I/O Performance
• All Flash, Scale-out, Highly Available, InfiniBand Connected Smart Storage
• 8x front mounted 1.6TB PCIe flash drives
– State-of-the-art NVMe interface optimized for low-overheard
– No flash cache misses, so predictably low flash response times
• Replaces High Performance (HP) disk configuration
– Similar capacity – 12.8 TB Extreme Flash vs 14.4 TB High Performance Disk
X5-2 DB Machine Rack with Extreme Flash Storage vs. X4-2

160% Faster Analytic Scans 263 GB/s Data Scans from SQL
25% Lower Latency OLTP IO Reduce Flash I/O Latency by 25%
10%More
55% to 20%
FlashLower Power
OLTP Reads 4.14M 8K Read IOPs from SQL
10% More
110% to 20% Lower
Flash OLTPPower
Writes 4.14M 8K Write IOPs from SQL
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted
Exadata X5-2 High Capacity (HC) Storage Server
More Flash, Higher Performance HC
• Tiered, Scale-out, Highly Available, InfiniBand Connected Smart Storage
• 12 front mounted 4 TB High Capacity Disks – 672 TB per Rack
• 4x 1.6TB PCIe flash cards per storage server
– State-of-the-art NVMe interface optimized for low-overheard
– Smart Flash Cache intelligently manages flash
X5-2 DB Machine Rack with High Capacity Storage vs X4-2

25% Lower Latency Flash IOPs
100% Larger Flash Cache 89.6 TB RAW (no hardware compression)
10% to 20% Lower Power
25% Lower Latency OLTP IO Reduce OLTP I/O waits by 25%
10% to 20% Lower Power 4.14M 8K Flash Read IOPs from SQL
55% More OLTP Flash Reads
37% More OLTP Flash Writes 2.69M 8K Flash Write IOPs from SQL
40% Faster Analytic Scans 140 GB/s Data Scans from SQL
Zero Planned Hardware Maintenance Disk Controller Battery Eliminated
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Exadata Elastic Scale-Out Configuration
Enables Incremental Expansion and New Workloads: In-Memory DB, All-Flash OLTP
X5-2 Quarter • Start with a Quarter Rack

Rack X5-2 Database – 2 Database Servers
Servers – 3 Storage Servers
• Add DB or Storage servers

– Mix EF and HC storage servers in same rack
X5-2 Storage Servers – No need for half rack upgrade, or full rack upgrade
Extreme Flash
• Assembled with requested servers by Oracle
EF – Or add servers incrementally at customer site
– Can add X5-2 servers to older (v2 to x4) machines
High Capacity
HC • Standard Configurations also available
– Eighth Rack, Quarter Rack, Half Rack, Full Rack
Max 22 servers or 38U of servers – Eighth to Quarter Upgrade (Compute, Storage, Both)
Exadata X5-2
Elastic Configuration
Population Rules
Exadata X5-2 Population Rules:
Populate Database Nodes 1st in the following order until none available
1) U16-19 populating towards top of rack (total of 4)
2) U23-26 populating towards top of rack (total of 4)
3) U39-27 populating towards bottom of rack skipping 1 RU (total of 7)
4) U14-02 populating towards bottom of rack skipping 1 RU (total of 7)
The point of the above rules is to have lower positions

open in the event that heavier storage servers are needed
in the same rack.
As always position U01 needs to be left open for the spine

switch.
Exadata X5-2 Population Rules:
Storage Cells(2U) are populated in the following order until none available
1) U02-07 populating towards top of rack (total of 3) # Only Storage nodes will be populated in
these RU
2) U08-15 populating towards top of rack (Total of 4)
3) U27-40 populating towards top of rack (Total of 7)
4) U26-23 populating towards bottom of rack (Total of 2) ** If database server present in RU,
skip
5) U19-16 populating towards bottom of rack (total of 2) ** If database server present in RU, skip
6) U41 populate (total of 1) ** Only can be populated on a small qty of configurations
Note: If there is a mixture of High Capacity and Extreme Flash, the heavier HC storage servers
should be in the lowest positions
Exadata X5-2 Population Rules Visual:
U42 Solid filler U42 U42 Solid filler U42 U42 Solid filler U42 U42 U42
U41 Solid filler U41 U41 Solid filler U41 U41 Solid filler U41 U41 Storage Cell (19) U41
U40 Solid filler U40 U40 Solid filler U40 U40 U40 U40 U40
U39 DB Server (9) U39 U39 DB Server (16) U39 U39 Storage Cell (14) U39 U39 Storage Cell (14) U39
U38 Solid filler U38 U38 Solid filler U38 U38 U38
The number next to the U37
U36
DB Server (10) U37
U36
U37
U36
DB Server (17)
Solid filler
U37
U36
U37
U36
Storage Cell (13) U37
U36
U38
U37
U36
Storage Cell (13)
U38
U37
U36
server represents the order U35

U34
U33
Storage Cell (12)
Storage Cell (11)

U35
U34
U33
U35
U34
U33
DB Server (18)
Solid filler
DB Server (19)
U35
U34
U33
U35
U34
U33
Storage Cell (12)
Storage Cell (11)

U35
U34
U33
U35
U34
U33
Storage Cell (12)
Storage Cell (11)

U35
U34
U33
the server is expected to be U32

U31
U30
Storage Cell (10)
U32
U31
U30
U32
U31
U30
Solid filler
DB Server (20)
Solid filler
U32
U31
U30
U32
U31
U30
Storage Cell (10)
U32
U31
U30
U32
U31
U30
Storage Cell (10)
U32
U31
U30
populated. U29
U28
U28
U29
U28
DB Server (21)
Solid filler
U29
U28
U29
U28
U27
Storage Cell (9)
Storage Cell (8)

U29
U28
U27
U29
U28
U28
U27 Storage Cell (8) U27 U27 DB Server (22) U27 U27 Storage Cell (8) U27
U26 DB Server (8) U26 U26 DB Server (8) U26 U26 DB Server (8) U26 U26 U26
U25 DB Server (7) U25 U25 DB Server (7) U25 U25 DB Server (7) U25 U25 Storage Cell (15) U25
U23 DB Server (5) U23 U23 DB Server (5) U23 U23 DB Server (5) U23 U23 Storage Cell (16) U23
U22 36-Port IB Switch U22 U22 36-Port IB Switch U22 U22 36-Port IB Switch U22 U22 36-Port IB Switch U22
U21 Cisco 4948E-F U21 U21 Cisco 4948E-F U21 U21 Cisco 4948E-F U21 U21 Cisco 4948E-F U21
U18 DB Server (3) U18 U18 DB Server (3) U18 U18 Storage Cell (17) U18
U18 DB Server (3) U18
U17 DB Server (2) U17 U17 DB Server (2) U17 U17 U17
U16 DB Server (1) U16 U16 DB Server (1) U16 U16 Storage Cell (18) U16
U15 U15 U15 U15 U15 U15
U15 Solid filler U15
U14 Storage Cell (7) U14 U14 Storage Cell (7) U14 U14 Storage Cell (7) U14
U13 U13 U13 U13 U13 U13
U12 Storage Cell (6) U12 U12 Storage Cell (6) U12 U12 Storage Cell (6) U12
U11 U11 U11 U11 U11 U11
U10 Storage Cell (5) U10 U10 Storage Cell (5) U10
U10 Storage Cell (5) U10 U10 DB Server (11) U10
U09 U09 U09 U09
U09 U09 U09 Solid filler U09
U07 U07 U07 U07
U05 U05 U05 U05
U03 U03 U03 U03
U01 Solid filler U01 U01 36-Port IB Switch U01
U01 Solid filler U01 U01 Solid filler U01
Exadata X5-2 Elastic Compute and Storage
Rack Constraints
• Up to 22 servers can be installed in the rack, taking up a total of 38 rack units.
• At least 2 database servers and 3 storage servers must be installed in the rack. The
storage servers must all be the same type.
• When adding servers, the additional storage servers can be a mix of X5-2 extreme flash
or high capacity storage servers, and X5-2 database servers.
• The maximum number of database servers allowed in the rack is 22. In this
configuration, there are no Exadata Storage Servers installed in the rack.
• The maximum number of Exadata Storage Servers allowed in the rack is 19. In this
configuration, there are no database servers installed in the rack.
• Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter
InfiniBand Switch 36 switches.
Exadata X4-8 Population Rules
DB nodes to be populated in the following positions
1) DB2: U16 – U20
2) DB3: U24 – U28
3) DB1: U10 – U14
4) DB4: U29 – U33
Storage Cells(2U) are populated in the following order until none available
1) U20 – U09 towards top of rack (total of 4)
6) U41 – U42 (total of 1)
Exadata X4-8 Population RulesVisual
U42 Storage Cell (16) U42 U42 Storage Cell (14) U42 U42 Storage Cell (11) U42 U42 Storage Cell (8) U42
U41 U41 U41 U41 U41 U41 U41 U41
U39 U39 U39 U39 U39 U39 U39 U39
U37 U37 U37 U37 U37 U37 U37 U37
U35 U35 U35 U35 U35 U35 U35 U35
U34 Storage Cell (10) U34 U34 Storage Cell (10) U34 U34 Storage Cell (10) U34 U34 Solid filler U34
The number next to the U33

U32
U31
Storage Cell (9)
U33
U32
U31
U33
U32
U31
Storage Cell (9)
U33
U32
U31
U33
U32
U31
Storage Cell (9)
U33
U32
U31
U33
U32
U31
Database
(X4-8) (4)
U33
U32
U31
server represents the U30

U29
U29
U30
U29
U29
U30
U29
U29
U30
U29
U30
U29
order the server is U28

U27
U26
Solid filler
Storage Cell (15)
U28
U27
U26
U28
U27
U26
Database
(X4-8) (2)
U28
U27
U26
U28
U27
U26
Database
(X4-8) (2)
U28
U27
U26
U28
U27
U26
Database
(X4-8) (2)
U28
U27
U26
expected to be populated. U25

U24
U24
U25
U24
U25
U24
U25
U24
U25
U24
U25
U24
U25
U24
U22 Cisco 4948E-F U22 U22 Cisco 4948E-F U22 U22 Cisco 4948E-F U22 U22 Cisco 4948E-F U22
U20 U20 U20 U20 U20 U20 U20 U20
U19 Database U19 U19 Database U19 U19 Database U19 U19 Database U19
U18 (X4-8) (1) U18 U18 (X4-8) (1) U18 U18 (X4-8) (1) U18 U18 (X4-8) (1) U18
U17 U17 U17 U17 U17 U17 U17 U17
U16 U16 U16 U16 U16 U16 U16 U16
U15 Storage Cell (13) U15 U15 Storage Cell (13) U15 U15 Solid filler U15 U15 Solid filler U15
U14 U14 U14 U14 U14 U14 U14 U14
U13 Storage Cell (12) U13 U13 Storage Cell (12) U13 U13 Database U13 U13 Database U13
U12 U12 U12 U12 U12 (X4-8) (3) U12 U12 (X4-8) (3) U12
U11 Storage Cell (11) U11 U11 Storage Cell (11) U11 U11 U11 U11 U11
U10 U10 U10 U10 U10 U10 U10 U10
U08 U08 U08 U08 U08 U08 U08 U08
U06 U06 U06 U06 U06 U06 U06 U06
U04 U04 U04 U04 U04 U04 U04 U04
U02 U02 U02 U02 U02 U02 U02 U02
U01 Solid filler U01 U01 Solid filler U01 U01 Solid filler U01 U01 Solid filler U01
Oracle Exadata Database Machine X4-8 Elastic
Configuration Restrictions
The following restrictions apply to Oracle Exadata Database Machine X4-8
Elastic Configurations:
1) At least 1 database server and 3 storage servers must be installed in the rack.
The storage servers must all be the same type.
2) When adding servers, the additional storage servers can be a mix of X5-2
extreme flash or high capacity storage servers, and X4-8 database servers.
3) Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun
Datacenter InfiniBand Switch 36 switches.
Number of Database Servers Maximum Number of Storage Servers

4 8
3 11
2 14
Calculating Rack Power and Cooling
Elastic configuration power and cooling values must be calculated for each rack,
based on the maximum wattage for each rack component.
Maximum Wattage for Rack Components
Component Maximum
Wattage
Oracle Exadata Database Machine X5-2 Elastic Configuration database server 727
Oracle Exadata Database Machine X4-8 Full database server 3600
High capacity Exadata Storage Server 535
Extreme flash Exadata Storage Server 597
Sun Datacenter InfiniBand Switch 36 switch 320
Cisco Ethernet switch 275
Calculating Rack Power and Cooling
The following procedure shows how to calculate the power and cooling values for a elastic
configuration:
Calculate the total wattage of each component in the rack using the following equations:
•Oracle Exadata Database Machine X5-2 Elastic Configuration database server
X52DB_qty * 536= total_X52DB_wattage
•Oracle Exadata Database Machine X4-8 Full database server
X48DB_qty * 3600 = total_X48DB_wattage
•High capacity Exadata Storage Server
HCS_qty * 610 = total_HCS_wattage
•Extreme flash Exadata Storage Server
AFS_qty * 510 = total_AFS_wattage
•Sun Datacenter InfiniBand Switch 36 switch
IB_qty * 320 = total_IB_wattage
•Cisco Ethernet switch
275
Add all the component wattages gathered, together to determine the maximum wattage of the rack
•Maximum power in watts (w):

total_X52DB_wattage + total_X48DB_wattage + total_HCS_wattage + total_AFS_wattage + total_IB_wattage + 320 = total_max_w
•Maximum power in volt amperes (Va):

(total_X52DB_wattage+total_X48DB_wattage + total_HCS_wattage +total_AFS_wattage + total_IB_wattage + 320)*1.02 = total_max_Va
Calculating Rack Power and Cooling Cont.
Calculate the total typical power using the following equations:
Typical power in watts: (In the equation, typical_pw_w is the typical rack power in watts.)
total_max_w * 0.7 = typical_pw_w
Typical power in volt amperes: (In the equation, typical_pw_Va is the typical rack power in volt amperes.)
typical_w * 1.02 = typical_pw_Va
Calculate the maximum cooling of the rack using the following equations:
Maximum cooling in BTU/hour: (In the equation, max_cool_BTU is the maximum cooling in BTU/hour.)
typical_pw_w * 3.414 = typical_cool_BTU
Maximum cooling in Kj/hour: (In the equation, max_cool_Kj is the maximum cooling in Kj/hour.)
max_BTU * 1.055 = max_cool_Kj
Calculate the typical cooling using the following equations:
Typical cooling in BTU/hour: (In the equation, typical_cool_BTU is the typical cooling in BTU/hour.)
typical_pw_w * 3.414 = typical_cool_BTU
Typical cooling in Kj/hour: (In the equation, typical_cool_Kj is the typical cooling in Kj/hour.)
typical_cool_BTU * 1.055 = typical_cool_Kj
Calculate the airflow for the rack using the following equations:
Maximum airflow (CFM): (In the equation, max_airflow is the maximum airflow.)
max_cool_BTU * 0.046296 = max_aiflow
Typical airflow (CFM): (In the equation, typical_airflow is the typical airflow.)
typical_cool_BTU * 0.046296 = typical_airflow
New Rack Orders
• The upper IB/Cat5e cable harness will NOT be included unless a server is populated in the upper
half of the rack.
– Following the X5-2 population rules; > 8 database nodes or > 7 Storage Cells will include the
upper harnesses.
– Following the X4-8 population rules; >1 X4-8 database or > 4 Storage Cells will include the
upper harnesses.
• The upper cable harnesses includes 2 discrete Cat5 and IB cables that attach to the top rack unit
to support specific configurations.
• The configurator will dermine the quantity of cable troughs based on the customer order.
– If no upper cable harness, the upper half of the rack will have no troughs.
– The configurator will add 1 Solid filler for every empty RU.
• In a mixed High Capacity/Extreme Flash Storage server environment, the High capacity will
always be populated before the Extreme Flash to prevent a top heavy rack.
– The one exception; If a customer orders < 3 HC servers in a mixed environment, the first 3
extreme flash servers will be populated first. This is a result of the base rack having a minimum
of 3 Storage cells and configurator limitations.
Upgrade Orders
Supporting “Elastic” upgrade orders require some additional
changes from the legacy fixed BOM upgrade model.
• Field Install Server without IB/Cat5 cables – In addition to the Server, the box contents contains;
– 2 Power cords
– 2 Rails
– 1 Cable management arm
• Field Install Server with IB/Cat5 cables - If customers rack is a V2, X2, or Storage expansion rack
X4 or earlier, the box contents will also contain 2 - IB and 2 - Cat5e cables. This is a result of;
– SER X4 or earlier did not include the cable harnesses
– The upper harness will not work for X2 and V2 resulting from the KVM, plus the lower harness for both IB/Cat5 were not
shipped for all configs.
• Upper cable harness kit - Includes the upper IB and Cat5 cable harness along with the discrete
cables that are used for the top rack unit (U41/42). This kit will be included for every upgrade order
that requires a server to be populated in the upper half of the rack except the following;
– V2/X2 – The upper harness will not fit resulting from the KVM
– Storage Expansion X4 or earlier – Rack wired with discrete cables
Note - This will be an orderable option in the configurator, the responsibility

is on Oracle sales to understand when this is required.
Upgrade Orders Cont.
• Trough kit - These troughs will be used for attaching the upper harness
connections when no server is present in the slot. This will be included for
every upgrade order requiring the upper cable harness kit.
• Upgrade accessory Kit – This kit contains 25 yards of velcro used to secure
cables.
• 37Kva PDU – Required if customer has 4 – X4-8 servers in a rack.
• 22/24Kva PDU – Required if upgrading beyond a half rack or > 11 Servers.
Service Upgrades
The following slides will give an overview of the
upgrade process and what to expect with the
“Elastic Compute and Storage” changes. Official
procedures have yet to be created, service should
always refer to the latest upgrade EIS checklist for
the instructions.
Upgrade Overview Checklist
Pre-Site Check
 Verify the customer order
 Contact the customer
 Simulate the rack build following the population rules
 Print the labels
Rack preparation
 Remove fillers, troughs and any cables
Upgrade the Rack
 Installing the trough kit
 Installing the upper harness kit
 Upgrade the PDU if required
 Install the Rails and CMA
 Install the Servers and labels
 Adding Storage cells to all database expansion rack
 Mixed Storage cell upgrade
 Adding Data Base servers
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Restricted 26
Pre-site Check – Order verification
• Verify the quantity of servers ordered are within the rack constraints
• Is the Upper cable harness kit required?
• Do the upgrade servers require discrete cables?
• Does the rack require an updated PDU?
Contacting the customer for;
• Schedule the visit
• Schedule any rack downtime if the upgrade requires powering down servers
• Verify a mechanical lift is available if installing X4-8
• Etc…
Pre-site Check – Printing Labels
Service will be required to print labels used for the power cords, IB and Cat5e
cables.
• Power cords labels will be required for all upgrade servers
• IB and Cat5e labels will only be required when upgrading a V2, X2, or SER X4
or earlier. (These racks will not have harnesses)
The service engineer will need to understand the rack location for the servers to
print the necessary labels.
A blank label sheet is available via FRU PN. This label kit includes the blank label
sheet, the instructions for printing the required labels, and a text file listing all the
different label combinations.
Upgrading The Rack – Installing the troughs
The trough kit is used to attach the unused cable harness connections when no server is
present. The kit will include 10 individually packaged troughs for X5-2 and 13 for X4-8.
Note - The trough kit will only be required when the upper cable harness kit is ordered.
It’s likely the upgrade will not use all troughs included in the kit, please discard any
unused troughs.
Install overview
1) Determine which rack slots will not contain a server
2) Using the #3 driver bit and 4 screws included in the kit, attach the trough to the rear of the rack
3) Repeat for all slots that will not contain a server
4) Discard any extra unused troughs.
Upgrading The Rack
Installing the upper cable harness kit X5-2
The process for adding the upper cable harness is no different than the existing process
needed for the fixed rack upgrades. The only addition will be the 4 discrete cables
running to the top rack unit.
Note – V2, X2, and Storage Expansion X4 or earlier will not support the X5-2 upper
harness kit
How to install the IB and Cat5 harness;

1) Follow existing instructions for the IB and Cat5e cable harness
2) If a server is not present, attach the unused cables to the trough using the velcro included in
the upgrade accessory kit.
3) If a server is present, leave the cable hanging as these will eventually be routed through the
cable management arm.
Upgrading The Rack
Installing the upper cable harness kit X5-2 Cont.
How to install 4 discrete cables;
1) Route the 2 IB and 2 Cat5 discrete cables neatly to the top of the rack (U41).
2) If no server is present in the top RU, attach the switch end of the cables to the rack and the
server end to the trough.
3) If the population rules require a Storage server in the top rack unit, the following steps need to
be taken.
Cat5 Cable – Attach the “server end” of the cable to the server and the “switch end” of the cable to
the Cisco Switch Port 15(MGMT) & 16(ILOM). This requires removing rack unit 26 Cat5 connection
from Port 15/16 and replacing with these cables. (Tie off RU 26 switch end of the cables)
IB Cable - Attach the “server end” of the cable to the server and the “switch end” to the
NM2(Server Port 1= 6B of NM2 in Slot 22 /Server Port 2= 6B of NM2 in Slot 20)
Upgrading The Rack - Upgrading the PDU
Not all upgrades require a larger PDU, only the following configurations;
• The 2 Socket Exadata requires a larger PDU when updating an existing half rack or a customer
upgrade will contain > 11 servers.
• The 8 socket Exadata requires an updated PDU when 4 – X4-8 will be included in a rack.
When upgrading the PDU, always follow the latest power cord SPEC included in the Owners Guide
or EIS Checklist. X5 has made some slight changes to rebalance the loads, upgrading an older
generation rack might require moving existing server power cords to different groups.
Note – At the time this course was writen the procedure to upgrade the PDU has not been
created.
Upgrading The Rack
Installing X5-2 Servers and Labels
The basic server installation process has not changed from the existing X4-2 procedures,
but includes a few additional steps as a result of Flex.
1) Determine if you have a mixed environment of HC and EF. If so, Add the HC first as these are
heavier.
2) Remove the server from the packaging
3) Attach the rails to the server
4) Insert the server in the rack
5) Remove the power cords and add the appropriate label matching the rack slot
6) Insert the power cords into the server and PDU
7) A. If the server did not arrive with IB/Cat5 cables, insert the cable harness connections to the
server
B. If the server arrived with cables (V2, X2, SER X4 or earlier), then;
1. Remove the 2 IB and 2 Cat5 cables and add the appropriate labels.
2. Route the cables through the CMA
3. Follow the SPEC and route the cables from the server to the correct switch ports
Upgrading The Rack
Adding X4-8 Server and Labels
Exadata X4-8 flex will support up to a max of 4 – X4-8 servers. Because of the weight of
the system, a mechanical lift is required for installing the system into the rack. We are
currently investigating if removing components to make this less heavy is an option for
geographies without a lift.
Note: At the time this course was written the official procedure has not been created,
but can be assumed it will follow the base requirements.
1. Remove the server from packaging
2. Install the rails
3. Label the IB and Cat5 Cables
4. Label the Power cord
5. Install the Server
Upgrading The Rack
Data Base Expansion Rack
At the time this course was written all policies regarding upgrades of the Data
Base expansion racks have not been finalized.
If a customer has an all database “expansion” rack and is allowed to add storage
cells, some configurations will require the database servers to be relocated to
avoid a top heavy rack.
Note 1 – The all database rack rules deviates from X5-2 rules to avoid a top heavy rack.
Note 2 – The following examples are simplified rules to avoid a top heavy rack.
Upgrading The Rack All Database Node
Example 1: U35 Solid filler U35
Adding 3 Storage cells to a 12 database U33 Solid filler U33
expansion rack U31 Solid filler U31
1) If the lower half of the rack has open space, add U30
U29
Solid filler
Solid filler
U30
U29
the storage cells following the existing X5-2 U28
U27
Solid filler
Solid filler
U28
U27
population rules. U26 DB Server (8) U26

U22 36-Port IB Switch U22
U21 Cisco 4948E-F U21
Storage Cell (3) U05 Solid filler U05
U03
Solid filler
Solid filler
U04
U03
U01
Solid filler
Solid filler
U02
U01
Upgrading The Rack
Corner Case All Database Node U42
U41
U40
U39
Solid filler
Solid filler
Solid filler
Solid filler
U42
U41
U40
U39
Example 2 U36 Solid filler U36
Adding 10 Storage cells to a 12 database Storage Cell (8) U34 Solid filler U34
expansion rack Storage Cell (7) U33

U32
Solid filler
Solid filler
U33
U32
1) Add the storage cells following the existing X5-2 Storage Cell (6) U31
U30
Solid filler
Solid filler
U31
U30
population rules in the open space in the bottom Storage Cell (5) U29
U28
Solid filler
Solid filler
U29
U28
2) Once all space fills up in the lower half, begin U25 DB Server (7) U25
populating the upper half with Storage cells that; U23 DB Server (5) U23
36-Port IB
U22 Switch U22
Equal to the amount of storage cells in the lower U21 Cisco 4948E-F
36-Port IB
U21
half + half of the quantity of database servers U20 Switch U20
below U14. (3 SC + 4DB/2 = 5) Storage Cell U19 DB Server (4) U19

(10) U17 DB Server (2) U17
3) Once this threshold is reached, the remaining Storage Cell (9) U15 Solid filler U15
storage cells need to be swapped with the lower U13
U12
Solid filler
DB Server (10)
U13
U12
half database nodes. U11 Solid filler U11
Upgrading The Rack
All Database Node U42
U41
U40
Solid filler
Solid filler
Solid filler
U42
U41
U40
Example 3 U37 Solid filler U37
Adding > 3 Storage cells to a 15 database expansion U35 Solid filler U35
rack U34
U33
Solid filler
Solid filler
U34
U33
If the lower half is filled with database servers and we are U32
U31 Storage Cell (3)
U32
U31
adding greater than 3 Storage cells, then we need to move U30 U30
U29 Storage Cell (2) U29
the database servers starting in U02 and add it in the U28 U28
U27 Storage Cell (1) U27
upper half and replace it with the storage cell. (Follow the U26 DB Server (8) U26
X5-2 population rules on where to add the Database and U25
U24
DB Server (7)
DB Server (6)
U25
U24
Storage servers) U23 DB Server (5) U23

U21 Cisco 4948E-F U21

Storage Cell (4) U10 DB Server (11) U10
Upgrading The Rack
Mixing Storage Cells
The High Capacity server is heavier than the extreme flash servers by 11
pounds. If upgrading a X5-2 high capacity server rack with extreme flash
servers, follow the below guidelines.
The upper half rack of the rack should weigh less than the lower half.
1) Following the population rules and calculate the lower half and upper half weight for all
the servers to be included in the rack.
2) If the upper half is heavier, the lower half extreme flash servers will need to be
swapped with High capacity servers.
3) Schedule a time with the DBA to perform the swap.
Database Servers = 36 pounds

High Capacity Servers = 66 pounds
Extreme Flash Servers = 55 pounds
Upgrading The Rack High Capacity
U42
U41
Solid filler
Solid filler
U42
U41
Mixing Storage Cells

High Capacity U38 Solid filler U38
Example High Capacity U33
U32
Solid filler
Solid filler
U33
U32
Customer with 7 Extreme Flash and 4 High Capacity U31
U30
Solid filler
Solid filler
U31
U30
Database nodes wants to add 8 High High Capacity U29 Solid filler U29
Capacity and 2 Database nodes. U26 Solid filler U26
DB Server (6) U25 Solid filler U25
DB Server (5) U23 Solid filler U23
1. Upper Half weight = 600 U22 36-Port IB Switch U22
Lower Half weight = 529 U21
U20
Cisco 4948E-F
36-Port IB Switch
U21
U20
2. Upper half is too heavy, this is a tip concern. U19
U18
DB Server (4)
DB Server (3)
U19
U18
3. Need to swap 4 High capacity in the upper half U17
U16
DB Server (2)
DB Server (1)
U17
U16
with 4 Extreme flash in the lower half. U15 U15
U14 Extreme Flash U14
Lower Half weight = 573 lbs U13 U13
Upper Half weight = 556 lbs U11 U11
U09 U09
U07 U07
U05 U05
U03 U03

Elastic Configuration Rules & Best PracticesV3

Încărcat de

Informații document

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Elastic Configuration Rules & Best PracticesV3

Încărcat de

Drepturi de autor:

Formate disponibile

Elastic Configuration Rules

• Start with 2 Database Servers and 3 Storage Servers

X5-2 DB Machine Rack with Extreme Flash Storage vs. X4-2

X5-2 DB Machine Rack with High Capacity Storage vs X4-2

X5-2 Quarter • Start with a Quarter Rack

• Add DB or Storage servers

The point of the above rules is to have lower positions

As always position U01 needs to be left open for the spine

server represents the order U35

Storage Cell (11)

Storage Cell (11)

Storage Cell (11)

the server is expected to be U32

Storage Cell (8)

The number next to the U33

server represents the U30

order the server is U28

expected to be populated. U25

Number of Database Servers Maximum Number of Storage Servers

Maximum Wattage for Rack Components

•Maximum power in watts (w):

•Maximum power in volt amperes (Va):

Note - This will be an orderable option in the configurator, the responsibility

• 37Kva PDU – Required if customer has 4 – X4-8 servers in a rack.

• 22/24Kva PDU – Required if upgrading beyond a half rack or > 11 Servers.

• Is the Upper cable harness kit required?

• Do the upgrade servers require discrete cables?

• Does the rack require an updated PDU?

Contacting the customer for;

• Schedule the visit

• Verify a mechanical lift is available if installing X4-8

How to install the IB and Cat5 harness;

U25 DB Server (7) U25

expansion rack Storage Cell (7) U33

half + half of the quantity of database servers U20 Switch U20

below U14. (3 SC + 4DB/2 = 5) Storage Cell U19 DB Server (4) U19

U22 36-Port IB Switch U22

U20 36-Port IB Switch U20

Database Servers = 36 pounds

Mixing Storage Cells

S-ar putea să vă placă și