02 CRS1 System Overview XR381

Cisco CRS-1
Platform Introduction Training
CRS-1 Training / lwigley
2005 Cisco Systems, Inc. All rights reserved.
Cisco Public
CRS-1 Platform Introduction Agenda

System Highlights & Roles in SP Networks
HW Introduction & System Architecture
Line Card Architecture
Switch Fabric
Mechanicals & Site Planning
Cisco Public

Switch Fabric
Cisco Public
CRS-1 Router Family (XR 3.3)

CRS-1/16, Fabric Chassis, and CRS-1/8
Cisco Public
CRS-1 Router Family (XR 3.4 & 3.5)
CRS-1/4 chassis offers reduced height, weight and depth
4 Slot Depth
27 in / 69 cm
8 Slot Depth
35-40 in / 89-102 cm
Cisco Public
CRS-1/4
Front and Rear View
Cisco Public
CRS-1 System Highlights

Scalable from 1 to 72 chassis (up to 92 Tbps or 1152 40G cards)
4, 8, or 16 slots of 40 Gbps performance per chassis
Service flexibility via micro-coded forwarding
Runs IOS XR micro-kernel based operating system
Carrier Class redundancy in all major components
Carrier Class resilience against network attacks
Industry leading QoS features throughout forwarding path
Scalable control plane and Secure Domain Routing
Cisco Public
Roles in Service Provider Networks - 2005
Backbone
to peers
Service Edge
Aggregation
7xxx 7xxx 10xxx
12000
12000
12000
12000
7xxx 7xxx 10xxx
Cisco Public
CRS-1 Roles Initial Deployments
to peers
7xxx 7xxx 10xxx

12000
12000
12000
12000
7xxx 7xxx 10xxx
Cisco Public
CRS-1 Roles POP Consolidation
to peers
7xxx 7xxx 10000

12000
12000
12000
12000
7xxx 7xxx 10000

CPE
Cisco Public
10

Switch Fabric
Cisco Public
11
HW Introduction & System Architecture Agenda
High Level Logical and Physical

Multi-chassis Introduction
Route Processors
Forwarding Components
Cisco Public
12
CRS-1 Hardware Introduction

16 slot Line Card
Chassis with
integrated rack
8 slot Line Card

Chassis rack mountable
External
Interfaces (PLIM)
Redundant
Route Processors
Fabric Card
Chassis
Front and Rear
Access Required
MSC and Fabric
Access - Rear
Cisco Public
13
CRS-1 High Level Logical Architecture

RP (active)
Routing to
IGP/BGP Peers
PLIM
Packets
In
PLIM
PLIM
PLIM
PLIM
PLIM
PLIM
PLIM
Stats
Pkts for CRS
CEF Tables
Routing Pkts
M
I
D
P
L
A
N
E
MSC
M
I
D
P
L
A
N
E
MSC
MSC
MSC
MSC
MSC
MSC
MSC
DRP
RP (standby)
M
I
D
P
L
A
N
E
M
I
D
P
L
A
N
E
F
A
B
R
I
C
S1
F
A
B
R
I
C
S1
F
A
B
R
I
C
S2
F
A
B
R
I
C
S3
F
A
B
R
I
C
S3
M
I
D
P
L
A
N
E
MSC
M
I
D
P
L
A
N
E
MSC
MSC
MSC
MSC
MSC
MSC
MSC
Routing to
IGP/BGP Peers
M
I
D
P
L
A
N
E
PLIM
M
I
D
P
L
A
N
E
PLIM
PLIM
PLIM
Packets
Out
PLIM
PLIM
PLIM
PLIM
Cisco Public
14
CRS-1 High Level Physical Architecture

Line Card Chassis (LCC)
RP System Master
PLIM & MSC Packet Forwarding
Switch Fabric LC/LC & RP/LC Path
Fans and Controllers - Cooling
Air Intake and Exhaust - Cooling
Power Supplies AC or DC
POWER
SUPPLIES
CRS-1
CABLE MGMT
PLIM
FAN
CTRL
PLIM
PLIM
R R
P P
PLIM
AIR
INTAKE
16 Slot
CABLE MGMT
D
R
P
PLIM
RR
PLIM
PP
P
L
I
M
R
P
PLIM
R
P
M
S
C
AIR INTAKE
POWER SUPPLIES
POWER SUPPLIES
Front View
M
S
C
AIR INTAKE
8 Slot
AIR OUT
FAN TRAY
FAN TRAY
CRS-1
CABLE MGMT
POWER
SUPPLIES
4 Slot
AIR OUT
FFFF
AAAA
BBBB
FF
AA
BB
D
R MSC
P
FF
F
A
B
MSC R MSC
I
C
CABLE MGMT
MSC
AA
BB
FAN TRAY
AIR OUT
F
A
B
MSC R MSC
I
C
FAN TRAY
POWER SUPPLIES
4 Slot
8 Slot
16 Slot
Rear View
Cisco Public
15
CRS-1 Multi-chassis Components

POWER
SUPPLIES
POWER
SUPPLIES
AIR
OUT
CRS-1
FAN TRAY
SWITCH
FABRIC
S
H
E
L
F
C
T
R
L
L
E
D
S
FIBER
OIMS
Cat6500
CABLE MGMT
SWITCH
FABRIC
S
H
E
L
F
C
T
R
L
L
E
D
S
Cat6500
FIBER
OIMS
Control Ethernet
Switches
FAN TRAY
AIR
INTAKE
Line Card
Chassis
Fabric Chassis
Front View
Fabric Chassis
Rear View
Cisco Public
16
CRS-1 Multi-chassis
Single to Multi-chassis upgrade w/o packet loss
Moves fabric stage 2 to separate chassis
Upgrade LCC fabric cards
Add fabric card chassis (FCC)
FCC Optical
Connections
Connect control GE to Catalyst switches

Connect LCC and FCC with fiber bundles
Optical Array
Cable (100m)
72 Fiber
Bundle
Cisco Public
17
CRS-1 Multi-chassis
Upgraded fabric
cards in LCC
Fabric Chassis
Cisco Public
18
CRS-1 Route Processor Hardware

Route Memory
CPU
Console/Aux
Mgmt Ethernet
Status LEDs
GE for multi-chassis
control network
Internal disk0
External disk1
Internal hard disk
Cisco Public
19
Route Processor Functional Overview

System master - leads system initialization & operation
Elects primary RP (all systems have redundant RPs)
Coordinates fabric, MSC, and PLIM boot
Provides physical console access, mgmt Ethernet, and boot media
Onboard disk for logging
Executes routing protocols

BGP, OSPF, ISIS, EIGRP, RIP, LDP, MPLS-TE,
Builds forwarding tables and sends to MSCs
2 GE for multi-chassis control

Different RPs for 8 & 16 slot
16 slot chassis RP has 2 CPUs
8 slot chassis RP has 1 faster CPU
Cisco Public
20
Distributed Route Processor HW Overview

2 Cards DRP PLIM and DRP CPU
Inserted into PLIM and MSC slots
Provides 2 additional routers
Each has independent route memory, flash, disk, pair of CPUs
Used for process placement and Secure Domain Routers

Both RPs in an DRP must be in the same SDR
Enables unlimited control plane scalability
DRP PLIM
DRP CPU
Cisco Public
21
CRS-1 RP Hardware Summary
CPUs
Chassis
Memory
Mgmt
Eth
Flash
PCMCIA
Disk
RP-8
RP-16/B
DRP/B
1x 1.2GHz PPC
2x 1.2GHz PPC
2x (2x1.2 GHz) PPC
CRS-1/16
ALL
2-4 GB
2-4 GB
2 x 4 GB
1x 10/100/1000
1x 10/100/1000
2x 10/100/1000
CRS-1/8
CRS-1/4
1 GB Internal
1 GB Internal
2x 1 GB Internal
1 GB External
1 GB External
2x 1 GB External
40 GB
40 GB
2x 40 GB
Cisco Public
22
CRS-1 MSC Functional Overview

Receives forwarding table from active RP/DRP
Ingress and egress packet forwarding
Performs packet forwarding, buffering, and features
IPv4/v6 Lookups and MPLS Lookup
ACL, WRED, Policing, MDRR, and other per-packet features
Implements first line of router self defense

Segments/Reassembles packets into/from cells
Cisco Public
23
CRS-1 PLIMs (IOS XR 3.3)

Paired with MSCs
Implement OSI L1/L2
Fixed PLIMs
POS 1x OC768, 4x OC192, 16x OC48
POS - Tunable Wavelength OC768
TenGE 8xTenGE, 4x TenGE Tunable WDM
Flexible PLIMs - SIP-800 (6 SPA bays)

POS 1x OC192, 4xOC3, 8xOC3/OC12
GE 8xGE
Oversubscription allowed with Ethernet
Cisco Public
24
CRS-1 Hardware (Additions in IOS XR 3.4)

Fixed PLIMs
DPT OC48, OC192 (on existing PLIM HW)
SPAs
POS 2xOC48, 4xOC48
GE 5/8/10xGE (v2)
TenGE 1xTenGE (v2)
FCC-SC-22GE (3.4.1) MC integrated Switch

SPAs (3.4.1)
2/4xT3/E3
OC192POS-VSR
Cisco Public
25

SPA (3.5.2)
10GE WAN PHY
Cisco Public
26

MC 4+4
MSC-B
Fixed PLIM
POS Tunable Wavelength DPSK+ OC768
Cisco Public
27
MSC vs. MSC-B
MSC
MSC-B
Benefit
SO-DIMM connectors for

FCRAM
FCRAM directly on board
Avoid the issues caused by

loose part/module
CPU MC7455 (800Mhz)
CPU MC7448 (1.7Ghz)
Improve netflow performance
Multiple power supply VRMs
Large discrete power circuits
Power saving
Intel 64Mbyte bootflash
AMD Spansion 256Mbyte

bootflash
Increase bootflash capacity
Weight: 8.4Kg
Weight: 5.4Kg
Weight decrease 37%
Power: 350W
Power: 300W
Power saving14%
Cisco Public
28

SPA
ATM 1/3xOC3-ATM-v2
ATM 1xOC12-ATM-v2
Cisco Public
29

MC 8+4
DPT on OC48 and OC192 SPAs
4GB Flash on RP
Cisco Public
30
CRS-1 Hardware (Additions in IOS XR 3.8.1)

New FP40 Forwarding Processor for thin core and internet peering
Similar to MSC with limited performance, scale and QoS
Supported on CRS-1/4 and CRS-1/8
Requires software licenses for selected edge features
Following GE/10GE PLIMs with limited POS (no 40G)
4 port 10GE LAN
(4-10GE)
4 x 10GE
LR+/ER+ XENPAK
DWDM-XENPAK
2 port 10GE LAN/WAN

Flex PLIM
(2-10GE-WL-FLEX)
Fixed 2 ports
10GE Lan/Wan
Phy with 2 SPA
Bay for POS
and/or Ethernet
SPAs
20 port 1GE
Flex PLIM
(20-1GE-FLEX)
Fixed 20 ports
1GE with 2 SPA
Bay for POS
and/or Ethernet
SPAs
42 port 1GE
(42-1GE)
42 x 1GE
SX, LX/LH, ZX
SFP Optics
SFP GE Copper
Version
Cisco Public
31
Switch Fabric Functional Overview

Forward cells towards their destination within system
3 distinct stages with different forwarding operations
Fabric cards in Line Card Chassis
S123 Implement all 3 stages of fabric in standalone system
S13 Implement 1st and 3rd stage in multi-chassis
Fiber connection to/from FCC for S2
Fabric cards in FCC

Implement 2nd stage of fabric
Fiber connections to LCC
8 slot chassis
S123 fabric card
Cisco Public
32

Switch Fabric
Cisco Public
33
CRS-1 Line Card Architecture Agenda

High Level LC Architecture
MSC Architecture
PSEs (Ingress and Egress)
IngressQ
FabricQ
EgressQ
PLIM Architecture
Fixed and SPA Carrier
SPA Carrier Slot Numbering
Cisco Public
34
High LC Level Architecture

MSC Modular Services Card
Forwarding and Features for all PLIMs
Buffering and Queuing for transit packets
PLIM Physical Interfaces
P
L
I
M
M
I
D
P
L
A
N
E
M
S
C
OSI Reference Model Layer 1 and 2

Fixed and 6 bay SPA Carrier (SIP)
Ethernet (1 & 10G) and POS (OC3 OC768)
Side View
Cisco Public
35
Modular Services Card Architecture

Queuing for fabric
Segmentation into cells
Shaping
RX forwarding
and features
IQ
P
L
I
M
M
I
D
P
L
A
N
E
PSE
IngressQ
(aka Metro)
(aka Sprayer)
CPU
FQ
EQ
FQ
EgressQ
PSE
(aka Sharq)
Output queuing
M
I
D
P
L
A
N
E
(aka Metro)
TX forwarding and features

Multicast replication
FabricQs
(aka Sponge)
F
A
B
R
I
C
S1
F
A
B
R
I
C
S3
F
A
B
R
I
C
S2
Cell Reassembly
Cisco Public
36
Packet Switching Engine ASIC (Ingress)

188 Parallel Forwarding Engines (PFEs)
Independent operation, not pipelined
All PFEs can access forwarding resources
Micro-coded for Service Flexibility

Policing/Marking
ACLs
CEF
TABLE
Netflow
TCAM
POLICER
Performs per packet operations

IPv4, IPv6, MPLS, and Multicast lookups
PSE
Statistics
IngressQ
ACLs and Netflow accounting

Policing and WRED
EgressQ
PSE
FabQs
Access to memories and TCAMs

Cisco Public
37
IngressQ
Queues packets waiting to be sent over the fabric
1GB of packet buffers
Input shaping with 128 kbps resolution
8K Queues - Packet by packet MDRR for dequeue
Segments packets into cells for fabric
PSE
IngressQ
IQ
EgressQ
PSE
FabQs
Cisco Public
38
FabricQ
2 FabricQ ASICs per MSC
Reassemble cells from the fabric
Maintains order of packets
Queues packets prior to Egress PSE & CPU
FQ
(not configurable)
PSE
IngressQ
FQ
EgressQ
PSE
FabQs
Cisco Public
39
Packet Switching Engine ASIC (Egress)

Identical hardware to Ingress PSE
Lookup for output adjacency
Output features
Netflow, ACLs, Statistics
Multicast replication
PSE
CEF
TABLE
TCAM
POLICER
EgressQ
IngressQ
PSE
FabQs
Cisco Public
40
EgressQ
Queues packets waiting to be transmitted
1GB of packet buffers
8K Queues - Packet by packet MDRR for dequeue
Shaping
P2PMDRR for low latency and bandwidth guarantee
Configurable via MQC
PSE
IngressQ
EQ
EgressQ
PSE
FabQs
Cisco Public
41
SPA Carrier PLIM Architecture

Shared Port Adapters
PLIM ASIC
SPA
SPA
PLA
SPA
SPA
SPA
PLA
SPA
M
I
D
P
L
A
N
E
IngressQ
PSE
MSC
EgressQ
P
S
E
FQ
M
I
D
P
L
A
N
E
F
A
B
R
I
C
S1
F
A
B
R
I
C
S3
F
A
B
R
I
C
S2
Total bandwidth of SPAs must be less than or equal to 40 Gbps

Unless ALL SPAs are Ethernet
Cisco Public
42
SPA Slot Numbering

Double height SPAs
use number from
higher numbered SPA
Cisco Public
43
Fixed PLIM Architecture

OC48/192/768 POS
or TenGE
OC192
POS
OC192
POS
OC192
POS
OC192
POS
PLA
PLA
M
I
D
P
L
A
N
E
IngressQ
PSE
MSC
EgressQ
P
S
E
FQ
M
I
D
P
L
A
N
E
F
A
B
R
I
C
S1
F
A
B
R
I
C
S3
Cisco Public
F
A
B
R
I
C
S2
44
PLIM ASIC - PLA

L2 statistics
Manage PLIM oversubscription
Combine/Separate streams to/from MSC
OC-768 has a 40G PLA768
OC192
POS
OC192
POS
OC192
POS
OC192
POS
PLA
PLA
Cisco Public
45

Switch Fabric
Cisco Public
46
Switch Fabric Agenda

Role, Architecture, and Major Components
Fabric Switching Decisions
Multicast Replication
Efficiency and Available Bandwidth
Utilizing Fabric Priority
Fabric Queuing and Backpressure
Monitoring Switch Fabric
CRS-1 Multi-Chassis
Cisco Public
47
Cisco CRS-1 Switch Fabric Overview

High Speed Path for Transit Packets and IPC
40 Gbps
100 Gbps
8
Line Card
8 of 8
2 of 8
1 of 8
Line Card
4 or 8 independent fabric planes (4 on CRS-1/4)

2.5x speedup through fabric
Support for 72 chassis & 1296 RP/MSC clients
Cisco Public
48
Cisco CRS-1 Switch Fabric Overview

3 Stages with Priority
8 of 8
S1
16
S3
2 of 8
Line Card
S2
1 of 8
S1
S2
S3
S1
S2
S3
Line Card
High and low priority cells

Set on control by default
Set on transit pkts via CLI
Vital Bit for IPC
3 stage switching fabric
Cisco Public
49
Multi-Stage Fabric (Theoretical)

S1
S2
S3
Distribution at
Stage 1
Routing
at Stages 2&3
Multiple paths to destination

# of paths to an output port equal to # center stage elements
Cisco Public
50
CRS-1 Fabric Planes

A full fabric consists of 8 planes (4 on CRS-1/4)
Switch Element ASICs (SEAs) perform switching operations
Each plane is an independent set of SEAs
A SEA can implement either S1, S2, or S3 stages
SEAs have 36 RX and 72 TX links
Number of RX and TX active depends on programming/stage
Cells never move between planes

A plane includes at least 1 SEA in each stage
Exact implementation depends on the type of CRS
4 slot 1*S1, 1*S2, 1*S3 (4 physical cards)
Multi-chassis n*S1, n*S2, n*S3
Cisco Public
51
CRS Fabric Cells

Header
12b
Payload
30b
CRC
30b
30b
4b
30b
120 bytes
136 bytes
136 byte cells with

12 byte header, 120 byte payload, 4 byte CRC
1 or 2 packets per cell

Packets must start on a 30 byte boundary
Packets sharing a cell must be same priority and cast
Entire cell travels over 1 fabric plane
Cisco Public
52
Fabric Efficiency and Throughput (Egress)

2.5 Gbps PER LINK (each column represents 100 Mbps)
8 LINKS
/ PLANE
8 PLANES
ELECTRICAL
8*8*2.5 Gbps
= 160 Gbps
AFTER 8B/10B
160*8/10
= 128 Gbps
AVG CELL TAX
128 * ~88%
= 113 Gbps
CELL OVERHEAD
113 * 120/136
= 100
Gbps
Cisco Public
53
Decisions at Each Stage in 16 slot

For each of the 8 planes
S1
S2
S3
Send to any S2.

No need to look
at header
Look at cell header.

Send to S3 based on
chassis/LC
Look at cell header. Send

to specific LC and FabricQ
Cisco Public
54

S1
S2
S3
Send to only S2
Send to only S3

Cisco Public
55

S1
S2
S3
Send to only S2
Send to only S3

Cisco Public
56
Switch Fabric Multicast Replication

CRS-1 provides efficient multicast replication via 3 operations
S2 can replicate cells to registered (via FGID) S3 SEAs
S3 can replicate cells to registered (via FGID) FabricQs
Egress SPP can replicate packets for each output port
1 million Fabric Group IDs

Program fabric for mcast
S2 and S3 lookup FGID
S1
S2
S3
S1 sends to any S2
No replication
Mcast replication at S2
based on FGID
Replication at S3
based on FGID
Cisco Public
57
IngressQ Ingress Side Fabric Client

Every MSC and RP transmits to the fabric via an IngressQ ASIC
Performs segmentation of packets into cells
Manages queues of cells going to fabric
Hi/Low priority unicast queues for each FabricQ in system
Hi/Low priority multicast queues
Separate queues for fabric control cells
An IngressQ ASIC has 32 TX links 4 per plane

16 slot RPs and DRPs use 16 TX links 2 per plane
8 slot RPs use 8 TX links 1 per plane
Ingress LC
IngressQ
Each of these links is 2.5 Gbps
Cisco Public
58
FabricQ Egress Side Fabric Client

Every MSC and RP receives data from the fabric via FabricQ ASICs
MSCs have two FabricQ ASICs
RPs have one FabricQ ASIC
DRPs have two FabricQ ASICs
Performs reassembly and reordering of packets

A FabricQ ASIC has 32 RX links
Each connection is 2.5Gb
FQ
Egress LC
FQ
Cisco Public
59
Fabric Full View of 1 Plane 16 slot

Fabric Plane (1 of 8)
Upper shelf
IngressQ
Ingress LC
& DRP x 8
Upper shelf
FQ
S3
S1
FQ
S2
Egress LC
& DPR x 8
S3
RP X 2
IQ
FQ RP X 2
S3
Lower
Lowershelf
shelf
IngressQ
Ingress LC
& DPR x 8
S1
Lower shelf
S2
FQ
S3
FQ
Egress LC
& DRP x 8
= 1 x 2.5G links
(16 LCs x 4 links) + (2 RPs x 2 links)
= 18 x 2.5G links
Fabric speedup from S2 to S3

Cisco Public
60

RP X 2
IQ
FQ RP X 2
Ingress LC
& DRP x 8
IngressQ
FabricQs
S1
S2
S3
Ingress LC
& DRP x 8
= 1 x 2.5G links
= 18x 2.5G links
Fabric speedup from doubling S3 outputs

Cisco Public
61

RP X 2
IQ
FQ RP X 2
Ingress LC
& DRP x 8
IngressQ
FabricQs
S1
S2
S3
Ingress LC
& DRP x 8
= 1 x 2.5G links
= 18x 2.5G links
Fabric speedup from 4X S3 outputs (compared to 16 slot)

Cisco Public
62
Fabric Hardware
CRS-1/16 has 8 fabric boards
1 plane per board
Removing one CRS-1/16 board will take one plane down

2 planes per board, each operating as individual planes
Removing one CRS-1/8 board will take two planes down

1 plane per board
Removing one CRS-1/4 board will take one plane down
Cisco Public
63
Fabric Resilience
CRS can operate with missing/failed fabric components
System can disable individual wire but still use plane
Capacity reduced if links or entire planes are down
Full capacity can be reached with 7 planes
At least 2 planes must be active for the system to work
Specifically one odd and one even numbered plane must be up
Each cell is sent on a single plane

Cells have error correcting ECC, but
No multi-plane reconstruction of errored cells
Removing fabric HW w/o shutting down the plane first will lose cells
Cisco Public
64
Fabric OIR Process 8 slot example

1. Shut down the fabric plane(s)
1. RP/0/RP1/CPU0:CRS-1(admin-config)#controllers fabric plane 0 shut
2. RP/0/RP1/CPU0:CRS-1(admin-config)#controllers fabric plane 1 shut
2. Turn off power to the fabric card

1. RP/0/RP0/CPU0:CRS-1(config)#hw-mod power disable loc 0/SM0/SP
3. Remove/replace fabric card

4. Turn power back on
1. RP/0/RP0/CPU0:CRS-1(config)#no hw-mod power disable loc 0/SM0/SP
5. Add fabric plane back to system

1. RP/0/RP1/CPU0:CRS-1(admin-config)#no controllers fabric plane 0 shut
2. RP/0/RP1/CPU0:CRS-1(admin-config)#no controllers fabric plane 1 shut
Cisco Public
65
Switch Fabric Priority

Fabric recognizes 4 different types of data cells
High priority unicast
Low priority unicast
High priority multicast
Low priority multicast
Control packets may set vital bit in header

Cells with vital bit set will not be dropped
Control is queued separately at S1, S2, and S3

Data Cast/Priority are grouped together at S1
Data Cast /Priority are queued separately at S2 and S3
When congested, there is a weighted allocation between
Unicast vs. Multicast
High Priority vs. Low Priority within each cast
Cisco Public
66
Cisco CRS-1 Fabric Buffering at S2/S3

Line Card
LINE CARD
CHASSIS
FABRIC
CHASSIS
LINE CARD
CHASSIS
S2
S3
Line Card
Modular Service Card
Cisco
SPP
8K Qs
Cisco
SPP
8K Qs
Cisco
SPP
MID-PLANE
S1
Interface Module
8K Qs
MID-PLANE
Interface Module
Cisco
SPP
8K Qs
Line Card
S2
S3
Cisco
SPP
8K Qs
Cisco
SPP

8K Qs
Cisco
SPP
MID-PLANE
S1
Interface Module
8K Qs
MID-PLANE
Interface Module
Line Card
Cisco
SPP
8K
Qs
Switch
Fabric
Queues
High Priority Unicast

Low Priority Unicast
Hi/Lo Priority Unicast
~2K DEEP CELL BUFFERS AT S2 and S3

Cisco Public
67
Monitoring Fabric Operation

High level fabric status
RP/0/RP0/CPU0:CRS(admin)# show
controllers fabric plane all detail
Plane Admin
Oper
Down
Total
Down
Id
State
State
Flags
Bundles
Bundles
-----------------------------------------------------0
UP
UP
0
0
1
UP
UP
0
0
2
UP
UP
0
0
3
UP
UP
0
0
4
UP
UP
0
0
5
UP
UP
0
0
6
UP
UP
0
0
7
UP
UP
0
0
Examples of Down flags

P plane admin down
C card admin down
p plane oper down

c card oper down
Cisco Public
68

View of fabric planes from MSCs
RP/0/RP0/CPU0:CRS(admin)#show controllers fabric connectivity all detail
Card
In Tx Planes Rx Planes Monitored Total
Percent
R/S/M
Use 01234567
01234567
For (s)
Uptime(s) Uptime
------------------------------------------------------------------0/0/CPU0
1 11111111
11111111
335147
335147
100.0000
0/2/CPU0
1 11111111
11111111
335147
335147
100.0000
0/RP0/CPU0 1 11111111
11111111
335147
335147
100.0000
0/RP1/CPU0 1 11111111
11111111
335147
335147
100.0000
Cisco Public
69

Error counts
RP/0/RP0/CPU0:CRS(admin)#show
Plane
controllers fabric plane all statistics
In
Out
Cells
Cells
CE
Cells
UCE
Cells
PE
Cells
--------------------------------------------------------------------------0
45088937799
45088965120
45088939239
45088966386
45088554913
45088582368
45088556270
45088583448
45088151158
45088178280
45088152592
45088179766
45089166942
45089194313
45089168302
45089194928
CE Cells Correctable Error

UCE Uncorrectable Error
PE Parity Error
Cisco Public
70
CRS-1 Multi-chassis
Fabric Chassis
40 Gbps
136 Bytes cells
40 Gbps
8 of 8
S1
16
S3
2 of 8
2
Line Card
S2
100 Gbps
(2.5X Speedup)
1 of 8
S1
S2
S3
S1
S2
S3
Line Card
S2 stage moves into Switch Fabric Chassis

Logical operation of fabric remains the same
Cisco Public
71
Multichassis and Benes Fabric

The distinct stages of the
Benes fabric allow easy
migration to Multichassis
Line Card
Chassis (LCC)
Fabric Card
Chassis (FCC)
Up to
100m
Up to
100m
Line cards (MSC) and S1 and

S3 stages stay on LCC
Line Card
Chassis (LCC)
S2 Stage move to the FCC

Array Cables connect the
fabric stages together
Upgrading from single

chassis to multichassis
can be done in services
The S2 stage for each plane
can be moved to FCC one at
a time
LCC requires new fabric
cards with that has just the
S1 and S3 stages
MSC
MSC
S1
S2
S
3
S1
S2
S3
Cisco Public
72
Decisions at Each Stage in 2+2 Multi-chassis

For 1 the 8 planes
LCC #1
S3
S2
S1 and S3
Stages in Line
Card Chassis
S1
S2 Stage in
Fabric Card
Chassis
S3
Logical decisions same

as standalone system
LCC #2
Cisco Public
73
Single Module (vertical) Topology

Each fabric plane uses one S2 card
Each S13 card has 3 cables
All 3 cables connect to one S2 card
OIM has 9 array connectors

Max 3 line card racks
To LC rack # 0
To LC rack # 1
Cisco Public
74
Multi Module (horizontal) Topology

Each plane uses 3 S2 cards
Total 24 S2 cards
Each S13 card connects to 3

different S2 cards
Scales to 9 LC chassis
To LC rack # 0
To LC rack # 2
To LC rack # 6
To LC rack # 8
Cisco Public
75
Multi-chassis Fabric Plane Distribution

Sample Distribution
1 2 3 4
1 23 4
5 67 8
1 12 2
3 34 4
5 56 6
7 78 8
5 6 7 8
1 23 4
5 67 8
1 12 2
3 34 4
5 56 6
7 78 8
1 FCC
4 FCC
2 FCC
Max 9 LCC
Max 36 LCC
Max 18 LCC
1 11 1
2 22 2
3 33 3
4 44 4
5 55 5
6 66 6
7 77 7
8 88 8
1 11 1
2 22 2
3 33 3
4 44 4
5 55 5
6 66 6
7 77 7
8 88 8
8 FCC
Max 72 LCC
Cisco Public
76
2+2 MC External GE Connections

RP0
LCC0
RP1
SC-GE-22
SC0
SC-GE-22
SC0
RP0
LCC1
SC-GE-22
RP1
SC-GE-22
SC1
SC1
FCC0
FCC1
Cisco Public
77

Switch Fabric
Cisco Public
78
Mechanicals & Site Planning Agenda

Mechanical Characteristics
Site Planning
Installation Process
Unpacking
Connecting power
Multi-chassis connections
External interfaces
Cable Management
Cisco Public
79
CRS-1 Mechanical Characteristics
Dimensions
HxWxD
Weight
Min - Max
Max Power
Cooling
Fully loaded system
Installation
Floor Loading
Footprint & Loading
CRS-1/4
CRS-1/8
CRS-1/16
FCC
30 x 18 x 27 in
76 x 45 x 69 cm
39 x 18 x (35-40) in
98 x 45 x (89-102) cm
84 x 23.6x (36-40) in
214 x 60 x (91-101)
cm
84 x 23.6 x (35-41) in
214 x 60 x (89-104) cm
260 - 380 lb
TBA kg
330 - 650 lb
138 - 295 kg
900 - 1600 lb
425 - 725 kg
1000 - 1627lb
454 - 738 kg
~4KW
~8.5KW
~15KW
~10KW
16000 BTU
Rack
mountable
2 / rack
Rack specs
27,000 BTU
Rack mountable
2 / rack
Rack specs
56,000 BTU
Integrated Rack
4.72 ft2
351 lb/ft2
4385 cm2 0.17 kg/cm2
35,000 BTU
Integrated Rack
5.74 ft2
270 lb/ft2
5332 cm2 0.13 kg/cm2
Note: Values are approximate. Refer to install documentation for exact specs.
Cisco Public
80
Airflow and Access Requirements
Fabric Card Chassis, CRS-1/8 & CRS-1/16 Line Card Chassis
Power
Independent Airflow
MSC Side
PLIM Side
Fans
PLIM /
Fabric S2
MSC/OIM Side
Power
16 Slot and FCC Chassis

CRS-1/16 50in / 127cm access front and rear
FCC
48in / 122cm access front and rear
8 Slot Chassis
48in / 122cm access front and rear

Cisco Public
81
Installation - The Goal
CRS-1 installation requires planning
(especially multi-chassis)
Cisco services are available to assist with installations

Cisco Public
82
Site Planning
Site planning is critical for CRS-1/16 and Multi-chassis
Ensure that mechanical requirements are met
Ensure travel path meets all requirements
Floor loading
Elevators
Height, width, turn radius
Verify Power and Cooling

Front and Rear Access
Cisco Public
83
Unpacking
Chassis will ship on a pallet
Everything else in boxes
RPs
MSCs
PLIMs
Fabric Cards
Power Supplies
Cosmetics
Dont forget ESD precautions
Cisco Public
84
Power Load Zones

CRS-1/8 has 2 power supplies
1:1 power redundancy for all components
No special considerations on system layout
CRS1/16 and FCC have 6 power supplies

Supplies are paired
No impact from one PS or source failure
Each pair covers 1/3 of the chassis
Layout to minimize impact of double failures
Cisco Public
85
FCC S2 Card Placement Example

S2 cards spread among load zones
FCC placement should also allow for
addition of additional LCC
Cisco Public
86
Cisco Public
87

02 CRS1 System Overview XR381

Încărcat de

Informații document

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

02 CRS1 System Overview XR381

Încărcat de

Drepturi de autor:

Formate disponibile

Cisco CRS-1

Platform Introduction Training

CRS-1 Training / lwigley

2005 Cisco Systems, Inc. All rights reserved.

CRS-1 Platform Introduction Agenda

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

System Highlights & Roles in SP Networks

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 Router Family (XR 3.3)

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 Router Family (XR 3.4 & 3.5)

CRS-1/4 chassis offers reduced height, weight and depth

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

Front and Rear View

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 System Highlights

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

Roles in Service Provider Networks - 2005

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

7xxx 7xxx 10xxx

CRS-1 Roles Initial Deployments

7xxx 7xxx 10xxx

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

7xxx 7xxx 10xxx

CRS-1 Roles POP Consolidation

7xxx 7xxx 10000

7xxx 7xxx 10000

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

System Highlights & Roles in SP Networks

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

HW Introduction & System Architecture Agenda

High Level Logical and Physical

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 Hardware Introduction

8 slot Line Card

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 High Level Logical Architecture

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 High Level Physical Architecture

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 Multi-chassis Components

Connect control GE to Catalyst switches

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

CRS-1 Route Processor Hardware

CRS-1 Training / lwigley

2006 Cisco Systems, Inc. All rights reserved.

Route Processor Functional Overview

Executes routing protocols