Documente Academic
Documente Profesional
Documente Cultură
BRKARC-2350
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
IOS Routing Internals
Agenda
Router Components
Data and Control Planes
Software Based Routers
Hardware Based Routers
Hybrid Routers
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Router Components
Data and Control Planes
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
IOS Routing Internals
Agenda
Router Components
Data and Control Planes
Software Based Routers
Hardware Based Routers
Hybrid Routers
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Router Components
Software Based Routers
Software Based
– Shared control and data plane
– General Purpose CPU (slow and smart)
– CPU responsible for all operations
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Router Components
Software Based Routers
I/O
RX Ring Memory CPU
Tx Ring Process
Memory
Network Interface
RAM
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
IOS Routing Internals
Agenda
Router Components
Data and Control Planes
Software Based Routers
Hardware Based Routers
Hybrid Routers
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Router Components
Hardware Based Routers
Hardware based
– Separated control and data plane
– CPU + ASIC (Application Specific Integrated Circuit)
– ASIC designed specifically to move packets (fast and dumb)
– CPU manages control plane
– CPU only moves packets the ASIC can’t
– Data Plane packets sent to the CPU are “punted”
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
Router Components
Hardware Based Routers
IO
Memory
CPU
Process
Memory
RX Ring RAM
Tx Ring Forwarding
TCAM ASIC
Network Interface
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Router Components
Hardware Based Routers
Control
Plane IO
Memory
Data CPU
Process
Plane
Memory
RX Ring RAM
Tx Ring Forwarding
TCAM ASIC
Network Interface
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
IOS Routing Internals
Agenda
Router Components
Data and Control Planes
Software Based Routers
Hardware Based Routers
Hybrid Routers
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Router Components
Hybrid Routers
Hardware assisted
– Separated control and data plane
– CPU + NP (Network Processor)
– NP is multi-core specialized processor
– NP is optimized to move packets
– CPU manages control plane
– CPU only moves packets the NP can’t
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Router Components
Hybrid Routers
Control
Plane IO
Memory
Data CPU
Process
Plane
Memory
RX Ring RAM
Tx Ring Forwarding
TCAM ASIC
Network Interface
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
Router Components
Hybrid Routers
Control
Plane IO
Memory
Data CPU
Process
Plane
Memory
RX Ring RAM
Tx Ring Dataplane
NP
Memory
Network Interface
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
IOS Routing Internals
Agenda
Router Components
Moving Packets
Process Switching
CEF Switching
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Moving Packets
Overview
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Process Switching
CPU
Interrupt
IO
Memory
L2 Hdr e0/0 e0/1
Rx Ring Tx Ring
Packet
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
Process Switching
Schedules IP
CPU
Input
Interrupt
IO
Memory
L2 Hdr e0/0 e0/1
Rx Ring Tx Ring
Packet
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
Process Switching
IP Scheduler
CPU
Input
Runs
IO
Memory
e0/0 Packet e0/1
Rx Ring Tx Ring
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Process Switching
Find
IP Scheduler
Route CPU
Input
Routing L2 Hdr
Table Find
Adjacency
ARP
Table
IO
Memory
e0/0 Packet e0/1
Rx Ring Tx Ring
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Process Switching
IP Scheduler
CPU
Input
Routing L2 Hdr
Table
ARP
Table
IO
Memory
e0/0 Packet e0/1
Rx Ring Tx Ring
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Process Switching
IP Scheduler
CPU
Input
Routing
Table
ARP
Table
IO
Memory
e0/0 L2 Hdr e0/1
Rx Ring PacketTx Ring
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
Moving Packets
Process Switching
Router#show ip route 172.16.1.1
Process Switching is BAD Routing entry for 172.16.1.1/32
Known via "bgp 65530", distance 20, metric 0
Multiple lookups * 10.0.0.1, from 10.0.0.1, 00:00:07 ago
Router#show ip route 10.0.0.1
Inefficient data structures Routing entry for 10.0.0.1/32
Known via "static", distance 1, metric 0
Process scheduling * 192.168.1.1
Router#show ip route 192.168.1.1
Routing entry for 192.168.1.0/24
Known via "connected", distance 0, metric 0
What can we do to improve? (connected, via interface)
* directly connected, via Ethernet0/1
– Better data structures
– Pre-compile forwarding information
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
IOS Routing Internals
Agenda
Router Components
Moving Packets
Process Switching
CEF Switching
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
The FIB (Forwarding Information Base)
“Show IP CEF”
ARP Table
Routing Adjacency
Table Table Other L2 Protocols
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
CEF Switching
CPU
Interrupt
IO
Memory
L2 Hdr e0/0 e0/1
Rx Ring Tx Ring
Packet
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
CEF Switching
IP Scheduler
CPU
Input
Route +
L2 Lookup
L2 Hdr CEF
Interrupt Table
IO
Memory
L2 Hdr e0/0 e0/1
Rx Ring Tx Ring
Packet
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
CEF Switching
CPU
Route +
L2 Lookup
L2 Hdr CEF
Interrupt Table
IO
Memory
e0/0 Packet e0/1
Rx Ring Tx Ring
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
CEF Switching
CPU
Route +
L2 Lookup
CEF
Interrupt Table
IO
Memory
e0/0 L2 Hdr e0/1
Rx Ring PacketTx Ring
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
CEF Switching - Summary
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
CEF Switching - Features
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Processes and Interrupts
Routing Memory Utilization
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
CEF and CPU Utilization
CPU utilization for five seconds: 5%/2%; one minute: 3%; five minutes: 2%
PID Runtime (ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
...
2 68 585 116 1.00% 1.00% 0% 0 IP Input
17 88 4232 20 0.20% 1.00% 0% 0 BGP Router
18 152 14650 10 0% 0% 0% 0 BGP Scanner
...
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
CPU Utilization Examples
1. CPU Utilization due to moderate traffic rates
CPU utilization for five seconds: 47%/46%; one minute: 40%; five minutes: 39%
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
CPU Utilization Examples
1. CPU Utilization due to moderate traffic rates
CPU utilization for five seconds: 47%/46%; one minute: 40%; five minutes: 39%
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
CPU Utilization Examples
1. CPU Utilization due to moderate traffic rates
CPU utilization for five seconds: 47%/46%; one minute: 40%; five minutes: 39%
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Process Priority
High
Medium
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Process Priority
1 2 Medium
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Process Priority
1 2 Medium
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Process Priority
1 2 Medium
3
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Process Priority
1 2 Medium
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Process Priority
1 2 Medium
4
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Process Priority
1 2 Medium
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 47
Process Priority
2 Medium
1
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Process Priority
2 Medium
1
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Process Priority
1 2 Medium
CPU Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
Process Priority
Interrupt! CPU 5
Low
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Processes and Interrupts
Routing Memory Utilization
Outbound Load Sharing
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Routing Process Memory
Routing Protocol, RIB, and CEF each take their own memory
RIB built from Routing Protocols
CEF built from RIB
Proc Mem
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
Memory Impact of Multiple Prefixes
ISP B
ISP A ISP C
400k 400k
400k Prefixes Prefixes
Prefixes
3 BGP Peers
400k Identical Routes
15.2(2)T
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
Memory Impact of Multiple Prefixes
Memory Utilization
50%
0 peers
40% 0 BGP entries 45% ISP A ISP C
41%
0 CEF entries 38%
30% ISP B
20%
3 BGP Peers
10%
5% 400k Identical Routes
0% 15.2(2)T
0 Peers 1 Peer 2 Peers 3 Peers
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Memory Impact of Multiple Prefixes
Memory Utilization
50%
Memory Utilization
50%
Memory Utilization
50%
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
CEF Equal Cost Multipath (ECMP)
Load Sharing with Performance Routing (PfR)
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Load Sharing vs. Load Balancing
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Equal Cost Loadsharing
OSPF Cost 20
OSPF
B
172.16.2.0/24 Area 0
OSPF Cost 20
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
Routing Table – Equal Cost Routes
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
Routing Table – Equal Cost Routes
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 64
Routing Table – Equal Cost Routes
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
Unequal Cost Load Sharing
B
172.16.2.0/24 EIGRP 10
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
Routing Table – Unequal Cost Routes
RouterB#show ip route 172.16.2.0
Routing entry for 172.16.2.0/24
Known via "eigrp 10", distance 90, metric 307200, type internal
Last update from 172.16.1.1 on Ethernet0/0, 1d02h ago
Routing Descriptor Blocks:
192.168.100.1, from 192.168.200.1, 1d02h ago, via Ethernet0/1
Route metric is 1561600, traffic share count is 47
...
* 172.16.1.1, from 172.16.1.1, 00:00:16 ago, via Ethernet0/0
Route metric is 307200, traffic share count is 240
Unequal Metrics
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
Routing Table – Unequal Cost Routes
RouterB#show ip route 172.16.2.0
Routing entry for 172.16.2.0/24
Known via "eigrp 10", distance 90, metric 307200, type internal
Last update from 172.16.1.1 on Ethernet0/0, 1d02h ago
Routing Descriptor Blocks:
192.168.100.1, from 192.168.200.1, 1d02h ago, via Ethernet0/1
Route metric is 1561600, traffic share count is 47
...
* 172.16.1.1, from 172.16.1.1, 00:00:16 ago, via Ethernet0/0
Route metric is 307200, traffic share count is 240
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
CEF Hashing
1
Without randomization every
D router makes the same
1 B decision
2 E
A
2 1 F Downstream routers never
C
2 loadshare
G
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
CEF Hashing Algorithm
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
CEF Loadsharing Options
Per-Packet
– More even load sharing
– Jitter
– Out of Order packets (bad for lots of applications)
Per-Destination (default)
– Can be less even load sharing
– Ordered delivery
– Hashing challenges
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
CEF Hashing
RouterB#show ip CEF 172.16.2.1 internal
172.16.2.0/24, epoch 0, RIB[I], refcount 5, per-destination sharing
…
ifnums:
Ethernet0/0(3): 172.16.1.1
Ethernet0/1(4): 192.168.200.1
path 08172748, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 172.16.1.1 Eth0/0, adj IP adj out Eth0/0, addr 172.16.1.1 081E35A0
path 08172898, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 192.168.200.1 Eth0/1, adj IP adj out Eth0/1, addr 192.168.200.1 0F75D9F8
flags: Per-session, for-rx-IPv4, 2buckets
2 hash buckets
< 0 > IP adj out of Ethernet0/0, addr 172.16.1.1 081E35A0
< 1 > IP adj out of Ethernet0/1, addr 192.168.200.1 0F75D9F8
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
CEF Hashing
RouterB#show ip CEF 172.16.2.1 internal
172.16.2.0/24, epoch 0, RIB[I], refcount 5, per-destination sharing
…
ifnums:
Ethernet0/0(3): 172.16.1.1
Ethernet0/1(4): 192.168.200.1
path 08172748, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 172.16.1.1 Eth0/0, adj IP adj out Eth0/0, addr 172.16.1.1 081E35A0
path 08172898, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 192.168.200.1 Eth0/1, adj IP adj out Eth0/1, addr 192.168.200.1 0F75D9F8
flags: Per-session, for-rx-IPv4, 2buckets
2 hash buckets
< 0 > IP adj out of Ethernet0/0, addr 172.16.1.1 081E35A0
< 1 > IP adj out of Ethernet0/1, addr 192.168.200.1 0F75D9F8
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
CEF Hashing
RouterB#show ip CEF 172.16.2.1 internal
172.16.2.0/24, epoch 0, RIB[I], refcount 5, per-destination sharing
…
ifnums:
Ethernet0/0(3): 172.16.1.1
Ethernet0/1(4): 192.168.200.1
path 08172748, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 172.16.1.1 Eth0/0, adj IP adj out Eth0/0, addr 172.16.1.1 081E35A0
path 08172898, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 192.168.200.1 Eth0/1, adj IP adj out Eth0/1, addr 192.168.200.1 0F75D9F8
flags: Per-session, for-rx-IPv4, 2buckets
2 hash buckets
< 0 > IP adj out of Ethernet0/0, addr 172.16.1.1 081E35A0
< 1 > IP adj out of Ethernet0/1, addr 192.168.200.1 0F75D9F8
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
CEF Hashing
RouterB#show ip CEF 172.16.2.1 internal
172.16.2.0/24, epoch 0, RIB[I], refcount 5, per-destination sharing
…
ifnums:
Ethernet0/0(3): 172.16.1.1
Ethernet0/1(4): 192.168.200.1
path 08172748, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 172.16.1.1 Eth0/0, adj IP adj out Eth0/0, addr 172.16.1.1 081E35A0
path 08172898, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 192.168.200.1 Eth0/1, adj IP adj out Eth0/1, addr 192.168.200.1 0F75D9F8
flags: Per-session, for-rx-IPv4, 2buckets
2 hash buckets
< 0 > IP adj out of Ethernet0/0, addr 172.16.1.1 081E35A0
< 1 > IP adj out of Ethernet0/1, addr 192.168.200.1 0F75D9F8
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
CEF Hashing
RouterB#show ip CEF 172.16.2.1 internal
172.16.2.0/24, epoch 0, RIB[I], refcount 5, per-destination sharing
…
ifnums:
Ethernet0/0(3): 172.16.1.1
Ethernet0/1(4): 192.168.200.1
path 08172748, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 172.16.1.1 Eth0/0, adj IP adj out Eth0/0, addr 172.16.1.1 081E35A0
path 08172898, path list 100071A8, share 1/1, type attached nexthop, for IPv4
nexthop 192.168.200.1 Eth0/1, adj IP adj out Eth0/1, addr 192.168.200.1 0F75D9F8
flags: Per-session, for-rx-IPv4, 2buckets
2 hash buckets
< 0 > IP adj out of Ethernet0/0, addr 172.16.1.1 081E35A0
< 1 > IP adj out of Ethernet0/1, addr 192.168.200.1 0F75D9F8
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
CEF Hashing
2 hash buckets
< 0 > IP adj out Ethernet0/0, addr 172.16.1.1 081E35A0
< 1 > IP adj out Ethernet0/1, addr 192.168.200.1 0F75D9F8
Eth0/0, 172.16.1.1
Source IP 0
CEF
Destination IP Hash or
1
Universal ID
Eth0/1, 192.168.200.1
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
CEF Hashing
RouterB#show ip CEF exact-route 192.168.2.38 172.16.2.24
192.168.2.38 -> 172.16.2.24 => IP adj out Ethernet0/1, addr 192.168.200.1
Eth0/0, 172.16.1.1
Source IP 0
CEF
Destination IP Hash or
1
Universal ID
Eth0/1, 192.168.200.1
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Equal Cost Multipath - Summary
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 82
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
CEF Equal Cost Multipath (ECMP)
Load Sharing with Performance Routing (PfR)
Routing Convergence Improvements
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Loadsharing Across Routers
CEF ECMP works per-router
No dynamic way to get even sharing across routers
20%
ISP1
WAN
Site
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Command and Control Infrastructure
Border Routers (BRs) communicate load to Master Controller (MC)
20%
ISP1
BR
WAN
Load Information Site
MC
BR
60% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Master Controller analyzes reports from Border Routers
20%
ISP1
? BR
WAN
Load Information Site
MC
BR
60% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Master Controller analyzes reports from Border Routers
MC detects policy violation
20%
ISP1
! BR
WAN
Load Information Site
MC
BR
60% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Master Controller pushes routing updates
20%
ISP1
! BR
WAN
Routing Updates Site
MC
BR
60% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Master Controller pushes routing updates
Border Routers adjust routing impacting load
48%
ISP1
BR
WAN
Routing Updates Site
MC
BR
40% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Border Routers continue reporting
48%
ISP1
BR
WAN
Load Information Site
MC
BR
40% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Operations
Border Routers continue reporting
Master Control continues analyzing
48%
ISP1
? BR
WAN
Load Information Site
MC
BR
40% ISP2
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PfR Summary
PfR “lifecycle”
Policy Enforcement
– BGP Local Preference
– Static Routes
– PBR
PfR provides routing intelligence
CEF and RIB are the same
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
Fast Convergence Overview
OSPF LFA
EIGRP Feasible Successor
BGP PIC-Edge
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Routing Convergence – What’s to Improve?
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
Failure Detection with BFD
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
Fast Convergence Overview
OSPF LFA
EIGRP Feasible Successor
BGP PIC-Edge
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
OSPF Overview
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
OSPF Convergence
Convergence =
Failure Detection + Event Propagation + SPF + FIB Update
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 98
OSPF Loop Free Alternate
10.1.1.0/24
A C
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
OSPF Loop Free Alternate
OSPF presents a primary and backup to CEF
– Backup calculated from secondary SPF run
RouterA# show ip route 10.1.1.0
Routing Descriptor Blocks:
* 172.16.0.1, from 192.168.255.1, 00:01:57 ago, via Ethernet4/1/0
Route metric is 2, traffic share count is 1
Repair Path: 192.168.0.2, via Ethernet4/2/0
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 100
OSPF Loop Free Alternate
LFA No LFA
milliseconds
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
OSPF Loop Free Alternate
A C
WAN
B D
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
Fast Convergence Overview
OSPF LFA
EIGRP Feasible Successor
BGP PIC-Edge
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
EIGRP Overview
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
EIGRP Feasible Successors
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
EIGRP Feasible Successors
Delay 10
B
172.16.2.0/24 EIGRP 10
Delay 15
172.16.2.0/24
B
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
EIGRP Feasible Successors
RouterB#show ip eigrp topology
P 172.16.2.0/24, 1 successors, FD is 285440
via 192.168.200.1 (285440/281600), Ethernet0/1
via 172.16.1.1 (307200/281600), Ethernet0/0
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
EIGRP LFA
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
EIGRP LFA
RouterB#show ip route 172.16.2.0
Known via "eigrp 10", distance 90, metric 1100800, type
internal
* 172.16.1.2, from 172.16.1.2, 00:00:17 ago, via Ethernet0/1
Route metric is 281600, traffic share count is 1
Repair Path: 192.168.1.1, via Ethernet0/0
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
IOS Routing Internals
Agenda
Router Components
Moving Packets
CEF, CPU and Memory
Outbound Load Sharing
Routing Convergence Improvements
Fast Convergence Overview
OSPF LFA
EIGRP Feasible Successor
BGP PIC-Edge
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
BGP Prefix Independent Convergence
10.1.1.0/24 192.168.1.1
10.1.2.0/24 192.168.1.1
10.1.3.0/24 192.168.1.1
400k prefixes
400k routes -> 400k updates
BGP often has same next hop A B
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 112
BGP Prefix Independent Convergence
10.1.1.0/24 192.168.1.1
10.1.2.0/24 192.168.1.1
10.1.3.0/24 192.168.1.1
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 113
BGP Prefix Independent Convergence
10.1.1.0/24 192.168.1.1
10.1.3.0/24 192.168.1.1
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 114
BGP PIC Core
Primary: A-B-C
Backup: A-D-C
CE1
B C
A CE2
D 10.1.1.0/24
10.1.2.0/24
IGP Next Hop 10.1.3.0/24
Prefixes BGP Next Hop ….
B
10.1.1.0/24
C
10.1.2.0/24
10.1.3.0/24
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 115
BGP PIC Core
Primary: A-B-C
Backup: A-D-C
CE1
B C
A CE2
D 10.1.1.0/24
10.1.2.0/24
IGP Next Hop 10.1.3.0/24
Prefixes BGP Next Hop ….
B
10.1.1.0/24
C
10.1.2.0/24
10.1.3.0/24
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 116
BGP PIC Core
Primary: A-B-C
Backup: A-D-C
CE1
B C
A CE2
D 10.1.1.0/24
10.1.2.0/24
IGP Next Hop 10.1.3.0/24
Prefixes BGP Next Hop ….
B
10.1.1.0/24
C
10.1.2.0/24
10.1.3.0/24
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 117
BGP PIC Core
Primary: A-B-C
Backup: A-D-C
CE1
B C
A CE2
D 10.1.1.0/24
10.1.2.0/24
IGP Next Hop 10.1.3.0/24
Prefixes BGP Next Hop ….
B
10.1.1.0/24
C IGP Next Hop
10.1.2.0/24
10.1.3.0/24 D
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 118
BGP PIC Core
Core
100000
10000
PIC
LoC (ms)
1000
no PIC
100
10
12 0
15 0
17 0
20 0
22 0
25 0
27 0
30 0
32 0
35 0
00
0
10 0
1
0
0
0
00
00
00
00
50
00
50
00
50
00
50
00
50
00
25
50
75
Prefix
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 120
Review
Router Components
– Control vs. Data plane
– Software vs. Hardware vs. Hybrid based routers
CPU and Memory
– Interrupt (CEF) vs. Process (Routing Protocol)
– Memory concerns for multiple routes
Load Sharing
– CEF and PfR
Routing Enhancements
– OSPF LFA/EIGRP Feasible Successors/BGP PIC
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 121
Further Reading
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 122
Complete Your Online Session Evaluation
Give us your feedback and
you could win fabulous prizes.
Winners announced daily.
Receive 20 Cisco Daily Challenge
points for each session evaluation
you complete.
Complete your session evaluation
online now through either the mobile
app or internet kiosk stations.
Maximize your Cisco Live experience with your
free Cisco Live 365 account. Download session
PDFs, view sessions on-demand and participate in
live activities throughout the year. Click the Enter
Cisco Live 365 button in your Cisco Live portal to
log in.
BRKARC-2350 © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public