Documente Academic
Documente Profesional
Documente Cultură
#CLUS
Cisco Webex Teams
Questions?
Use Cisco Webex Teams (formerly Cisco Spark)
to chat with the speaker after the session
How
1 Find this session in the Cisco Events App
2 Click “Join the Discussion”
3 Install Webex Teams or go directly to the team space
4 Enter messages/questions in the team space
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Is Your Network Ready for Digitization of
Tomorrow?
IP Display/DMS Printer IP Camera LED Lights / IoT AP PC/Laptop IP Phone
Does the platform Does the platform Does the platform Does the platform Does the platform let you
support new PoE make it easy to support enough ensure secure adapt to new connectivity
devices efficiently? provision Programmability? network access? requirements?
and scale? #CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Enterprise Trends Driving Digital Transformation
Fabric Enabled Wireless CoAP / IoT Device profiling 256bit MacSec DevOps Toolkit
Multigigabit SD Bonjour Trustworthy Systems Netconf
Perpetual PoE Group based policy Yang Models
AVB Full Netflow Streaming telemetry
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
“The goal of this session is to
give you an in depth view of the
platform so you can understand
its strength as well as its
limitations …”
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Agenda
• Introduction & Overview
• Platform and ASIC Architecture
and Packet Walks
• High Availability – Data and
Power Stacks
• Scale
• Software Innovations
• Conclusion
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
Introduction to Catalyst
3850 and 3650
The Catalyst 3K Family
Catalyst 3850 Catalyst 3650 Catalyst 3850 SFP Catalyst 3850 mGig Catalyst 3850 SFP+ Catalyst 3650 Mini Catalyst 3650
Stackwise-480, Stackwise-160, Stackwise-480, Stackwise-480, Stackwise-480, Stackwise-160, Mgig
Stackpower - Stackpower Stackpower Stackpower Data/PoE/PoE+/ Stackwise-160,
Data/PoE/PoE+/UPoE Data/PoE/PoE+/ 12 and 24 Port Versions 24 and 48 Port Versions 12, 24 and 48 Port Versions Fixed Uplinks Data/PoE/PoE+/UPOE
FRU Uplinks Fixed Uplinks FRU Uplinks Stacks with any Catalyst 3850 Enabling 10G Aggregation Stacks with any 3650 Fixed Uplinks
Stacks with any 3650
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
One Switch – Multiple Deployment scenarios
MultiGigabit
48 Port SFP+ Version
MultiGigabit No Stackwise 480
1 Gigiagbit SFP+
Mini – Shallow Depth SFP
1 Gigabit
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
Fixed Uplink Options on Catalyst 3650
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Power Supplies
Catalyst 3850 Catalyst 3650
MultiGigabit SKUs
Same PS as 3850s
715WAC 1100WAC
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
Catalyst 3650 Mini – Fixed PS
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
48 Port SFP+ Version – 750 WAC PS
Dual 750 WAC PS
4x40G Fixed Uplinks
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
Stack–Cables and Components
Catalyst 3850 Catalyst 3650
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Catalyst 3850/3650 models For Your
Reference
Similarities & Differences
Catalyst Catalyst 3850
Features / Catalyst Catalyst Catalyst 3850 Catalyst Catalyst 3650 Catalyst 3650
3850 SFP+ (12,24
Scale 3850 3850 SFP SFP+ (48Port) 3650 Mini MultiGigabit
MultiGigabit Ports)
ASIC UADP 1.0 UADP 1.0 UADP 1.1 UADP 1.1 UADP 1.1 UADP 1.0 UADP 1.1 UADP 1.1
MACSEC 128 bit 128 bit 256 bit 256 bit 256bit 128 bit 256 bit 256 bit
SSO,
HA SSO SSO SSO SSO, Stackwise SSO SSO SSO
Virtual
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
Looking Inside the
Switch
Catalyst 3850: Under the Covers…
Cavium CPU
Ampere / Stack
Power Controller
FRU Uplink
Module
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
ASICs are a Pillar of Cisco Innovation…
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Traditional ASIC Pipeline
Can lookup these
Fields
Parses &
Understands Fixed Fixed
Parser
number of Bytes
MAC IPv4 ACL QoS
Ether
net
IP Payload Look Look Look Look
up up up up
Ether VXLA Ether
VXLAN net
IP UDP
N net
IP Payload
GRE Ethern
IP GRE
Ethern
IP Payload
et et
Fixed Pipeline
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Cisco Innovation
No Compromise on Performance
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
UADP 1.0 and 1.1 ASIC Block Diagram
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
IGR o
k
u
p
T
a
o
k
u
p
T
a
o
k
u
p
T
a
o
k
u
p
T
a
b b b b
l l l l
e e e e
Stage #15 L
o
o
L
o
o
L
o
o
L
o
o
Stage #1
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Flexible
b b b b
l l l l
e e e e
Controller L
o
o
L
o
o
L
o
o
L
o
o
Controller
Stage #..
Stage #.. Look up
k k k k
u u u u
p p p p
T T T T
Stage #2
L
o
o
k
u
p
T
a
Tables
L
o
o
k
u
p
T
a
L
o
o
k
u
p
T
a
L
o
o
k
u
p
T
a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
ReWrite
a a a a
Flex Parser
b
l
e
b
l
e
b
l
e
b
l
e
EGR Engine
Encryption Recirculation
Engine Engine
Ingress
Egress
FIFO
FIFO
UADP 1.1
MACsec MACsec
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
Lets take a look at the Programmable Pipelines
15 Ingress Stages
256 B Header
Ingress Programmable Pipeline
Flex Parser IGR
7 Egress
Stages
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
Micro Code Programmed to
understand
VXLAN
L3/L2
MC
Look
span
Look
Policy Stage
Tunn
eling
NF
Look
OSPF MPLS ACLs
Lookup Lookup #..
up up #.. up
Software Features
Span Sec. NF
Stage Stage Stage Policy
Look
up
Look
up
#5 #4 #3
Look
up
Lookup ASIC
EGR Flex Parser
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
Dual Core 1G/10G/40G 256 Bit 24K x2
Running @ 500MHz Ethernet MACsec Netflow Records
Encryption
UADP 1.1
External Name
Catalyst 3850
Multigigabit Catalyst 3650 Catalyst 3650
Catalyst 3850 Mini
SFP+ Multigigabit
Enhanced Version of UADP
1.0 ASIC
Enhanced Power & Security Capability
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
IOS XE Evolution
Same Look & Feel, More Powerful Architecture
IOS IOS XE 3.7.x(SE) Open IOS XE 16.X
Common
CommonInfrastructure
Common Infrastructure//HA
HA Infrastructure / HA
Management
ManagementInterface
Management Interface Interface
Process
ModuleDrivers
Module Drivers Module Drivers DB
Kernel
Kernel Kernel
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
UADP ASIC & Open IOS-XE Enables…
Core
WiF
Cat 5e i>
Cables 1G
SW-1 SW-2
MultiGigabit MultiGigabit
Switch Capable AP
LDP session
MPLS Dom ain
PE P P PE CE
CE
CE PE P P PE CE
Label switched path
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
Most Importantly : Software Defined - Access
BRKARC-3467 : Cisco Enterprise Silicon - Delivering Innovation for Advanced Routing and Switching
TECCRS-2900 : From the Gates to the GUI – Innovations in Enterprise Networking, Catalyst Switching,
and Beyond!
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
Platform and ASIC
Architecture, Packet
Walk
Catalyst 3850/3650—24 Port Layout
480G STACK INTERFACE
Flash
2GB
Network Interface
USB
Dual PHY Dual PHY
Octal PHY Octal PHY Octal PHY MACSec MACSec
MACSec* MACSec* MACSec*
24 Port PoE+
2 x 10G, 2 x 1G / 4 x 1G EMP Console
24 x 1G 10/100/1000
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Catalyst 3850/3650—48 Port Layout
480G STACK INTERFACE
UADP ASIC
Clock - 375 MHz /
56Gbps
Packet Buffer Packet Buffer 800 MHz Quad-
Core CPU
Forwarding Controller Forwarding Controller
FPGA
Reassembly Reassembly
Crypto Crypto
SDRAM
Ingress Egress Ingress Egress
FIFO FIFO FIFO FIFO
4GB
Flash
2GB
Network Interface Network Interface
USB
Dual PHY Dual PHY
Octal PHY Octal PHY Octal PHY Octal PHY Octal PHY Octal PHY MACSec MACSec
MACSec* MACSec* MACSec* MACSec* MACSec* MACSec*
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Catalyst 3850 MultiGigabit — 24 Port Layout
480G STACK INTERFACE
UADP ASIC
Clock – 500 MHz / 160 Gbps
USB
10GB PHY 10GB PHY 10GB PHY 10GB PHY 10GB PHY 10GB PHY Dual PHY Dual PHY
MACSec MACSec MACSec MACSec MACSec MACSec MACSec MACSec
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Catalyst 3850/3650 MultiGigabit—48 Port Layout
480G STACK INTERFACE
UADP ASIC
Clock – 500 MHz / 160 Gbps
USB
OctalPHY OctalPHY OctalPHY OctalPHY OctalPHY 10GB PHY 10GB PHY 10GB PHY Dual PHY Dual PHY
MACSec* MACSec* MACSec* MACSec* MACSec* MACSec MACSec MACSec MACSec MACSec
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
C3850-12XS
Architecture Overview
480G STACK INTERFACE
UADP ASIC
Clock – 500 MHz / 160 Gbps
Ingress
Crypto
ASIC0
Egress Ingress
Crypto
Egress SDRAM
FIFO FIFO FIFO FIFO
4GB
Core 1 Core 0 Flash
Network Interface Network Interface 4GB
USB
EMP Console
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
C3850-24XS
Architecture Overview
480G STACK INTERFACE
UADP ASIC
Clock – 500 MHz / 160 Gbps
Ingress
Crypto
ASIC1
Egress Ingress
Crypto
Egress Ingress
Crypto
ASIC0
Egress Ingress
Crypto
Egress SDRAM
FIFO FIFO FIFO FIFO FIFO FIFO FIFO FIFO
4GB
Core 1 Core 0 Core 1 Core 0 Flash
Network Interface Network Interface Network Interface Network Interface 4GB
USB
EMP Console
1x6 10G SFP+ 1x6 10G SFP+ 1x6 10G SFP+ 1x6 10G SFP+ 2x40G, 8x10G, 4x10G
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Catalyst 3850 SFP+ 48 Port – Block Diagram
480G STACK INTERFACE
UADP ASIC
Clock – 500 MHz / 160 Gbps
Cavium
Packet Buffer Packet Buffer Packet Buffer Packet Buffer Packet Buffer Packet Buffer Packet Buffer Packet Buffer 1.3 GHz
Core 0 Core 1 Core 0 Core 1 6-Core CPU
Forwarding Forwarding Forwarding Forwarding Core 0
Forwarding Core 1
Forwarding Core 0
Forwarding Core 1
Forwarding
Controller Controller Controller Controller Controller Controller Controller Controller
Ingr Reass Egr Ingr Reass Egr Ingr Reass Egr Ingr Reass Egr Ingr Reass Egr Ingr Reass Egr Ingr Reass Egr Ingr Reass Egr
FPGA
ess embly ess ess embly ess ess embly ess ess embly ess ess embly ess ess embly ess ess embly ess ess embly ess
FIF Crypt FIF FIF Crypt FIF FIF Crypt FIF FIF Crypt FIF FIF Crypt FIF FIF Crypt FIF FIF Crypt FIF FIF Crypt FIF
O o O O o O O o O O o O O o O O o O O o O O o O
ASIC 0 SDRAM
Network Interface Network Interface ASIC 1
Network Interface Network Interface Network Interface Network Interface
ASIC 2 Network Interface Network Interface
ASIC 3 8GB
Flash
8GB
USB
10G PHY 10G PHY 10G PHY 10G PHY 10G PHY 10G PHY Dual PHY Dual PHY
MACSec MACSec MACSec MACSec MACSec MACSec MACSec MACSec
EMP Console
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
For Your
Reference
Number of ASICs in different versions of Switches
Product Version UADP Version Number of ASIC / Total Clock Speed Total Bandwidth
number Cores Available
24 Port 3850/3650 1.0 1/1 375 MHz 56 G
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Port Mappings – Platform Level Command
Cat3850-2#show platform port-asic ifm mappings local-port switch 1
Mappings Table
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Packet Walks
Unicast – within ASIC
Stack Interface
4
AQM
Q PBC – Packet Buffers Complex SQS
FIFO
T T T T
a a a a
b b b b
l l l l
e e e e
Stage #15 L
o
o
L
o
o
L
o
o
L
o
o
Stage #1 5. EQS schedule PBC to send
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
Stage #2
a a a a
Flexible
b b b b
l l l l
e e e e
to IFC Controller L
o
L
o
L
o
L
o
Stage #1
4. Descriptor has local ReWrite 7. Rewrite the packet and send
L L L L
o o o o
o o o o
6
k k k k
u u u u
p p p p
T T T T
Flex Parser
l
e
l
e
l
e
l
e
EGR
info to EQS 2
Encryption Recirculation
Engine Engine 7
Ingress
Egress
FIFO
FIFO
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Unicast – Across ASICs on Input
Stack Interface
5 4 AQM
Q PBC – Packet Buffers Complex SQS
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Flexible
b b b b
to IFC
l l l l
e e e e
Controller L
o
o
L
o
o
L
o
o
L
o
o
Controller
Stage #..
Stage #.. Look up
k k k k
Stage #1
destination, PBC sends the
L L L L
o o o o
o o o o
k k k k
u u u u
p p p p
T T T T
a a a a
info to IQS
b b b b
Flex Parser
l
e
l
e
l
e
l
e
EGR
2
5. IQS schedule PBC to send ReWrite
the packet with descriptor to Engine
Encryption Recirculation
Stack Interface
Engine Engine
Ingress
Egress
FIFO
FIFO
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Unicast – Across ASICs on Output
6
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
Stage #15 L
o
o
L
o
o
L
o
o
L
o
o
Stage #1 6. PBC received the frame and
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
Stage #2
a a a a
Flexible
b b b b
l l l l
e e e e
Controller L
o
o
L
o
o
L
o
o
L
o
o
Controller
Stage #..
Stage #.. Look up
k k k k
Stage #2
L
o
o
k
Tables
L
o
o
k
L
o
o
k
L
o
o
k
a copy to EFC and a copy to
ReWrite (includes descriptor)
u u u u
p p p p
T T T T
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L L L L
8
o o o o
k
u
p
T
a
b
k
u
p
T
a
b
k
u
p
T
a
b
k
u
p
T
a
b
ReWrite
Flex Parser
l
e
l
e
l
e
l
e
EGR Engine ReWrite
9. Rewrite the packet and send
Encryption Recirculation out though the egress FIFO
Engine Engine 9
Ingress
Egress
FIFO
FIFO
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Multicast – Egress Replication Only a single copy of packet in
Stack Interface buffer memory during replication
4
AQM
Q PBC – Packet Buffers Complex SQS
FIFO
T T T T
a a a a
b b b b
l l l l
e e e e
Stage #15 L
o
o
L
o
o
L
o
o
L
o
o
Stage #1 5. AQM within EQS generate
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
Stage #2
a a a a
Flexible
b b b b
l l l l
e e e e
to IFC Controller L
o
o
L
o
o
L
o
o
L
o
o
Controller
Stage #..
on descriptor, schedule for
Stage #.. Look up
k k k k
u u u u
Stage #1
4. Descriptor has local goes though the EFC, ReWrite
L L L L
o o o o
o o o o
6
k k k k
u u u u
p p p p
T T T T
a a a a
Flex Parser
l
e
l
e
l
e
l
e
EGR
info to EQS 2
ReWrite
Encryption Recirculation Engine
Engine Engine
Ingress
Egress
FIFO
FIFO
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Catalyst 3850 / 3650 –
UADP Performance – 375 MHz Clock
64 B Frame Speed
BW – 56G/ASIC
64 B Line 84 Mpps
Rate (56 Switching Downlinks
Gbps) Capacity Uplinks
24G 20G
Minimal
added
1/10G
latency with
Ethernet
Recirculation
(1/2 us) Recirculation
10G
CPU
2G
Downlinks + Uplinks
64 B Line 84 Mpps 68G
Rate (160 Switching
Gbps) Capacity
Minimal
added
1/10G/40G
latency with
Ethernet
Recirculation
(1/2 us) Recirculation
10G
CPU
2G
• 6 rings in total
• 3 rings go East
• 3 rings go West
• Each ring is 40Gbps
• 240Gbps uni-direction
• Spatial Reuse= 480Gbps
Stack
Interface
of UADP
ASIC Assuming 4 x 24-port 3850 Switches
6 Rings in the
Stack
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
Unicast Packet Path on the Stack Ring
Assuming
4
3
2
1
4 x 24-port
3850 Switches
Creating
Packet segmented into Segments
256 bytes Re-ordering
segments
Packet travels half the
ring for unicast traffic
Segments reordered at
destination stack port
Destination strips the
packet off the stack ring
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
Stack Ring Spatial Reuse
4
3
1
2
Assuming
4 x 24-port
3850
Switches
Credit based system on
the Stack Ring
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Stack Ring Spatial Reuse
4
3
1
2
Assuming
4 x 24-port
3850
Switches
Unicast flows use only
part of the Ring
Increases the stack ring
bandwidth to 480Gbps
3
1
2
4
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
Multicast Packet Path on Stack Ring
Assuming
4 x 24-port 3
1
2
4
3850 Switches
One copy of the source packet
is placed on the rings
Interested Stack Ports grab the
segments when they see them
Packet segments travel the
whole ring back to source
The source strips these
segments off the ring (Source
Stripping)
Results in efficient replication of
multicast traffic for multiple
Stack Port receivers
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
Resiliency – StackWise-160
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
How many Can I stack together?
Up to 9 Up to 32
Cores
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
High Availability – Data
and Power Stacks
Catalyst 3850 Stack vs. Catalyst 6500
• Active and Standby Members run • Active and Standby Supervisors
IOSd, WCM, etc. • Run IOS on Supervisors
• Synchronize information • Synchronize information
• Active controls Data plane programing • Active programs all DFCs
for all members • DFCs run a subset of IOS for LCs
• Member switches act as Line cards–
connected via the Stack Cable
A A S
S
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
Catalyst 3850 System Architecture
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
Stack Active Election
A
1) The stack (or switch) whose member
has the higher user configurable
priority 1–15
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 64
Stack Initialization
Active starts RP Domain (IOSd, WCM, etc)
locally 2min timer
Programs hardware on all LC Domains
LC RP Infra A
Traffic resumes once hardware is programmed
RP LC Infra
S
Starts 2min Timer to elect Standby
in parallel
Active elects Standby LC Infra
Catalyst3850#switch 1 priority 15
Power up the first Switch that you want to make
it as Active A
Configure Priority of the switch (1-15) – 1 by Catalyst3850#switch 2 priority 14
default – the higher the better
S
Power up the second member that you want to
make as Standby & then power up rest of the Catalyst3850#switch 3 priority 13
members
To add a member to an existing stack plug in the Catalyst3850#switch 4 priority 12
stack cable first, then power up the switch
Avoid stack Merge & Stack split if possible
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
Stack Split – Double Failure – Scenario #1
Stack speed is reduced by half because of A
the half ring
The top side of the split remains stable,
Active initiating Clean up for the S
members data
Lower Side of the Stack reboots - Active
election is held on the lower side of the split
Active starts RP domain locally and programs
local hardware as well as that of the member
Active elects Standby (after 2 min timer), and
RP A
signals Standby to start its RP Domain
Active and Standby perform Bulk Sync as RP S
part of HA – where lower member is
Standby-Hot
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
Stack Merge – Two Active members in one Stack
1
RP A
Full ring is restored
Stack Discovery runs to build Stack 2
topology with broadcast and neighbor RP S
A
cast packets
HA detects there are two Active switches
(1 and 2) in Stack
3
Whole Stack reboots RP S
Stack initialization happens as before
Configuration of the Active elected is
RP S
downloaded on all members 4
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
Stack Member Addition
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
Stack Member Deletion
Configuration is moved to
Pre-Provisioned state
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
Stackwise Virtual
StackWise Virtual Architecture
Extending StackWise Architecture
Access-1
SW-1
SW-2
Dist-1
SW-3
SW-5
40G/10G
WS-C3850-48XS WS-C3850-48XS
SW-6
SW-7
SW-8
SW-9
• Cisco StackWise Virtual extends proven back-panel technology over front-panel network ports
• Cisco StackWise Virtual simplifies the Distribution-Layer with two common 3850-48XS series
chassis into single logical entity
• Added Support for StackWise Virtual in 16.8 on 3850-12XS and 3850-24XS
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
StackWise Virtual Architecture
Unified Forwarding Architecture
Core
Core
SW-1 SW-2
Distribution
40G/10G
WS-C3850-48XS WS-C3850-48XS
Access
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
High Availability For Your
Related Sessions Reference
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
Stack Power
StackPower - Overview
“Zero-Footprint” RPS deployment
• Provides RPS functionality with Zero
RPS Footprint
• Pay-as-you-grow architecture –
similar to the Data Stack
• 1+N Redundancy with Inline Power
• Up to 4 Switches in a StackPower
Ring
• Multiple StackPower Possible within
one Data Stack
• Up to 9 Switches in a star topology
with XPS
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
Power Budget Modes
Power Sharing Mode Redundant Mode
1100 1100
715 W 715 W
W W
715 715
W W
#CLUS
Global Stack Power Reserve = 30 ~ 60W BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
How StackPower Works?
Power Sharing Mode – Default Mode
StackPower
1100W AC
715 W
715W AC
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
How StackPower Works?
Redundant Mode
StackPower
1100W AC
715 W
715W AC
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
Enforcement Modes
Strict & Loose Modes Control The Behavior of Load Shed
BUDGET ALLOCATED ACTUAL BUDGET ALLOCATED ACTUAL
Available Committed Drawn Available Committed Drawn
Power Pool Power Power Power Pool Power Power
Lost PS or Lost PS or
Power source Power source
Shed Load
Lost Shed Load
another PS
Dropped PD Dropped PD
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
For Your
System Power Reserved Reference
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Scale
UADP ASIC Block Diagram
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
IGR o
k
u
p
T
a
o
k
u
p
T
a
o
k
u
p
T
a
o
k
u
p
T
a
b b b b
l l l l
e e e e
Stage #15 L
o
o
L
o
o
L
o
o
L
o
o
Stage #1
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Flexible
b b b b
l l l l
e e e e
Controller L
o
o
L
o
o
L
o
o
L
o
o
Controller
Stage #..
Stage #.. Look up
k k k k
u u u u
p p p p
T T T T
Stage #2
L
o
o
k
u
p
T
a
Tables
L
o
o
k
u
p
T
a
L
o
o
k
u
p
T
a
L
o
o
k
u
p
T
a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
ReWrite
a a a a
Flex Parser
b
l
e
b
l
e
b
l
e
b
l
e
EGR Engine
Encryption Recirculation
Engine Engine
Ingress
Egress
FIFO
FIFO
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
TCAM and SRAM
12 K TCAM
Switch# show platform hardware fed switch act fwd-asic resource tcam utilization
CAM Utilization for ASIC Instance [0]
Table Max Values Used Values
--------------------------------------------------------------------------------
SRAM
Unicast MAC addresses 32768/512 15/21
L3 Multicast groups 4096/512 0/7
L2 Multicast groups 4096/512 0/9
Directly or indirectly connected routes 16384/7168 2/18
QoS Access Control Entries 2560 88
Security Access Control Entries 3072 114
...
...
Netflow ACEs 768 15
Input Security Associations 256 4
Output Security Associations and Policies 256 5
OUTPUT_GROUP_LE 6144 0
Macsec SPD 256 2
Switch#
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
Catalyst 3850 – TCAM & ACL Scale
TAQs 3 & 4
Reserved for
Security ACLs
ACL Resources
IPv4 Entries 3000 Entries RACL Region 1
5
3
IPv6 Entries Half the IPv4 6
PACL
One type of IPv4 ACL (RACL, 1500 Entries Region E
PACL, VACL, GACL*) n
t
L4OPs/Label 8 L4OPs VACL r
Region i
e
Ingress VCUs 196 s
GACL
Region
Egress VCUs 92
256 Bits Entries Each (512
• GACL (Group Client ACL) – Any dot1x client attached features like dACL, QoS, for IPv6 Entries)
Filter ID, Per User ACLs are in GACL region Regions are flexible BUT cannot span across TAQs
• Order of Processing : GACL PACL VACL RACL
• TAQ – ACL TQD (TCAM Quads)
• VCU = Value Comparison Unit
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 85
Catalyst 3850 – Netflow Scale
Configuring FNF involves 4 major steps:
Ingress & Egress FnF supported on all ports, VLANs & SSIDs
System Scalability: 24K flows / ASIC. 1.0 and 2 x 24k / ASIC 1.1
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 86
Catalyst 3850/3650 – QoS Fundamental Actions
Conditional
Policing Marking
Trust Classification
Unconditional
Marking
Conditional
Marking Policing
Classification PQ1
PQ or Q
Scheduler
PQ2
8q3t
Unconditional
Marking 1p7q3t Q3
2p6q3t Q4 WTD
Q5 WRR
Q6
Q7
Q8
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 87
Catalyst 3650/3850 Campus QoS Design
Wired Port Egress Queuing (2P6Q3T with WTD) Model
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
6MB Packet Buffer
Packets to Egress Port Queues
3MB-4MB EQC
0.6MB
0.75MB-1MB
Packet 0.5MB-1MB SQS
Holding Buffer IQS
Packets from the Stack And
Locally Switched Packets
Packets going to Stack
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
Policing
No No B>Tc No
B<Tc B>Tp
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 90
Catalyst 3850 – QoS Scale
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 91
Key Differences –
Catalyst 3850/3650 vs 3750-X/E
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
For Your
Catalyst 3850 – SD-Access Scale Reference
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
Software Innovations
Trustworthy Systems
Secure by Design
MACsec
Encryption
Anti-Counterfeit
Phase 2 (ACT2)
Secure Storage
Secure UDI Secure Hardware
HW Entropy Development
Data at Rest Encryption Boot Code
Hardening
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
REAL WORLD: Converted 3750-X 24 to 48 Ports
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
Cisco Secure Boot and Trust Anchor Module
Validating the Authenticity of Software Followed by Hardware
Step 5 Step 6
Step 1 Step 2 Step 3 Step 4
Trust Anchor Trust Anchor
module module
*
CPU CPU CPU CPU CPU
Microloader Bootloader OS OS OS
Microloader
* The first instructions that run on a CPU are either stored in immutable hardware so that they cannot be tampered with or are validated by the hardware
*
Hardware authenticity check
Software authenticity check
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 98
Trustworthy Systems - Features Supported
Feature Catalyst 3850/3650
Image Signing Yes
Reference:
FLIPSEC-1010 Malware on Network Elements – Protect and Verify with Trustworthy Systems
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
Fast Software Upgrade (16.8)
Regular Upgrade Vs Fast Software Upgrade Process
Normal Upgrade Time Fast Software Upgrade Impact
Traffic Traffic
Reload
X sec Kernel X/2 sec
Reload
Traffic is impacted throughout the upgrade Traffic impact is reduced by more than half by
cycle #CLUS separating ©the control
2018 Cisco andAll rights
and/or its affiliates. data plane
reserved. updates
Cisco Public 100
Fast Software Upgrade
Supported and Unsupported Designs
STP
L2 Only L2 Only
x x Vlan1-10
L2 Only
MEC MEC
Access Access Access
Layer Layer Layer
Unsupported Designs
L2 Extensions with
Access Layer Device L3 connections with
Routing Protocols
Access
Layer Roadmap
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
Software Maintenance Upgrades
Software Upgrades are Challenging
Cost
Time SMU
• Reduced IT staff slows software roll out Point Fixes
Reduces Validation –
• Physical presence required Scope & Time
Scope
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
SMU Types
• Cold Patching (traffic-affecting)
Install of a SMU will require a system reload from 16.8 and 16.6(3)
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 103
Catalyst 3850 12/24/48 XS ISSU Workflow for SVL
(16.8) 1. ISSU Started, Image is
expanded on Active and Standby
V1 S1 Active
If S2 fails to become standby it
will revert back to step 1
2. Standby Reloads
with the new V2 Image
V2
5. ISSU S1 Standby
V1 S1 Active
Expired Abort timer will revert
Complete to Step 2 and then Step 1
V2 S2 Active V1 V2 S2 Standby
Abort Timer
Expired
Abort Timer
Stopped
V1 V2 S1 Standby
3. Auto-Switchover causes S2 to
4. ‘Commit’ Keyword become new active and S1 reloads
stops the abort timer
V2 S2 Active
with the new V2 image
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
Software-Defined Access
Solution Components
DNA Center:
Simple Workflows
DNA Center
DNAC
Network Data Services Identity Services Engine
Appliance
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
Software Defined Access For Your
Related Sessions Reference
PSOCRS-2003 : A Revolutionary New Way to Build and Manage Digital Ready Networks
CCP-2001 : DNA SD-Access - Roadmap
LTRCRS-2810 : DNA SD-Access - Hands-On Lab
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
Software Defined Access For Your
Related Sessions Reference
BRKCRS-2893 : Choice of Segmentation and Group based Policies for Enterprise Networks
BRKARC-3467 : Cisco Silicon - Delivering Innovation for Advanced Routing and Switching
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
Programmability & Data Models
NETCONF (16.6)
RESTCONF (16.8)
gNMI (16.8)
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
Network Device Lifecycle Goal:
Get devices into an operational state
Provisioning Automation Tools:
Goal: PXE, ZTP, PnP
Continuously upgrade Python Scripting
network, incrementally
and safely
Tools: Install
Patching
Config/Replace
Goal:
Apply configuration to the
Upgrade Configure device
Tools:
Goal:
Data Models
Add dynamic services,
optimize behavior and Programmable Interfaces
Optimize
trouble shooting Python Scripting
Tools:
Telemetry
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 109
Audio Video Bridging
Convergence of AV on Ethernet with Cisco Catalyst Switches
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 110
Cisco MultiGigabit – Now IEEE 802.3bz
WiFi > 1G
Cat 5e Cables
2.5-5G!
MultiGigabit MultiGigabit
Switch Capable AP
RES
T
Based on REST Open IETF Standard
Lets ‘You’ chose Secure
(GET PUT POST) (RFC 7252)
the date Model
L6 HTTP 80
L5 FTP 20/21
AVC
L4 POP3 110
Netflow
L3 IMAP 143
L2 HTTPS 443
L1 SMTP 25
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 114
Enabling and Monitoring AVC – CLI
GigabitEthernet1/0/23
CLI Input Output
switch# show run int g1/0/23 ----- ------
Protocol Packet Count Packet Count
Building configuration... Byte Count Byte Count
5min Bit Rate (bps) 5min Bit Rate (bps)
interface GigabitEthernet1/0/23 5min Max Bit Rate (bps) 5min Max Bit Rate
switchport access vlan 193 ------------------------ ------------------------ ------------------------
ip nbar protocol-discovery youtube 356 187
end 264713 25603
0 0
6000 3000
bing 2741 2384
493258 423925
0 0
3000 3000
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 115
WebUI – Monitoring AVC
• Filter Monitoring Over
Ingress/Egress
interfaces and
direction
• Monitor percentage
Bandwidth usage
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 116
MPLS Enables Network Segmentation in Campus
INTERNET
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 117
Conclusion
Catalyst 3850/3650 is built on Robust Architecture
+
The Combination of UADP and IOS-XE 16.x Makes your Network Ready and Future proofed
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 119
2013 2015 2017
Converged
Converged OS Converged ASIC Licensing
Open IOS-XE UADP 2.0 Packaging
Catalyst 9300
Lead Fixed Access
Catalyst 9500
Lead Fixed Core
Catalyst 9400
Lead Modular Access
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 121
Catalyst 9000 For Your
Related Sessions Reference
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 122
What to Do Next?
Technical Advisor y
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 123
Complete your online session evaluation
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 124
Continue
your Demos in
the Cisco
Walk-in
self-paced
Meet the
engineer
Related
sessions
education campus labs 1:1
meetings
#CLUS BRKARC-3438 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 125
Thank you
#CLUS
#CLUS