Disjoint Layer2 Uplinks (DLU)

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Overview
In UCS release 1.4, network facing interfaces are configured to support all VLANs in the system.
There is no way to configure a subset of VLANs on a network facing interface. A single network-facing interface is selected to receive multicast/broadcast traffic from the upstream network. This limits UCS to deployments where the upstream networks are symmetrical (all LAN segments are reachable by each border interface).

Only workaround prior to 2.x was Switch Mode

Brad Hedlund explains Disjoint Layer 2 concepts and workarounds concerning 1.4 and earlier: http://www.youtube.com/watch?feature=player_embedded&v=hL nBucShu38

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Disjoint Layer 2 Sample Topology

Prod VLANs 1-20
Network 1 VLAN 177

Dev VLANs 2130

Network 2 VLAN 178

Network 3 Backup VLAN 183 VLAN 31

BIF1

BIF2

BIF3

BIF1

BIF2

BIF3

UCS A

UCS B

Assumptions There is no overlap in VLAN IDs between the disparate networks Both FIs have access to the same set of VLANs. This ensures the function of fabric failover.
Presentation_ID 2010 Cisco Systems, Inc. All rights reserved. CAE Bootcamp

Disjoint L2 Configuration Overview

Define all necessary VLANs

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Disjoint L2 Configuration Overview

Launch LAN Uplink Manager

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Disjoint L2 Configuration Overview

Associate VLANs with Uplinks

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Disjoint L2 Configuration Overview

Verifying Configuration

From UCSM CLI NXOS Context:

show interface trunk Should expect to see your associated VLANs on the assigned interfaces only. Ex. Eth 1/16-17 are Uplinks
Port Vlans Allowed on Trunk ---------------------------------------------------------Eth1/16 1,5-7,1000,3000 Only Eth1/16 allows VLAN 5 Eth1/17 1,6-7,1000,3000 Veth705 1000 Veth709 1,1000 <snip>
Presentation_ID 2010 Cisco Systems, Inc. All rights reserved. CAE Bootcamp

Service Profile Circuit Paths

A servers virtual interface (VIF) mapping can be displayed with the show service-profile circuit command. The VIF number can be used in the NXOS level of the FI to trace a path to the upstream.
UCS-B# show service-profile circuit server 1/1 Service Profile: root/ESXi_3 Server: 1/1 Fabric ID: A VIF vNIC Link State Overall Status ---------- ---------- ---------- -------------41 Unknown Unknown 9158 Up Active 964 eth0 Up Active 966 fc0 Up Active Fabric ID: B VIF vNIC Link State Overall Status ---------- ---------- ---------- -------------42 Unknown Unknown 9159 Up Active 965 eth1 Up Active 967 fc1 Up Active Admin Pin ---------0/0 0/0 0/0 0/0 Admin Pin ---------0/0 0/0 0/0 0/0 Oper Pin ---------0/0 0/0 0/3 0/0 Oper Pin ---------0/0 0/0 0/3 0/0 Transport --------Unknown Ether Ether Fc Transport --------Unknown Ether Ether Fc

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Active Border Interfaces

The interface a VIF will use to reach the upstream network can be determined by analyzing the active border-interfaces on the FI:
UCS-B(nxos)# show pinning border-interfaces active

--------------------+---------+---------------------------------------Border Interface Status SIFs --------------------+---------+---------------------------------------Eth1/7 Active Veth729, Veth730 Eth1/8 Active Veth731 Eth1/9 Active Veth732 Eth1/16 Active Veth733 Eth1/17 Active Eth1/18 Active Eth1/19 Active Eth2/1/29 Eth1/20 Active Veth706 Eth1/21 Active Eth1/22 Active
Total Interfaces : 10 FI-6248-B(nxos)#
9

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

Determining DR for Bcast & Mcast

The Designated Receiver (DR) port can be determined by: UCS-B(nxos)# show platform software enm internal info vlandb [id x] | all
vlan_id 1 ------------Designated receiver: Eth1/8

Membership:
Eth1/8 Eth1/9 Eth1/17 vlan_id 5 ------------Designated receiver: Eth1/16 Membership: Eth1/16 <snip>
Presentation_ID 2010 Cisco Systems, Inc. All rights reserved. CAE Bootcamp

Eth1/16

Eth1/18

Eth1/19

Eth1/20

Eth1/21

Eth1/22

10

Disjoint Layer 2 Notes

Default behavior is same as pre-2.0. VLANs will be allowed on all interfaces. If no interfaces are implicitly assigned to a VLAN, then default behavior will be implemented & that VLAN will be allowed on all interfaces (traffic dynamically pinned in Round Robin fashion) In UCSM 2.0, a designated broadcast/multicast receiver is allocated on a per VLAN basis rather than on a global basis. For a downgrade, disjoint Layer 2 config should be removed as it will not be supported in versions prior to UCSM 2.0 and may cause traffic disruption.
Presentation_ID 2010 Cisco Systems, Inc. All rights reserved. CAE Bootcamp

11

Presentation_ID

2010 Cisco Systems, Inc. All rights reserved.

CAE Bootcamp

12