Design and Automate With NDFC
Design and Automate With NDFC
#CiscoLive
Cisco Webex App
https://ciscolive.ciscoevents.com/
ciscolivebot/#BRKDCN-2918
Questions?
Use Cisco Webex App to chat
with the speaker after the session
How
1 Find this session in the Cisco Live Mobile App
BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 2
• Flexible Design options for
VXLAN EVPN
• External Handoff options for
VXLAN EVPN
Agenda • Introduction to NDFC
• Automate VXLAN EVPN
Single-Site with NDFC
• Conclusion
BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Data Center
Network
Requirements
What are our basic network requirements?
1) Provide paths for endpoints to communicate at 4) Communication to external L2 networks (DCI)
Layer2(MAC) and Layer3(IP) 5) Communication to external L3 networks (WAN)
2) Provide separation of endpoint into Layer2
forwarding domains (VLAN or BD)
3) Routing between IPv4/IPv6 subnets and allow
separation of these into multiple VRFs
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
What are our basic network requirements?
6) Allow security policies in order to limit communication to between endpoints to allowed protocols.
ip access-list web-in
VLAN 1 VRF1 VLAN 2 permit tcp Subnet1 Subnet2 eq 80
Subnet1 Subnet2 ip access-list web-out
permit tcp Subnet2 eq 80 Subnet1
EP1 EP3
80
ip access-group web1 in
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
What Physical Topology is required?
• Physical topology must support our endpoint communication
(layer-2 / layer-3), and the location of endpoints within the physical
network will affect the supporting design/configuration.
VLAN VLAN L2 L3
EP1 EP2 EP3 EP4
1 2 External External
VRF-1
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
Data Center Network Evolution
Well-Known but Legacy Methods
Core
Access
Classic Spanning-Tree
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
Data Center Network Evolution
Well-Known but Legacy Methods
Core
Access
Core
Layer-2 FabricPath
Leaf
FabricPath (Mac-in-Mac)
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Data Center Network Challenges
Of Legacy Methods
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Next Generation– VXLAN BGP EVPN Fabrics
Becoming Industry De-Facto Standard
• An IGP is recommended for the underlay
(OSPF or IS-IS) R R
• BGP can also be used if needed
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
Data Center Network Challenges
Solving it with VXLAN EVPN
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
A Leaf and Spine
Paradigm
Kick Start your VXLAN Fabric!
A Leaf and Spine Paradigm
Spine
• IP Transport
• BGP EVPN
Control Plane Tier-2
(RR)
Stage-2
Stage-1 Stage-3
• Connect Endpoints,
Service Nodes, and
External Networks.
• BGP EVPN Control Tier-1
Plane
• VXLAN
Leaf
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
VXLAN Single-Site
Flexible Design
Leaf Node Placement Option
Spine EVPN Route
Attachment Next-hop
Type
Leaf as Standalone VTEP
vPC N/A
- Seen as an individual VTEP (PIP) Type 2
(Host Routes) Orphan Port Advertised by PIP
- No HA, Orphan hosts only PIP- 10.1.1.1 PIP- 10.1.1.2
Type 5 vPC N/A
Leaf-1 Leaf-2 (IP Prefix
Routes) Orphan Advertised by PIP
Spine
Leaf as vPC VTEP EVPN Route
Attachment Next-hop
- Seen as a single logical VTEP (VIP) Type
- Legacy vPC Peer-Link required Type 2 vPC Advertised by VIP
VIP- 10.1.1.3
- HA with Dual-Attached and Orphan hosts PIP- 10.1.1.1 PIP- 10.1.1.2
(Host Routes) Orphan Port Advertised by VIP
- Possibility for L4-7 peering Type 5 vPC Advertised by VIP
Leaf-1 Leaf-2 (IP Prefix
Routes) Orphan Advertised by VIP
Spine
Leaf as vPC Fabric-Peering VTEP EVPN Route
Attachment Next-hop
- Seen as a 3 “three” VTEP (PIP + VIP) Type
- No need for Physical Peer-Link Type 2 vPC Advertised by VIP
VIP- 10.1.1.3
- More ports available for EPs (Host Routes) Orphan Port Advertised by PIP
PIP- 10.1.1.1 PIP- 10.1.1.2
- HA with Dual-Attached and Orphan hosts Type 5 vPC Advertised by PIP
- Possibility for L4-7 peering Leaf-1 Leaf-2 (IP Prefix
Routes) Orphan Advertised by PIP
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Super-Spine Node Placement Option
Scale-out Multi-Clos Fabric to Interconnect the PODs using
Super-Spine R R
Super-Spine
Architecture beyond a single server room. Simpler capacity
planning
Spine
Leaf hosts:
- East-West VXLAN (VTEP)
Spine hosts: V V V V
- Layer-3 IP Transit Leaf
Super-Spine hosts:
- Route Reflector (RR) (iBGP EVPN) POD-1 POD-2
- Rendezvous Point (RP) (Multicast Underlay BUM)
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
External Handoff
Border Placement
Border Node Placement Option
Border as Leaf (Flexible Design option-1)
North-South
Clean role separation and uniform reachability from
the entire fabric are the major advantages L2VPN EVPN
R R
Support for Inter-AS option A (VRF-LITE) and Spine
seamless VXLAN-MPLS gateway (Border-PE)
V V V V
Optionally it can have directly attached endpoints Leaf
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Border Node Placement Option
Border Spine (Flexible Design option-2)
North-South
V V L2VPN EVPN
Border Spine hosts: R
R
- North <> South VXLAN (VTEP) <> IP handoff Border Spine
- Route Reflector (RR) (iBGP EVPN)
- Optionally Rendezvous Point (RP) (Multicast Underlay BUM)
V V V V
Leaf
East-West
R = RR/RP
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Border Node Placement Option
Border on top of Super-Spine (Flexible Design option-3)
External Network
Capacity planning only for North-South traffic flows
Edge Router
Clean role separation and uniform reachability from the
entire fabric are the major advantages IPv4/IPv6/L3VPN
V V
Support for Inter-AS option A (VRF-LITE) and seamless Border Leaf Handoff
VXLAN-MPLS gateway (Border-PE)
L2VPN EVPN
R R
North-South
Optionally it can have directly attached endpoints Super-Spine
V V V V
Leaf
V V = VTEP
POD-1 POD-2
R = RR/RP VXLAN EVPN Site
East-West
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Border Node Placement Option
Border Super-Spine (Flexible Design option-4)
North-South
Spine Handoff
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
External Handoff
Connectivity
External Layer-3 connectivity options
Inter-AS Option A
Clear separation of Autonomous Systems Separated Border + PE
Simple, Straight forward, and Commonly used (Inter-AS Option A)
No need for redistribution VPNv4/VPNv6 External Network
MPLS-LDP or SR-MPLS
Easy and Flexible BGP route-filtering mechanisms
Edge Router BGP 65099
BGP natural loop avoidance
Structured handoff between the VXLAN BGP EVPN fabric and the IPv4/IPv6
external routing domain (Backbone, WAN, Campus, etc.)
V V
Not ideal for High scale VRF handoff deployment Border Leaf BGP 65001
EP1- 192.168.10.10/32
Network – 192.168.10.0/24
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
External Layer-3 connectivity options
Inter-AS Option A Network – 10.0.0.0/8
External Network
Edge Router uses per-VRF eBGP session to advertise External network
with itself as Next-Hop Edge Router BGP 65099
V V V V
Leaf
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
External Layer-3 connectivity options
Seamless Protocol Gateway Model (Border-PE)
Combines two different encapsulations and
Address Family, using a “single-box (Border- Seamless Stitching between
PE)” instead of a “two-box (CE-PE)” model
VXLAN, MPLS, and SR
VXLAN VTEP Border nodes also becomes a
External Network
MPLS L3VPN Provider Edge (PE), resulting in
a role called Border-PE
Remote PE BGP 65099
Best suited for high scale VRF deployment
VPNv4/VPNv6
Saves CAPEX and OPEX MPLS-LDP or SR-MPLS
Seamless stitching between L2VPN EVPN
and VPNv4/v6 Address Family Reoriginate EVPN Prefix in L3VPN V V
Border-PE
Reoriginate L3VPN Prefix in EVPN BGP 65001
BGP route-filtering mechanisms available
VXLAN EVPN
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
External Layer-3 connectivity options
Seamless Protocol Gateway Model (Border-PE)
EVPN routes are imported into the local VRF instance according to
the BGP Route-Target filtering
Imported routes are re-exported to the VPN address family, and a MPLSP VPN AF
local VPNv4/v6 MPLS label is allocated External Network
Re-exported routes are Re-originated and advertised to eBGP BGP Update BGP 65099
peers with the allocated VPNv4/v6 MPLS label alongside local RD [Prefix/RD2/RT2/LB1]
and RT of Border-PE. The per-VRF VXLAN fabric relevant BGP RT is Remote PE
stripped off VRF Export MPLS-LDP or SR-MPLS
[Prefix/RD2/RT2]
Key Description
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
External Layer-3 connectivity options
Seamless Protocol Gateway Model (Border-PE)
MPLS routes are imported into local VRF according to Route-
Target filtering. Routes are imported into local RIB and FIB with
MPLS label.
MPLSP VPN AF
Imported routes are re-exported to the EVPN address family External Network
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Advertise VTEP Primary IP Address
What exactly is Advertise-PIP and Why you need it?
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Advertise VTEP Primary IP Address
What exactly is Advertise-PIP and Why you need it?
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
Advertise VTEP Primary IP Address
What exactly is Advertise-PIP and Why you need it?
router bgp 65001
address-family l2vpn evpn
advertise-pip
On both VPC peer Border Backbone
Interface nve1 Devices
advertise virtual-rmac
vPC VIP
10.13.0.3
The advertise-pip command lets BGP use the PIP as next-hop PIP-1 PIP-2
when advertising prefix routes or leaf-generated routes if vPC is 10.13.0.1 10.13.0.2
enabled. With the advertise-pip and advertise virtual-rmac
commands, EVPN Type-5 routes are advertised with PIP, and
EVPN Type-2 routes are still advertised with VIP. In addition, a
virtual MAC will be used with the VIP that is shared by both vPC
peers, and individual peer specific system Router MAC will be
used with PIP when the advertise-pip feature is enabled. In this
way, the traffic will always be destined to the right vPC peer. MP-BGP EVPN Table
Backbone →
10.13.0.1, 10.13.0.2
VXLAN EVPN Site
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
Who can be the
External Edge Router?
Edge Router Placement Option
Nexus and Non-Nexus support
External Network External Network External Network
Data Center VXLAN EVPN Data Center VXLAN EVPN Data Center VXLAN EVPN
Managed NX-OS as Edge Router Managed IOS-XR as Edge Router Managed IOS-XE as Edge Router
- Nexus 9000 - Cisco 8000 - Catalyst 9000
- Nexus 7000 - ASR 9000 - Catalyst 8000
- NCS 5500 - ASR 1000
- CSR 1000
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Cool! But What’s the Catch?
There is always a catch ☺
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
What is Nexus
Dashboard
Fabric
Controller?
Cisco Nexus Dashboard Powering automation
Unified agile platform
Simple to automate, simple to consume
Insights
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Cisco Nexus Dashboard Fabric Controller
App accessed through Cisco Nexus Dashboard
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
Cisco Nexus Dashboard Fabric Controller
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Automation
Accelerate provisioning from days to minutes
DevOps friendly
Benefits
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Management Single point for management
for data center operations
Optimized for both large deployments
and traditional deployment models
Granular RBAC
Image management
RMA
Change Control
Benefits
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Visibility & Monitoring
Get comprehensive monitoring
Benefits
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Cisco NDFC Modes
Make decision at run-time!
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Fabric Discovery
Benefit
Benefit
Benefit
Physical ND Cluster
VM VM
Data Broker SAN Controller
Virtual ND Cluster
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Cisco Nexus Dashboard Formats - NDFC
Each node is a UCS Server with: For NDFC each vND VM must
satisfy the following requirements:
2.8GHz AMD CPU Specs APP
256G RAM
4x2.4TB HDD vCPU 16
960 GB SSD
1.6 TB NVMe drive RAM (GB) 64
For the latest information check the specific SSD (GB) 550
scalability guide. 12.1.3b Verified Scalability
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Cisco Nexus Dashboard Scaling - NDFC Cisco NDFC 12.1(3)
Full scale for NDFC can Full scale for NDFC can Switches per Fabric: Switches per Fabric:
be achieved with 3 be achieved with 5 200 200
nodes nodes
Overlays: 500 VRF and Overlays: 400 VRF and
Managed mode (VXLAN Managed mode (VXLAN 2000 Layer-3 Networks 1050 Layer-3/Layer-2
and BGP fabrics): 500 and BGP fabrics): 400 OR 2500 Layer-2 Networks
switches switches Networks
Multi-Site Domain: 30
Managed/Monitor mode Managed/Monitor mode Multi-Site Domain: 30 fabrics
(External fabrics): 1000 (External fabrics): 1000 fabrics
switches switches
ToR/Leaf: 40 Leaf
Overall fabric count: 50 Overall fabric count: 50 (VTEP) and 320 ToRs in
DC VXLAN EVPN fabric
Recommended 3x vND can support 100
switches in managed
mode
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Cisco Nexus Dashboard Connectivity - NDFC
Data/Fabric Network The two interfaces cannot share the
L2
bond0br same subnet
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
NDFC Persistent IPs
Persistent IPs are tied to a
service, like the SNMP trap
receiver
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
NDFC Persistent IPs – Normal conditions
Data/Fabric Network
bond0br
Management Network
bond1br
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
NDFC Persistent IPs - Failover
Data/Fabric Network
bond0br
Management Network
bond1br
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Cisco Nexus Dashboard Connectivity - NDFC
Data/Fabric Network bond0br
L3
This L3 options is valid since
MAX RTT 50msec
12.1.1e
172.17.20.127/24 172.17.20.128/24
10.1.1.101/24 10.1.2.101/24 10.1.3.101/24
172.17.20.128/24
10.1.1.101/24 10.1.2.101/24 10.1.3.101/24
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Cisco NDFC Connectivity to the Switches Use case #2
MAX RTT
50msec
ND Mgmt ND Data Subnet Fabric Mgmt 0 Fabric Inband LAN Device Management
Subnet Subnet Subnet Connectivity must be set to
Data
10.2.2.0/24 10.1.1.0/24 10.1.1.0/24 10.3.3.0/24
(see next slide)
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
Cisco NDFC Connectivity to the Switches Use case #2
continues
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
Cisco NDFC Connectivity to the Switches Use case #3
MAX RTT
50msec
ND Mgmt ND Data Subnet Fabric Mgmt 0 Fabric Inband A static route to 10.4.4.0/24
Subnet Subnet Subnet must be added in ND
Management Interface
10.2.2.0/24 10.1.1.0/24 10.4.4.0/24 10.3.3.0/24
(see next slide)
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 62
Cisco NDFC Connectivity to the Switches Use case #3
continues
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
Cisco NDFC Connectivity to the Switches Use case #4
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
Why NDFC?
Multi-Topology, Multi-Protocol
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
Why NDFC?
Multi-Domain, Multi-Platform
NX-OS Nexus 9000 and 3000 IOS-XE Catalyst 9000 IOS-XR ASR 9000
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
Why NDFC?
In a nutshell…
Step into SDN via VXLAN BGP EVPN Multi-OS management and support
Config and Compliance across Cisco Products Simplify Complex Network Operations
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
Automate VXLAN EVPN deployments
Provision a new fabric in minutes
VXLAN Fabric
Accelerate fabric deployments Automated consistency Minimize risk Support for both Greenfield and Brownfield deployment
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
Manage and Deploy
VXLAN BGP EVPN
with NDFC
VXLAN BGP EVPN Greenfield
Not on VXLAN EVPN Today?
NDFC Fabric Controller Build VXLAN fabric Templates already IP addresses, overlay pool,
Mode in few minutes embed best practices routing profiles, replication
attributes –all taken
care by NDFC
Step 1 Step 3
Create Recalculate and Deploy Fast, automated process
Define fabric settings (Underlay, Overlay) - Generates config based on intent
AS#, Replication Mode, IGP, IP Pools, etc. Preview side by side diffs
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
NDFC Day-0:
VXLAN EVPN
Underlay
Step1 -> Create a Fabric
Create Fabric
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
Step1 -> Create a Fabric
(continued)
BGP ASN
VXLANv4
or
VXLANv6
RR > 2 or 4
PM Metrics
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
Step1 -> Create a Fabric
(continued)
BUM >
Multicast or
Ingress
Replication
L2VNI
Multicast
Group
RP > 2 or 4
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
Step1 -> Create a Fabric
(continued)
Cisco’s Best
Practice
Configuration
Templates
VXLAN Overlay
Mode > CLI or
Config-Profile
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
Step1 -> Create a Fabric
(continued)
L2VNI Label
L3VNI Label
Router ID
VRF_LITE
VTEP IP Handoff
RP IP
P2P Underlay IP
VRF_LITE IP
Range
L4-L7 Service
Network
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
Step1 -> Create a Fabric
(continued)
NDFC Built-In
Bootstrap POAP
Services. Supports
OOB and In band
POAP
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
Step2 -> Add Switches
Add Switches
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
Step2 -> Add Switches
(continued)
Switch Mgmt0 IP
Switch Discovery
Credentials
Switch Hops
based on CDP
Discover
Switches
VXLAN Greenfield or Brownfield
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Step2 -> Add Switches
(continued)
Switch Inventory
Management
Add Switches
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 82
Step3 -> Set Role
Topology View
Switch Roles
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
Step4 -> VPC Pairing
(optional)
Hierarchical Topology
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
Step4 -> VPC Pairing
(optional)
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 85
Step5 -> Recalculate and Deploy
Fabric
Recalculate and
Deploy
Pending
Configuration
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 86
Step5 -> Recalculate and Deploy
(continued)
Fabric
Configuration
status
Pending
Configuration
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 87
Step5 -> Recalculate and Deploy
(continued)
Spine related
features
Spine EVPN
RR Client
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
Step5 -> Recalculate and Deploy
(continued)
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
NDFC VXLAN EVPN Topology View
Link Status
Fabric Fabric
Operational Configuration
View View
Fabric
Configuration
Status
Fabric Minor
Alarms
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 90
NDFC Day-1:
VXLAN EVPN
Overlay
Deploy Network and VRF
in Data Center VXLAN EVPN
Have VXLAN EVPN fabric ready
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
Step1 -> Create Network and VRF
Auto
Generated
Name
L2 or L3
Network
VXLAN
Overlay VRF
Auto
Create VXLAN Generated
Overlay L2VNI Label
Network
CSV Option
Network SVI
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
Step2 -> Attach Network and VRF
Attach
Network to
Switches
Select
Switches
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
Step2 -> Attach Network and VRF
(continued)
Port
Attachment
Switches
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
Network and VRF Configs
VXLAN Tenant
L3VNI VRF
Configs
L2VNI
Network
Configs
NVE Tunnel
Configs
L3 SVI
Configs
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
Network and VRF Deployment Status
In VXLAN EVPN Fabric
VXLAN Overlay
Deployment Status
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
Manage and Deploy
External IP Handoff
with NDFC
VRF-LITE: Border to Nexus Edge
Topology and IFC considerations
External Network
ASN 65100
VRF
“CORP”
• IFC Automated
Border Leaf
VRF
“CORP”
ASN 65001
VXLAN EVPN
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
Managing Edge Devices
part of “External Connectivity Network” Fabric
• Create Fabric, Discover Switches, Set Role, and Recalculate & Deploy
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 100
VRF-LITE: Border to Nexus Edge
Defining IFC deployment type
• Review Fabric Settings for VRF-Lite IFC deployment type:
LAN > Fabrics > Select (your DC VXLAN Fabric) > Actions > Edit Fabric > Resources Tab
Per VRF Per Dotq1
association
Select
Deployment Type
Deploy VRF-LITE if
Edge device is
Nexus and
managed by NDFC
eBGP peering
subnet details
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
VRF-LITE: Border to Nexus Edge
Defining IFC Link on physical interface
• IFC link has been defined
• Policy should be ext_fabric_setup
o IPs auto selected from VRF-Lite Subnet IP Range
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
VRF-LITE: Border to Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 103
VRF-LITE: Border to Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
VRF-LITE: Border to Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
VRF-LITE: Border to Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
VRF-LITE: Border to Nexus Edge
Defining VRF extensions on Border
Physical Interface
MTU
Provide Route-MAP
if different from
NDFC default
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
VRF-LITE: Border to Nexus Edge
Preview and Deploy VRF extensions on Border
L3 Tenant
CORP Advertisement of Default route
towards site internal VTEP
L3VNI VRF
Configs
eBGP External
Edge neighbor
Default route static
towards External Edge
Border Physical
Interface Config
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
VRF-LITE: Border to Nexus Edge
Preview and Deploy VRF extensions on External Edge
• Once configurations are deployed on Border Leaf (DC VXLAN EVPN), navigate to
External Network Fabric and perform Recalculate and Deploy
VRF Configs
eBGP Border
Leaf neighbor
Edge Physical
Interface Config
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 109
Enabling VRF-Lite: Manual
Border Leaf to Non-Nexus Edge Router
Step 2 Step 4
IFC prototypes
External Network Fabric VRF-Lite Extension
Define IFC Type: “Manual” Define sub-interfaces, invoke BGP policies
Define IFC link on physical interface NDFC will generate Sub-int and eBGP peering on Edge router
Recalculate config and deploy Deploy on External Network Fabric
Step 1 Step 3
Create and Import DC VXLAN EVPN Fabric VRF-Lite Extension
Define VXLAN EVPN and External Fabric. Set Define Individual VRF extension on the Border leaf
respective roles (e.g. Border, BGW, Edge)
NDFC will generate Sub-int and eBGP peering on Border leaf
Uncheck Fabric monitor mode in External
Deploy on Data Center VXLAN EVPN Fabric
Fabric if the Edge router is in managed mode
For Non-Nexus ensure SNMP configs for
discovery
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 110
VRF-LITE: Border to Non-Nexus Edge
Topology and IFC considerations
External Network
ASN 65099
VRF
“CORP”
• IFC Manual
Border Leaf
VRF
“CORP”
ASN 10
VXLAN EVPN
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 111
VRF-LITE: Border to Non-Nexus Edge
Defining IFC deployment type
• Review Fabric Settings for VRF-Lite IFC deployment type:
LAN > Fabrics > Select (your DC VXLAN Fabric) > Actions > Edit Fabric > Resources Tab
Select
Deployment Type
eBGP peering
subnet details
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 112
VRF-LITE: Border to Non-Nexus Edge
Defining IFC Link on physical interface
• Verify link from DC VXLAN Fabric to External Fabric was discovered
LAN > Fabrics > Double Click (your DC VXLAN Fabric) > Links
If no policy exists, or
neighbor not found. A link
can be created manually
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 113
VRF-LITE: Border to Non-Nexus Edge
Defining IFC Link on physical interface
External Fabric
“WAN-EXT”
ASN 65099
Edge Router
Gig0/0/0/0.2 – 10.10.10.1/31
E1/1.2 – 10.10.10.0/31
Border Leaf
ASN 10
DC Fabric
“VXLAN”
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 114
VRF-LITE: Border to Non-Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 115
VRF-LITE: Border to Non-Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 116
VRF-LITE: Border to Non-Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 117
VRF-LITE: Border to Non-Nexus Edge
Defining VRF extensions on Border
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 118
VRF-LITE: Border to Non-Nexus Edge
Preview and Deploy VRF extensions on Border
Advertisement Default
route towards site internal
eBGP External
Edge neighbor
Border Physical
Interface Config
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 119
VRF-LITE: Border to Non-Nexus Edge
Defining the policies on the Edge Router
• After completing the configurations on the VXLAN Fabric (Border Leaf), Navigate to
External Fabric (Edge Router) and apply the following policies
• ios_xr_base_bgp
Policy = Ios_xr_base_bgp
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 120
VRF-LITE: Border to Non-Nexus Edge
Defining the policies on the Edge Router
• After completing the configurations on the VXLAN Fabric (Border
Leaf), Navigate to External Fabric (Edge Router) and apply the
following policies
• ios_xr_base_bgp
• ios_xr_Ext_VRF_Lite_Jython
Policy =
External Fabric Ios_xr_Ext_VRF_Lite_Jython
“WAN-EXT”
Edge Router
Gig0/0/0/0.2 – 10.10.10.1/31
E1/1.2 – 10.10.10.0/31
Border Leaf
ASN 10
DC Fabric
“VXLAN”
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 121
VRF-LITE: Border to Non-Nexus Edge
Deploy configs on the Edge Router
eBGP Border
Leaf neighbor
IOS-XR Physical
Interface Config
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 122
Verification and
Validation with NDFC
Verification through NDFC
Keeping you away from CLI
Step 2
Deployment History
Configuration Execution Status:
Verify Deployment History Status Success for
Underlay, Overlay, Interfaces, and more
Step 1 Step 3
Verify Network and VRF attachments Show commands
Job Execution Status: Service / features status
Network Status Deployed (CLI through NDFC)
VRF Status Deployed
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 124
Attachment deployment status
Job execution perspective
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 125
Deployment History Tool
Commands execution perspective
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 126
Show Commands Tool
Switch Config perspective
NDFC pre-built
commands or user
commands
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 127
Conclusion
Key points to remember
NDFC simplifies automation and
management of VXLAN EVPN fabrics
using Cisco’s best practices
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 128
Complete Your Session Evaluations
Earn 100 points per survey completed and compete on the Cisco Live
Challenge leaderboard.
#CiscoLive BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 129
• Visit the Cisco Showcase
for related demos
BRKDCN-2918 © 2024 Cisco and/or its affiliates. All rights reserved. Cisco Public 130
Thank you
#CiscoLive