Cisco-Disaggregating Network
Cisco-Disaggregating Network
Disaggregating Network
Devices and Software :
A reality check !
• Introduction
• Market Driver of HW/SW Disaggregation
• Delayering the integrated router
• Cisco ISO XR on 3rd HW
• Implications and lessons learnt
• Summary
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Functional
Components
“The separation of networking
equipment into functional
Modularization Smallest form components and allowing each
of HW/SW factor component to be individually
deployed. Ideally, provided in
the smallest form factor
Disaggregation capable of delivering a specific
function. Equipment should be
self-contained, required no
Software additional common equipment
Self Contained
Control
to operate, and incorporate
open APIs to enable Software
Open APIs
control ”
Source : “Charting the Path to Network Automation and Disaggregation: Carrier
SDN Survey Analysis” ; Heavy Reading ; February 2018
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Disaggregation Changes The Value Proposition
Integrated Disaggregated
Network Infrastructure
Software Software Abstractions
&
Forwarding and HW
Hardware Abstractions
Whitebox HW Whitebox HW HW HW HW
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
Market Drivers
The Promise of Disaggregation
SW
HW
Vendor Independence :
$$$$ $ Customers can source from
Rate of Innovation : a diverse supplier market
Decouple SW and HW
roadmaps Cost Efficiency:
Standardization, open source,
commoditization reduces costs
All Required
Features Features
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
SP Disaggregation Survey Analysis
Source : “Charting the Path to Network Automation and Disaggregation : Carrier SDN Survey Analysis” ; Heavy Reading ; Februar y 2018
N=137 respondents
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
SP Network Functions & Benefits
Most Important Functions Benefits for Operators
Source : “Charting the Path to Network Automation and Disaggregation : Carrier SDN Survey Analysis” ; Heavy Reading ; Februar y 2018
N=137 respondents
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Customer Profiles
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Delayering the
Integrated Router
De-Layering The Network Stack
A Typical Integrated Router
Management
Application/Protocol Layer
APIs into the Control (e.g. (BGP, IGP, APL API
SR) and Management Plane (e.g CLI,
Netconf, SNMP, Syslog, SSH)
Protocol Stacks
(BGP, ISIS, OSPF, LDP, SR, L2 Protocols)
Network Infrastructure
(RIB, Label Manager, BFD, Interface and more)
Forwarding
(Fwding Chains, FRR,
NPU Restarts,etc)
OS and platform SW
(Linux, ASIC SDK, fan, sensor modules, etc)
Fans
CPU Optics Switching ASIC
Sensors
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
De-Layering The Network Stack
High Level Value Proposition
Management
APL API
Protocol Stacks
• Rich Feature Set (BGP, ISIS, OSPF, LDP, SR, L2 Protocols)
Network Infrastructure
• Wide Range of HW (RIB, Label Manager, BFD, Interface and more)
Form Factors Forwarding
(Fwding Chains, FRR,
NPU Restarts,etc)
• Pre-integrated /
pre-tested OS and platform SW
(Linux, ASIC SDK, fan, sensor modules, etc)
• Single Touchpoint
Support
Fans
CPU Optics Switching ASIC
Sensors
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
De-Layering The Network Stack
Usual Concerns Related to Integrated Systems
Management
APL API
Protocol Stacks
• Rich Feature Set (BGP, ISIS, OSPF, LDP, SR, L2 Protocols) • Slower Feature
Network Infrastructure
Development
• Wide Range of HW (RIB, Label Manager, BFD, Interface and more)
Form Factors Forwarding • HW and SW Vendor
(Fwding Chains, FRR, Lock
NPU Restarts,etc)
• Pre-integrated /
pre-tested OS and platform SW
(Linux, ASIC SDK, fan, sensor modules, etc)
• Mostly Proprietary
Solutions
• Single Touchpoint
Support • Higher Cost
Fans
CPU Optics Switching ASIC
Sensors
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
De-Layering The Network Stack
Phase 1 : Exposed Direct Access to the Forwarding Plane
Management
Application/Protocol Layer
APIs into the Control (e.g. BGP, IGP, APL API
SR) and Management Plane (e.g CLI,
Netconf, SNMP, Syslog, SSH) Protocol Stacks
(BGP, ISIS, OSPF, LDP, SR, L2 Protocols) Service Adaptation Layer (Cisco)
SL API Enables dynamic, programmatic control.
Build & extend the device’s control plane
functionality.
Network Infrastructure
(RIB, Label Manager, BFD, Interface and more)
Forwarding
(Fwding Chains, FRR,
NPU Restarts,etc)
OS and platform SW
(Linux, ASIC SDK, fan, sensor modules, etc)
Fans
CPU Optics Switching ASIC
Sensors
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
De-Layering The Network Stack
Phase 1 : Exposed Direct Access to the Control Plane
Management
Application/Protocol Layer
APIs into the Control (e.g. BGP, IGP, APL API
SR) and Management Plane (e.g CLI,
Netconf, SNMP, Syslog, SSH) Protocol Stacks
(BGP, ISIS, OSPF, LDP, SR, L2 Protocols) Service Adaptation Layer (Cisco)
SL API Enables dynamic, programmatic control.
Build & extend the device’s control plane
functionality.
Network Infrastructure
(RIB, Label Manager, BFD, Interface and more)
Forwarding
(Fwding Chains, FRR,
NPU Restarts,etc)
OS and platform SW
(Linux, ASIC SDK, fan, sensor modules, etc)
Fans
CPU Optics Switching ASIC e.g : Open/R integration with XR
Sensors
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
De-Layering The Network Stack
Phase 2 : Complete Separation Between SW and HW
Management
Application/Protocol Layer
APIs into the Control (e.g. BGP, IGP, APL API
SR) and Management Plane (e.g CLI,
Netconf, SNMP, Syslog, SSH) Protocol Stacks
(BGP, ISIS, OSPF, LDP, SR, L2 Protocols) Service Adaptation Layer (Cisco)
SL API Enables dynamic, programmatic control.
Build & extend the device’s control plane
Network Infrastructure functionality.
Platform Mgmt Optics Forwarding
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
De-Layering The Network Stack
The Three Main Components of a Disaggregated System
Management
APL API
Protocol Stacks
(BGP, ISIS, OSPF, LDP, SR, L2 Protocols)
Network Operating System
SL API
(NOS)
Network Infrastructure
Platform Mgmt Optics Forwarding
Platform AL HAL
Fans
ONIE
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
What Is A White Box?
• Controls Switch ASIC
• Usually Intel SoC
• Older use PowerPC
• Only basic boot strap SW (e.g. ONIE)
I/O
• Broadcom, Mellanox, Centec,
i2c i2c Cavium, Barefoot
• Requires vendor specific SDK
i2c PCI
PSU BMC
Micro Switching and driver to drive ASIC
Server ASIC
I/O I/O
• Optional
• Management & Monitoring
• Usually proprietary SW
• Facebook has OpenBMC
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Typical Whitebox – What do you get?
Subscription SW XR
App
App
Upgrades (SIA) XR
Perpetual Linux
Software Suite Distribution Linux Distribution
Cisco
Hardware 3rd Part HW 3rd Part HW
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
IOS XR on a White Box
Management
CLI, Netconf, SNMP, Syslog, SSH
IOS XR
Sysadmin Control & TPA
Forwarding
Protocol Stacks
(BGP, ISIS, OSPF, LDP, SR, L2 Protocols)
SL API
Network Infrastructure
IOS-XR Host
(RIB, Label Manager, BFD, Interface and OS
more) Platform & Optics
ASIC Abstraction
Forwarding Abstraction
(Fwding Chains, Back-walks, FRR,
NPU Restarts,etc) Platform Vendor drivers Generic Kernel ASIC SDK API
Optics vendor drivers WRL Distro ASIC drivers & SDK
Platform API HAL Libraries (LXC & Docker)
Platform Abstraction
ASIC
Linux Base OS SDK
3rd Party White box
ONIE
Power, Fan, ASIC
Optics
Temp,…
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
Upgrade
Rescue
Install
Boot
etc
ONIE NOS / XR
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
Upgrade
Rescue
Install
Boot
etc
ONIE NOS / XR
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
Upgrade
Rescue
Install
Boot
etc
ONIE NOS / XR
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
Platform : x86_64-accton_as7816_64x-r0
Info: Mounting kernel filesystems... done.
Info: Mounting ONIE-BOOT on /mnt/onie-boot ...
Info: Making NOS install boot mode sticky.
Installing for i386-pc platform.
Installation finished. No error reported.
Info: Using eth0 MAC address: 3c:2c:99:1d:7e:71
<snip>
ONIE: Using DHCPv4 addr: eth0: 172.18.1.53 / 255.255.255.0
<snip>
Please press Enter to activate this console. Info: eth0: Checking link... up.
Info: Trying DHCPv4 on interface: eth0
ONIE: Using DHCPv4 addr: eth0: 172.18.1.53 / 255.255.255.0
Upgrade
ONIE
Debug
Upgrade
Rescue
Install
Boot
etc
ONIE NOS / XR
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
ROUTER
H
S
d
e
n
a
a
y
s
s
Booting `eXR'
Loading eXR ...
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
Upgrade
Rescue
Install
Boot
etc
ONIE NOS / XR
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
IOS XR on a White Box
IOS XR IOS XR
Boot
Boot Run
ONIE Install XR IOS XR Bake
Upgrade
ONIE
Debug
+----------------------------------------------------------------------------+
|*eXR |
| ONIE |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
+----------------------------------------------------------------------------+
IOS-XR Host
OS
Platform & Optics
ASIC Abstraction
Abstraction
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
IOS XR on Whitebox -
Commands
IOS XR on a White Box
RP/0/RP0/CPU0:WB3#show ver
Sun Dec 2 08:07:33.966 UTC
Cisco IOS XR Software, Version 6.5.2.24I
Copyright (c) 2013-2018 by Cisco Systems, Inc.
Build Information:
Built By : ahoang
Built On : Wed Dec 12 21:25:01 PST 2018
Built Host : iox-ucs-021
Workspace : /auto/iox-ucs-021-san1/nightly/r65x_18.12.12C/iosxrwb
Version : 6.5.2.24I
Location : /opt/cisco/XR/packages/
RP/0/RP0/CPU0:WB3#
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
IOS XR on a White Box
RP/0/RP0/CPU0:WB3#show platform
Sun Dec 2 08:08:04.702 UTC
Node Type State Config state
--------------------------------------------------------------------------------
0/RP0/CPU0 7816-64X-O-AC-F(Active) IOS XR RUN NSHUT
0/FT0 7816-FN-BK OPERATIONAL NSHUT
0/FT1 7816-FN-BK OPERATIONAL NSHUT
0/FT2 7816-FN-BK OPERATIONAL NSHUT
0/FT3 7816-FN-BK OPERATIONAL NSHUT
RP/0/RP0/CPU0:WB3#
RP/0/RP0/CPU0:WB3#show ip int br
Sun Dec 2 08:08:19.538 UTC
<snip>
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Ecosystem
Illustrative. Non exhaustive
The Ecosystem …
Network SONiC
Operating
System (NOS) FBOS
cEOS
: SAI
Platform
OS : OFA
Open Network
Debian Linux : OpenNSL ; SDKLT
Linux (ONL)
Whitebox
HW
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
SP & NOS/SW Vendor Investments/Partnerships
AT&T purchased Vyatta Open-Sourced to OCP as DANOS 1,2
Multi NPU, more complex abstraction, connectivity and state management between NPUs
Single SoC, small # of components to manage. Easy to abstract and manage hardware
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Disaggregation Applicability
Subscriber Aggregation Scale, QOS
Cell Site Top
IP Edge (ex L3VPN, MEF) Traffic Engineering Top or
or Rack
Rack (TOR)
(TOR)
IP Edge Spine
HA, Scale, Rich Feature Sets Massive bandwidth Spine - Leaf
- Leaf
Customer Prem
Peering functions
Integrated
Disaggregation
Applicability
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
End to end deployment process
V SP V SP V
•
SP Service Provider / Customer
V• Vendor
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
End to end development and deployment process
SW
SW Development
SW or SP SW HW SP SW HW SP SW HW
• Requirements
• Arch, Functional & Design Integration / Deployment Operation
Product Release
Specs Certification Testing
• Code + Unit Testing
• Integration Testing (on HW
where applicable) • Functional
• Product release • Design
• System Testing • Optimization
• Training and • Staging and deployment
• Scale & Performance * • Solution support (TAC)
documentation • Solution validation
HW • Security *
• Pre-production testing (RMA, defects, etc)
HW Development • Customer Specific
Testing
• HW Design and
Development
• BSP, Bootloader, BIOS
development and test
• Documentation
•
SP Service Provider / Customer
HW HW Vendor
•
• SW Vendor
SW
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Operating Model Implications
`
SW
SW Development
SW or SP SW HW SP SW HW SP SW HW
• Requirements
• Arch, Functional & Design Integration / Deployment Operation
Product Release
Specs Certification Testing
• Code + Unit Testing
• Integration Testing (on HW
where applicable) • Functional
• Product release • Design
• System Testing • Optimization
• Training and • Staging and deployment
• Scale & Performance * • Solution support (TAC)
documentation • Solution validation
HW • Security *
• Pre-production testing (RMA, defects, etc)
HW Development • Customer Specific
Testing
• HW Design and
Development
• BSP, Bootloader, BIOS
development and test
• Documentation
CI / CD Pipeline
(Integration, Testing, Repositories, Reporting)
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Integration Implications
NOS Protocols
Protocol Stacks
Platform Optics
Drivers Drivers
Network Infrastructure
ASIC SDK
Platform Optics ASIC
Modules Driver SDK
Board Support Linux
(BSP) Security Linux
Binaries Kernel
ONIE
White Box Components
ONIE BMC
CPLD BIOS
(Fan/Mboard/etc.)
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Trust & Security: End to End
Protocol Hardware
IPSec
Secure BGP/IGP Trust Anchor Module (TAm)
SSH Secure Unique Device Identity (SUDI)
Runtime
LPTS, Image
DDoS, CoPP
SELinux Secure BIOS
Integrity Measurement(IMA) Signed Bootloader
Secure image boot
Signed Image
Transport
MACSec
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 47
Trust & Security: End to End
Protocol Hardware
IPSec
Secure BGP/IGP Trust Anchor Module (TAm)
SSH Secure Unique Device Identity (SUDI)
Runtime
LPTS, Image
DDoS, CoPP
SELinux Secure BIOS
Integrity Measurement(IMA) Signed Bootloader
Secure image boot
Signed Image
Transport
MACSec
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Secure Boot
HW Trust Bootloader
TAm Secure
Chip-Guard ONIE
Singed XR
BIOS Singed
Secure NOS
UEFI/BIOS
boot
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Secure Boot
HW Trust Bootloader
TAm Secure
Chip-Guard ONIE
Singed XR
BIOS Singed
Secure NOS
UEFI/BIOS
boot
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
Support Model Implications
”Classic” “Disaggregated”
SW SW
HW HW
Customer
Customer
Case
Case
Handling
Handling
Support
(e.g TAC) SW Support HW Support
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Serviceability
Management
Protocol Stacks
Network Infrastructure
ONIE Linux
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
Serviceability
ONIE
HW Issue Debugging White Box Components
Troubleshooting
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
Summary
Cisco View
Cisco Strengths
Disagg => Diff Value Proposition Cisco offers strong value including
Separates value from components component IP, supply chain, and
and modules services capabilities
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Summary
Disaggregation is :
• Separation of HW from SW
• Delayering the SW stack
Increased flexibility and options
• e.g. HW, NOS, ASIC
5G Virtual Reality
Demos Experience
Experience 7 Essential Enjoy “Running with the 5G Bull”
Technology and 3 Generate immersive demo
Revenue with 5G demos and
join our guided demo tours
More Sessions
Check out the
Service Provider Digital Transformation Assessment
Technology Track by Take a meeting session to benchmark your
scanning the code digital readiness against your industry peers
Want to see use cases, solution details and more. Visit ©www.cisco.com/go/sp
2019 Cisco and/or its affiliates. All rights reserved. Cisco Public
Cisco Webex Teams
Questions?
Use Cisco Webex Teams (formerly Cisco Spark)
to chat with the speaker after the session
How
1 Find this session in the Cisco Events Mobile App
2 Click “Join the Discussion”
3 Install Webex Teams or go directly to the team space
4 Enter messages/questions in the team space
cs.co/ciscolivebot#BRKSPG-2698
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
Complete your online
session survey
• Please complete your Online Session
Survey after each session
• Complete 4 Session Surveys & the Overall
Conference Survey (available from
Thursday) to receive your Cisco Live T-
shirt
• All surveys can be completed via the Cisco
Events Mobile App or the Communication
Stations
BRKSPG-2698 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Thank you