Metro Ethernet Standards

Lim Wong APAC Consulting Team limwong@cisco.com

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

Metro Ethernet Standard Bodies

Metro Ethernet Forum

Service Definitions & Internetworking

IEEE
Physical Layer, OAM, Provider Bridges

IETF
MPLS, VPLS, Traffic Engineering

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah Updates

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah projects

Copper Line coding for EoVDSL EPON New protocol to extend MAC functionality for point to multipoint (or PON) topology Concerns about cost, security OAM For remote subscriber management, OAM in frames vs OAM in preamble. OAM for 10GBASE- links Optics Defining and standardizing specs for extended temp. operation 40 to +85 Celsius case temp.
OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah Physical layer Specifications

10PASS-TS
Symmetrical min 10 Mbps Point-to-point topology >= 750 m on voice grade copper cable DMT line code chosen Supports PSTN in baseband

2BASE-TL
Symmetrical min 2Mbps Point-to-point topology >=2700 m on voice grade copper cable Higher speed with bonding

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah Physical Layer Specifications cont.

100BASE-LX10/BX10 & 1000BASE-LX10/BX10

Up to 10 km over SMF Point-to-point topology

1000BASE-PX10/20 (PON)
Point-to-Multipoint topology Up to 10 or 20 km with 1:16 splits on SMF

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah Ethernet in the First Mile

Ethernet Standard for the First Mile Access Network
EFM Copper for the last 750 to 2700 meters 10 Megabit and 2 Megabit Ethernet over local loop copper Hybrid deployment with EFM fiber supports a flexible variety of access network topologies (greenfield and legacy)

Cat 3

CentralOffice Office Central

EFM Copper 10Mbps P2P EFM Fiber 1000 or 100 Mbps

P2MP EPON 32 Mbps per ONU

EFM Copper 10Mbps

OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah - OAM Objectives

OAM provides mechanisms to: Monitor link operation and health Improve fault isolation Method: OAM data conveyed in basic (untagged) 802.3 Slow Protocol frames Sent between two ends of a single link Slow Protocols will allow S/W implementation Fills major requirement to reduce EFM OpEx
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah - OAM Non-objectives

Does not provide capabilities for:
Station management Protection switching Provisioning No SET functions Bandwidth allocation Speed/duplex negotiation End-to-end OAM communication 802.3 scope restricted to single links
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

IEEE 802.3ah - OAM Forwarding

Can only traverse a single link
Not forwarded by bridges

Communication beyond a single link left to higher layers

OAMPDUs

OAMPDUs

OAMPDUs
OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

Source: Kevin Daines, Editor EFM -OAM Sub Task Force

10

OAM Critical Link Events

Link Fault
Signal remote device that receive path is broken Sent only once per second in Information OAMPDU

Dying Gasp
Signal remote device that unrecoverable local fault (e.g. power failure) has occurred May be sent immediately/continuously

Critical Event
An unspecified critical event has occurred May be sent immediately/continuously
OPT-2045 8017_05_2003_c2

New as of D2.1
2003, Cisco Systems, Inc. All rights reserved.

11

Hub & Spoke Architecture With redundancy

Dynamic Routing OAM
Primary Data Centre Backup Data Centre

Primary VC

Metro Ethernet
Primary Link Backup Link

Backup VC

Primary Link Backup Circuit

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

12

OAM Remote Loopback

Local DTE
Client LLC

Remote DTE
Client LLC OAM MAC CTRL MAC RS GMII PCS PMA PMD MDI MEDIUM

Local DTE sends arbitrary data frames Remote DTE returns data frames Frame BER equals bit BER to high probability when bit BER is better than 10 6

OAM MAC CTRL MAC RS GMII PCS PMA PMD MDI MEDIUM

Tx

Rx

Tx

Rx

Can be implemented in H/W or S/W

OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

Source: Kevin Daines, Editor EFM -OAM Sub Task Force

13

OAM Discovery
Allows local DTE to detect OAM on remote DTE Once OAM support is detected, both ends of the link exchange state and configuration information
e.g. mode, PDU size, loopback support

If both DTEs are satisfied with settings, OAM is enabled on link Loss of link and non-reception of PDUs for 5 seconds are causes of Discovery re-starting
OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

14

Ethernet Ping

Verifies all aspects of an Ethernet service, end-to-end Verifies valid packet sizes

Measures round-trip delay Uses 802.3ah OAM in band

IP/MPLS CORE

Ethernet Ping Enables Rapid Traffic Verification and Problem Isolation

OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

15

IEEE 802.1ad Updates

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

16

Firm Directions

Double Tag Format New Well Known MAC Addresses Layer Control Protocol Handling Complex UNI

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

17

New Tag EtherType

MAC Frame

Destination Address Source Address Length/Type IEEE 802.1Q Tag Length/Type IEEE 802.1Q Tag Data FCS

TBD S-Tag 0x8100 C-Tag S-Tag stands for Service Tag (formerly P-Tag for Provider Tag)

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

18

Provider Well Known MAC Addresses

Originally thought was 33 new addresses Agree now that Provider Well Known Addresses will be in the existing BPDU block, 01:80:C2:00:00:xx Result is that Provider Layer 2 Control Protocols can not tunnel through a Subscribers bridged network

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

19

Well Known Address Notes

General Agreements
802.3X (Pause Frames) and Slow Protocols (EFM, Link Aggregation) will not be tunneled

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

20

Model for Edge Bridge

Model to explain allowed behavior Implementation must match model behavior not model structure Constrains some features relative to MEF Enables new features relative to MEF Details still to be worked out, e.g., dealing with .1p bits in C-Tag
OPT-2045 8017_05_2003_c2 21

2003, Cisco Systems, Inc. All rights reserved.

Model of Single Service UNI

Provider Bridge

Provider trunk
Identified by S-Tag Classical QinQ Subscriber Layer 2 Control protocols can be tunneled as data
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

UNI Subscriber MEN

22

Model of Multiple Service UNI

Provider Bridge 4 UNIs
Bundling

.1Q Bridge

Provider trunk
Identified by S-Tags

(2 untagged port pairs)

All ports are normal

UNI Subscriber MEN
23

Translation

Layer 2 Control Protocols from Subscriber Processed by .1Q Bridge

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

Notes on Multiple Service UNI

No Layer 2 Control Protocol tunneling MEN participates in Layer 2 Control Protocols, e.g., Subscribers Spanning Tree Protocol
Robust way to prevent loops when CE is a bridge Probably need to discard in .1Q Bridge to prevent participation

Links between Provider Bridge and .1Q Bridge will be virtual in an implementation
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

24

Metro Ethernet Services

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

25

Ethernet Relay Service (ERS)

Logical Port to Logical Port Analogous to Frame Relay Service Well Defined Service Model
A B C

Frame Relay Service

OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

Ethernet Relay Service

26

Typical Enterprise Network Architecture

E1 E3

E1 E3

E3

ATM Frame Relay Backbone Backbone

E1

Internet
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

27

Ethernet Relay Service

Vl an #1 10

Vla n# 10 1

Vl an #1 00

Vla n# 10 2

k runa T q 1 . 802

Metro Ethernet
Vla n#1 06

03 Vlan#1 Vlan#104
Vlan#1 05

7 10 # n Vla

Internet
OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

28

CPE Considerations - ERS and L2 Switches

ERS is a VLAN service opaque to L2 PDUs L2 CPE must use VLAN IDs determined by SP STP loops cannot be detected in the presence of Backdoors A Backdoor could be a service from another SP In a loop-free scenario:
STP domain partitioned, one root on each side VTP advertisements will not flow end-to-end
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

29

CPE Considerations ERS Valid Combinations

ERS is mainly intended for L3 CPEs or any other scenarios where L2 PDU transparency is not required SP should protect the UNI against un-expected L2 PDUs L2 CPE to L3 CPE is another valid combination
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

30

Ethernet Wire Service (EWS)

Defines a point-to-point, port-based service No service multiplexing all-to-one Bundling Transparent to customer BPDUs Routers and switches can safely connect
2003, Cisco Systems, Inc. All rights reserved.

OPT-2045 8017_05_2003_c2

31

Ethernet Wire Service Example

SP 2 SP 1 Data Centre Metro Ethernet

SP 1 POP

SP 1 POP

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

32

CPE Considerations EWS Valid Combinations

EWS is a port based service with L2 PDU transparency External loops can be detected by the end devices Both L2 and L3 CPEs can be connected to an EWS UNI
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

33

Ethernet Multipoint Service (EMS)

Multipoint service where all devices are direct peers No service multiplexingall VLANs are presented to all sites (all-to-one bundling) Transparent to customer BPDUs Routers and switches can safely connect
Multicast Scaling Issues
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

34

Ethernet Multipoint Service Example

Campus A Metro Ethernet Campus B

Campus C

Campus D

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

35

Ethernet Relay Multipoint Service (ERMS)

Both P2P and MP2MP Services can coexist on the same UNI Service multiplexed UNI (e.g. 802.1Q trunk) Opaque to customer PDUs (e.g. BPDUs)
OPT-2045 8017_05_2003_c2

Routers can safely connect to an ERMS UNI

2003, Cisco Systems, Inc. All rights reserved.

36

L3 VPN Service
CE

PE PE PE
CE CE

PE PE
CE CE

L3 MPLS VPN Service

Scalable Any-to-Any connectivity Internet & Intranet Managed & Unmanaged Service
OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

37

L3 VPN Applications

VPN A VPN C VPN B

MPLS VPN

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

38

MPLS Services

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

39

Metro Ethernet Architecture

Vla n# 10 1

Vl an #1 00

Vla n# 10 2

Vl an #1 10

k runa T q 1 . 802

Metro Ethernet

03 Vlan#1 Vlan#104
Vlan#1 05

7 10 # n Vla

Vla n#1 06

Internet
OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

40

Switch based Metro Ethernet Network

Pros
Relatively inexpensive Simple, easy to build

Cons
4K VLAN ID limitation Scaling issue Spanning tree

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

41

Scaling the Network MPLS

L2 Domain

L2 Domain

MPLS

L2 Domain

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

L2 Domain

42

Basic MPLS

Solve ISP peering problem Same as IP routing No VPN Services MPLS routers/switches
Label Distribution Protocol IS-IS or OSPF

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

43

MPLS as a Foundation for Value Added Services

MPLS/ VPN

Traffic Engineering

Fast Re-route

Ethernet VPLS Over MPLS

Multi-Protocol Label Switching

Network Infrastructure

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

44

MPLS Components

Provider Edge Router

Label Switch Router

MPLS

Label Switch Router

Provider Edge Router

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

45

EoMPLS - Draft-martini

The basic idea is to tunnel L2 packets through the MPLS cloud using an LSP tunnel A Layer 2 circuit is allocated a label and LDP is used to distribute the label-circuit mapping.

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

46

Ethernet Over MPLS (EoMPLS)

MPLS

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

47

Ethernet Over MPLS (EoMPLS)

L2 Domain

MPLS
L2 Domain

VLA N#1 00

L2 Domain
VLA N#1 00

L2 Domain

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

48

What is VPLS?

A Virtual Private LAN Services (VPLS) is a multipoint Layer 2 VPN that connects two or more customer devices using Ethernet bridging techniques VPLS is an ARCHITECTURE defined within IETF A VPLS emulates an Ethernet Switch with each EMS being analogous to a VLAN

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

49

VPLS

MPLS

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

50

How VPLS works

A VPLS essentially emulates an Ethernet switch from a users perspective
All connections are peers within the VPLS and have direct communications

The architecture is actually that of a distributed switch A VPLS forwards frames based upon bridging techniques
Self learns Source MAC to Port Associations Floods unknown destination addresses, broadcast and multicast packets

A VPLS does not run Spanning tree

OPT-2045 8017_05_2003_c2
2003, Cisco Systems, Inc. All rights reserved.

51

VPLS
CE VFI VFI PE-POP PE-CLE Tunnel VC connects PEPOPs together Attachment VC VFI PE-POP CE Virtual Forwarding VFI Instance Emulated VC (pseudowire) VFI VFI CE

MPLS

PE-POP PE-CLE

VPLS runs on the PE-POPs and acts as an overlay on the MPLS Core providing Multipoint Capabilities
OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

52

MPLS Traffic Engineering

Congested Path

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

53

MPLS VPN
VPN B VPN A VPN C VPN A VPN C VPN B intranet VPN A extranet VPN B VPN C VPN A VPN B VPN C

Overlay VPN
Frame Relay/VC privacy VC-based Frame Relay/ATM aware
OPT-2045 8017_05_2003_c2

MPLS-Based VPNs
Network privacy Network-based (subnets) IP and VPN-aware groups users and services
54

groups endpoints
2003, Cisco Systems, Inc. All rights reserved.

MPLS-VPN Benefits

Any-to-Any connectivity Interworks with legacy infrastructure Overlapping IP address space No VLAN ID coordination QoS

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

55

OPT-2045 8017_05_2003_c2

2003, Cisco Systems, Inc. All rights reserved.

56