Ethernet OAM Tutorial for Apricot

78 downloads 136 Views 4MB Size Report
Ethernet OAM Tutorial. Srinath Beldona [email protected]. Technical Marketing Engineering, Edge Routing Business Unit. Yogesh Jiandani yogeshj@ cisco.
Ethernet OAM Tutorial

Srinath Beldona

[email protected]

Technical Marketing Engineering, Edge Routing Business Unit Yogesh Jiandani

[email protected]

Consulting Systems Engineer, India and SAARC Region Presentation_ID

© 2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

1

HOUSEKEEPING ƒ We value your feedback, Please don’t forget to complete your online session evaluations after each session Please don’t forget to complete the Overall Conference Evaluation which will be available online

ƒ Please switch off your mobile phones!

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

2

Agenda ƒ Review of Metro Ethernet technologies & Ethernet OAM ƒ Manageability to the Customer Premises ƒ Ethernet OAM Overview ƒ Ethernet OAM Deployment Overview ƒ 802.1ag Connectivity Fault Management for Services Management ƒ 802.3ah for Ethernet in the First Mile for Connectivity Verification ƒ Metro Ethernet Forum MEF-16 E-LMI for Rapid Service Deployment ƒ Ethernet OAM Interworking ƒ Summary Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

3

Metro Ethernet – Deployment scenarios Integrated System Full Service

Customer Equipment

Efficient

Access

Large Scale

Aggregation

Intelligent

Multi-service

Edge

Intelligent

Core

Efficient

Edge

Access

Full Service

Customer Equipment

Si

User Facing Provider Edge (U-PE) U-PE

Metro A

GE Ring

10/100/ 1000 Mbps

Metro C

PE-AGG Hub & Spoke

Si

P

P

10/100/ 1000 Mbps

U-PE

N-PE

MPLS/IP/TDM 10/100/ 1000 Mbps

Metro B N-PE

P

SONET/SDH Ring

/ 00 s /1 bp 10 0 M 0 10

P

DWDM/ CDWM N-PE U-PE Network Facing Provider Edge (N-PE) Ethernet OAM Tutorial

U-PE

Metro D

Internet © 2006 Cisco Systems, Inc. All rights reserved.

4

Metro Ethernet—Service Descriptions Ethernet Wire Service—EWS (Like a Leased Line)

C A

SP Network B

Ethernet Relay Service—ERS (Like Frame Relay)

C A

SP Network B

Ethernet Multipoint Service—EMS (Enhanced with VPLS, Port Mapping)

SP Network

Ethernet Relay Multipoint Service—ERMS (New service where the SP cloud acts like a LAN, VLAN Mapping)

SP Network

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

5

IETF Terminology for Metro Ethernet Core Core Device Device (P) (P) P

Emulated VC

Frame Frame Forwarding, Forwarding, Congestion Congestion Management Management

Emulated -PE) ** Emulated VC VC Endpoint Endpoint (Network (Network PE, PE, N N-PE)

specific for MPLS/L2TPv3 MPLS/L2TPv3 pseudowire pseudowire encapsulation, encapsulation, L2 L2 Interworking, Interworking, Ethernet:

(Pseudowire) N-PE

Extension VC

CE

VPLS Bridging

Aggregation -AGG) Aggregation Device Device (PE (PE-AGG) PE-AGG

U-PE

Attachment VC

IP IP Service Service Integration, Integration, Congestion Congestion Management, Management, L3VPN L3VPN Interconnection Interconnection (for (for PEs PEs supporting supporting that that function) function) Replaces Replaces PE-POP PE-POP Traffic Traffic Aggregation Aggregation and and Congestion Congestion Management Management

(Note: (Note: PE-AGGs PE-AGGs and and Extension Extension VC’s VC’s are are formally formally identified identified in in Switched Switched Ethernet Ethernet Access Access Domains, Domains, although although the the functions functions exist exist in in FR FR and and ATM ATM networks networks as as well.) well.)

Attachment -PE) ** Attachment VC VC UNI UNI Endpoint Endpoint (User (User PE, PE, U U-PE) Admission Admission Control, Control, Policy Policy Enforcement, Enforcement, Classification, Classification, Policing Policing & & Marking, Marking, Congestion Congestion management, management, SLA SLA monitoring monitoring and and reporting, reporting, VC VC Mapping Mapping to to L1 L1 Channel, Channel, VC-ID translation, Replaces U-PE VC-ID translation, Replaces U-PE

specific for Ethernet:

Bridging

Note: These different roles can be collapsed within a single box

* For More Information refer to http://www.ietf.org/internet-drafts/draft-ietf-ppvpn-l2-framework-03.txt Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

6

Review of OAM

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

7

OAM &P: The Concept ƒ

Operations, Administration, Maintenance & Provisioning: − fault indication

− performance monitoring

− security management − diagnostic functions − configuration & service provisioning ƒ OAM covers both NÅÆ S and WÅÆE interfaces

N ÅÆ S

Management Plane (NMS / EMS)

Network Plane (NEs)

W ÅÆ E Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

8

OAM &P: The Concept ƒ Operations, Administration, Maintenance & Provisioning: − fault indication

− performance monitoring

− security management − diagnostic functions − configuration & service provisioning ƒ OAM covers both NÅÆ S and WÅÆE interfaces

N ÅÆ S

Management Plane (NMS / EMS)

Primary Focus of Ethernet OAM protocols is on W ÅÆ E interactions (across NEs) Network Plane (NEs)

W ÅÆ E

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

9

OAM Layering Operator A

Customer Bridge

Edge Router

ATM Switch

10G Ethernet

ATM Switch

Bridge

Bridge

Router

Router

Ethernet over MPLS

Service Layer

ATM RFC1483

Service OAM

Network Layer Transport Layer

Router

Bridge

switch

switch

Edge Bridge

Customer Bridge

Ethernet over SONET

Operator B

Network OAM SONET OAM

MPLS OAM

Ethernet Link OAM

Network OAM ATM OAM

ƒ Model is iterative (layer stacking) & relative (service layer for Operator is transport layer for SP) ƒ Each Layer supports its own OAM mechanisms ƒ Inter-working across and within OAM layers is possible Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

10

Manageability to the Customer Premise

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

11

Carrier Ethernet Attributes

Platform and Technology Convergence Cisco Carrier Ethernet Rich Ethernet Services Scalability QoS

Transport Flexibility H-VPLS MPLS

Final Attribute to Enable Carrier Grade Ethernet Services OAM Service Level Assurance

Network

Resiliency

Accelerate Migration to Carrier Ethernet ƒ Ethernet OAM Provides Manageability to Customer Premise ƒ Increased Business Confidence in Ethernet Service Level Agreements ƒ Granular Bandwidth, Increased Transport Efficiency, Lower Costs

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

12

What Is Service Assurance? New

New

Detection • IEEE 802.1ag CFM for End-to-end service management over any infrastructure • IEEE 802.3ah for Ethernet First Mile Link Monitoring

Ethernet OAM

MPLS OAM

Service Availability Ethernet Local Management Interface (E-LMI) • Rapid Start service turn-up • Manageability to Customer Premise with CPE

System and Control Infrastructure

Resiliency • • • • • Ethernet OAM Tutorial

Non-Stop Forwarding (NSF) Stateful Switchover (SSO) Control Plane Failure with Zero Packet Loss Pseudowire Redundancy for L2 Failover MPLS Link Protection © 2006 Cisco Systems, Inc. All rights reserved.

13

Ethernet OAM: Service Availability

Rapid Start Service Turn Up—Reduce Truck Rolls

Rapid Start -- Service Turn-Up ƒ Technician installs CPE Router ƒ CPE communicates to UPE “I’m Alive” ƒ UPE responds with available Ethernet connection services (EVCs) ƒ CPE confirms connection to available EVCs ƒ Dramatic time-to-install reduction Router Standards-based E-LMI (MEF16)

Ethernet Switch

U-PE CPE

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

14

Service Assurance Detection IEEE 802.3ah Link Layer OAM

802.3ah

802.3ah Customer Equipment

Native Ethernet

MPLS

SONET/SDH

Customer Equipment

PW MPLS

ƒ Standardized as IEEE 802.3ah Ethernet in the First Mile (EFM) ƒ Maintain consistency of an Ethernet transport connection (per link, or “physical” OAM) ƒ Addresses three key operational issues when deploying Ethernet across geographically disparate locations Link monitoring, fault signaling, remote loopback, and OAM discovery

ƒ Operates on a single point-to-point link between two devices ƒ Slow protocol using packets called OAMPDUs which are never forwarded Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

15

Service Assurance: Detection

IEEE 802.1ag Connectivity Fault Management (CFM) CPE

PE-Agg

NPE

NPE

CPE

PE-Agg

Core

CPE UPE

Service Link Service

UPE

L2

E-LMI 802.3ah

CPE E-LMI

802.3ah

802.3ah

802.3ah IEEE 802.1ag

802.3ah

802.3ah

“L1”

ƒ IEEE 802.1ag (CFM) uses Ethernet frames, not MPLS, ATM, or SONET frames, cells, or sub-Ethernet control information ƒ All devices must support these Ethernet frames to allow service provider to verify end-to-end service connectivity over any IP, MPLS, or VPLS infrastructure

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

16

End-to-End Manageability Customer Loyalty: Service Level Assurance

CPE PE-Agg

CPE

Link Service

PE-Agg

Core

CPE

Service

NPE

NPE

U-PE

U-PE

E-LMI 802.3ah

CPE E-LMI

802.3ah

802.3ah

802.3ah

802.3ah

802.3ah

802.1ag

Carrier Ethernet Capabilities ƒ IEEE 802.1ag: Fault Management per Service/VLAN ƒ IEEE 802.3ah Link Protection and Monitoring ƒ MEF 16 E-LMI for Customer Premise Ethernet OAM Tutorial Equipment

Benefits ƒ End-to-end Service Manageability ƒ First Mile Physical Connectivity Verification ƒ Pro-active Service Status and Availability

© 2006 Cisco Systems, Inc. All rights reserved.

17

Standards Landscape Ethernet OAM [WÅÆE, NÅ ÆS]

Standard Organization

Link OAM [EW] IEEE 802.3ah Fault Mgmt [EW] IEEE 802.1ag MIBS IEEE 802.3 + 802.1 EMS/NMS [NS] EMS-NMS Info Model Service OAM [EW] Performance Mgmt Ethernet OAM [EW] Y.1731 Ethernet Protection G.8031 FCAPS SG4 L2VPN OAM Req. & Framework [EW] L2VPN WG Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

18

Carrier Ethernet

Ethernet OAM Standards Summary Standards Body

Ethernet Services

Architecture/Control

Ethernet OAM*

Ethernet

ƒ 802.3: MAC ƒ 802.3ar: Congestion Management IEEE

ƒ 802.1D/Q: Bridges/VLAN ƒ 802.17: RPR

ƒ 802.3ah: EFM

ƒ 802.1ad: Provider Bridges

ƒ 802.1ag: CFM

ƒ .1ah: Provider Backbone Bridges

ƒ 802.1AB: Discovery

ƒ .1ak: Multiple Registration Protocol

ƒ 802.1ap: VLAN MIB

ƒ 802.3: PHYs ƒ 802.3as: Frame Expansion

ƒ .1aj: Two Port MAC Relay ƒ .1AE/af: MAC/Key Security ƒ .1aq: Shortest Path Bridging ƒ MEF 10: Service Attributes MEF

ƒ MEF 3: Circuit Emulation

ƒ MEF 4: Generic Architecture

ƒ MEF 6: Service Definition

ƒ MEF 2: Protection Req and Framework

ƒ MEF 8: PDH Emulation

ƒ MEF 11: UNI Req and Framework

ƒ MEF 9: Service Certification

ƒ MEF 12: Layer Architecture

ƒ MEF 16: E-LMI

ƒ MEF 13: UNI Type 1 ƒ E-NNI

ƒ MEF 14: Traffic Profiles

ITU

ƒ G.8011: Services Framework

ƒ G.8010: Layer Architecture

ƒ Y.1730: Ethernet OAM Req

ƒ G.8011.1: EPL Service

ƒ G.8021: Equipment Model

ƒ Y.1731: OAM Mechanisms

ƒ G.8011.2: EVPL Service

ƒ G.8010v2: Layer Architecture

ƒ G.8031: Protection

ƒ G.asm: Service Mgmt Arch

ƒ G.8021v2: Equipment Model

ƒ Y.17ethqos: QoS

ƒ G.smc: Service Mgmt Chnl

ƒ Y.17ethmpls: ETH-MPLS Interwork

ƒ Y.ethperf: Performance

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

ƒ G.8012: UNI/NNI ƒ G.8012v2: UNI/NNI 19

Overview of Ethernet OAM

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

20

Drivers for Ethernet OAM ƒ Management Complexity Large Span Networks Multiple constituent networks belong to disparate organizations/companies IP overlay or plug-n-play no longer valid options!

ƒ Operational Efficiency Reduce Opex, avoid truck-roll Downtime cost

ƒ OAM benchmarks set by TDM and existing WAN technologies

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

21

The Promise of Ethernet OAM ƒ Simplify deployment of Ethernet WAN services particularly important as Ethernet moves to a volume market with less technically sophisticated customers

ƒ Enable monitoring & verification of SLAs Not all customers and all services are equal. SLAs will be a key differentiator for carriers and service providers.

ƒ Provide End-to-End OAM Not only within the franchise of a single carrier Eliminate finger-pointing between carriers

ƒ Facilitate deployment of Ethernet services over multiple access technologies Service independence from access and transport

ƒ Deliver SP’s customers packaged plug and play solutions Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

22

Ethernet OAM: the Protocol Building Blocks

Se rvi ce

La yer

Ne two rk La yer Tra ns po rt L aye r

Y.17

I E-LM 802.1

31

ag

ah 802.3

ƒ IEEE 802.1ag: Connectivity Fault Management (CFM) ƒ ITU-T Y.1731: OAM functions and mechanisms for Ethernet based networks ƒ IEEE 802.3ah: Ethernet Link OAM (EFM OAM) ƒ MEF E-LMI: Ethernet Local Management Interface Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

23

802.1ag Connectivity Fault Management (CFM) Service Provider

Customer

MPLS Core

Ethernet Access CE 1

uPE B PE-Agg B nPE B

MPLS Access nPE A

uPE A

CE 2 Customer Domain Service Provider Domain Operator Domain

ƒ End to End per EVC OAM ƒ Hierarchical Maintenance Domains MEPs/MIPs ƒ Standard Ethernet Frames (in-band) Continuity Check Loopback Link Trace

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

24

Y.1731 ƒ CFM plus… ETH-LCK (out of service diagnostics) Multicast Loopback AIS TEST Maintenance Communication Channel Experimental OAM Performance Measurement (Delay, Packet loss …)

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

25

802.3ah Customer

Service Provider

Ethernet Access

MPLS Core

CE 1

MPLS Access CE 2 Link Layer OAM

802.3ah

802.3ah 802.3ah

ƒ Link Level OAM ƒ Operates on point-to-point link, not propagated beyond a single hop. ƒ Slow Protocol (Max rate of 10 frames per second) ƒ Functions: OAM discovery – Discover OAM capabilities on peer device Link monitoring – Event notification when error thresholds exceeded Remote MIB Variable Retrieval – Polling and response (but not writing) of 802.3ah MIB Remote Failure indication – Inform peer that receive path is down. Remote Loopback – Puts peer in (near-end) intrusive loopback state. Statistics can be collected while testing link. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

26

E-LMI Service Provider

Customer

Ethernet Access CE 1

MPLS Core

uPE B

MPLS Access uPE A

CE 2 Service Layer OAM

E-LMI

E-LMI

ƒ Asymmetric protocol, applicable on UNI only (uPE to CE) ƒ Specifies procedures & message formats exchanged and NOT how uPE collects OAM data – relies on Service/Network OAM running uPE to uPE ƒ Allows uPE to communicate to CE: EVC Status Remote UNI Status CE-VLAN to EVC Map BW Profiles

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

27

802.1ag Connectivity Fault Management

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

28

Why do Service Providers want Connectivity Fault Management? ƒ Debugging Layer 2 networks is not easy in the Enterprise space. ƒ Debugging networks of Layer 2 networks promises to be even harder. ƒ Especially when the component networks belong to different organizations and/or different companies. ƒ Experience in providing circuit-based services provides a very useful model for managing and debugging nets of nets. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

29

What is Ethernet Connectivity Fault Management? ƒ Connectivity Fault Management (CFM) is an important part of “End-to-End OAM”. ƒ CFM is Ethernet frames, not MPLS, ATM, or SONET frames, cells, or sub-Ethernet control information. ƒ Only bridges see CFM because bridges are the only active relay functions that exist. ƒ MPLS, ATM, and SONET OAM are important for debugging Ethernet “wires”, but are not always end-to-end. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

30

(Terminology issue) There is no such thing as a “Metro Ethernet Edge Router” ƒ If interoperability is to be achieved among the various technologies used for Metro Ethernet, the IEEE 802 LAN architecture must be observed. ƒ There are only two kinds of active relay elements in IEEE 802: Bridges and Hubs (Repeaters). ƒ A “Metro Ethernet Edge Router” is a Bridge that does not need to run spanning tree, has only two ports per VLAN enabled (one trunk and one local Ethernet), and uses Pseudowires for trunks. ƒ (This notion saves a lot of verbiage in this document. Whether a box is a router or a bridge depends on which function you are looking at.)

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

31

Maintenance and other OAM issues not discussed ƒ Minimal discussion of Provider-to-Customer (single-link) IEEE 802.3ah OAM. ƒ No explanation of MPLS, ATM, or other OAM. ƒ No explanation of other techniques such as periodic confirmation of network topology and configuration, SNMP-based “traceroute”, or Layer 3 functions such as Ping. ƒ No explanation of other protocols such as Ethernet Line Management Interface, BPDUs, etc. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

32

Two standards bodies are defining CFM or End-to-End OAM ƒ IEEE 802.1ad defines Q-in-Q “Provider Bridges”. IEEE 802.1ag defines “Connectivity Fault Management” for all IEEE 802 Bridges. ƒ ITU-T Question 3, Study Group 13, is defining end-to-end Ethernet OAM for both circuit-switched equipment (e.g. Ether-over-SONET) and packet-switched equipment (802.1ad Bridges). ƒ Both 802.1 and Q.3/13 share common membership and are cooperating fully. 802.1 should define low-level aspects tied closely to bridging technology. Q.3/13 should define high-level aspects tied to the service models.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

33

Domains, Maintenance Levels, and Flow Points

Presentation_ID

© 2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

34

The OAM Environment Customer

CE

Service Provider Ethernet Access

Customer MPLS Core

Ethernet Access

CE

Customer Domain Provider Domain

Operator Domain

Operator Domain

Operator Domain

ƒ Customer contracts with Provider for end-to-end service. ƒ Provider contracts with Operator(s) to provide equipment and networks. ƒ Provider and Operator(s) may or may not be the same company or same division. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

35

Flow Points and Domains ƒ Domains are defined in terms of “flow points”, which are “MACs” to IEEE 802, and “interfaces” or “ports” to others. ƒ A flow point (FP) at the edge of a Domain is called a “Maintenance Point” or MP. System administrators use MPs to initiate and monitor CFM activity and report the results.

ƒ A flow point inside a Domain, and visible to an MP, is called a “Loopback Point”. Loopback Points (LPs) passively receive and respond to CFM packets initiated by MPs.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

36

Domains

OK NO ƒ Domains may nest or touch, but must never intersect. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

37

Domains

Maintenance Points

Loopback Points

ƒ Maintenance Points are always at the edges of Domains. ƒ Loopback Points are always within Domains.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

38

Maintenance Levels Customer Equipment

Operator A Bridges

Operator B Bridges

Customer Equipment

Customer Level Provider Level Operator Level Physical (or Layer 3 carrier) Level

ƒ At (at least) Operator and Physical levels, there may be multiple Domains. There could be multiple Domains at any level.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

39

Lower CFM Levels (Expanding red link in the previous slide) Operator A Bridge

Operator C Routers

Operator D Routers

Operator B Bridge

“Physical” level of Connectivity Fault Management MPLS OAM Level Layer 3 Operator Level Physical Level

ƒ There are levels below CFM. This is where MPLS OAM, ATM OAM, etc., live. These OAM functions ought to, but do not necessarily, follow the MP/LP/FP model.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

40

Loopback Points, Maintenance Points Customer Equipment

M

Operator A Bridges

L

Customer Equipment

L

M

M

Operator B Bridges

L

L

M

M

M L

L L

L M

M L

L L

L L

L M

MM

MM

MM

MM

MM

MM

MM

M

ƒ Each Level’s Maintenance Points are the next-higher-level’s Maintenance or Loopback Points. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

41

Loopback Points, Maintenance Points Customer Equipment

M

Operator A Bridges

L

Customer Equipment

L

M

M

Operator B Bridges

L

L

M

M

M L

L L

L M

M L

L L

L L

L M

MM

MM

MM

MM

MM

MM

MM

M

ƒ Each Level’s Loopback Points are invisible to all higher levels. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

42

Loopback Points and Maintenance Points: Operator Levels (x3)

Maintenance Points Loopback Points ƒ Each Level’s Maintenance Points are the next-higherlevel’s Maintenance or Loopback Points. ƒ Each Level’s Loopback Points are invisible to all higher levels.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

43

Loopback Points and Maintenance Points: Provider Level

Maintenance Points

Loopback Points

ƒ Each Level’s Maintenance Points are the next-higherlevel’s Maintenance or Loopback Points. ƒ Each Level’s Loopback Points are invisible to all higher levels. Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

44

Connectivity Fault Management ƒ Overview ƒ CFM Technology Primer ƒ CFM implementation

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

45

Standards-Based Ethernet OAM — Comprehensive Approach MPLS OAM: VCCV, LSP Ping/Traceroute

Customer

CE

E-LMI: Automated config of CE based on EVCs and bw profiles; L2 connectivity mgmt

Service Provider Ethernet Access

Customer MPLS Core

Ethernet Access

Customer Domain Provider Domain

Operator Domain

Operator Domain

Operator Domain

802.1ag Connectivity Fault Management: • Uses Domains to contain OAM flows and bound OAM responsibilities • Provides per EVC connectivity mgmt and fault isolation • Three types of packets: Continuity Check, L2 Ping, L2 Traceroute Connectivity and Performance Mgmt: • Per EVC measurement of availability/connectivity, frame loss ratio, latency, and jitter • Ethernet OAM functionality integrated with MPLS OAM functionality

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

CE 802.3ah Eth in First Mile: When applicable, physical connectivity mgmt between devices. Most applicable to “first mile” Standards: ITU-T SG 13 and SG 15: • Ethernet Layer Ntwk Arch (G.8010 SG 15) • Ethernet OAM Functionality (Y.17ethoam SG 13) • Reqmts for OAM in Ethernet based twk (Y.1730 – SG 13) IEEE: • 802.3ah – Ethernet in First Mile (Physical OAM); • 802.1ad – Provider Bridges • 802.1ag – Connectivity Mgmt (Per VLAN OAM) MEF: • E-LMI 46

CFM Technology Primer ƒ The Basics CFM uses standard Ethernet Frames. CFM frames are distinguishable by Ether-Type (and MAC Address for multicast messages). CFM frames are sourced, terminated, processed and relayed by Provider Bridges – only Bridges see CFM.

ƒ The Players Customer contracts with Metro-E Provider for end-to-end Ethernet service. Provider sub-contracts with Operator(s) to provide equipment and networks.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

47

CFM Technology Primer ƒ Maintenance Domains & Levels A “Management Space” owned and operated by a single organization (department). CFM message exchanges and operations are per-domain. A Domain has a Maintenance Level associated with it (value 0 to 7). Two (or more) disjoint domains may be at the same Level, even on the same device. Domains have a hierarchical relationship that parallels the structure of the “Players”.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

48

CFM Technology Primer ƒ Maintenance Domains & Levels (continued…) Domains may nest but cannot intersect.

OK NO As of this writing, higher Maintenance Levels are more “Phyward”, lower Maintenance Level are more “Custward”.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

49

CFM Technology Primer ƒ Maintenance Points A Maintenance Point (MP) is a demarcation point on an interface (port) that participates in CFM within a Maintenance Domain. Two classes of MPs: Maintenance End Points (MEPs): At the edge of a Domain. Actively source CFM messages. Are directional (inward or outward facing). Maintenance Intermediate Points (MIPs): Internal to a Domain. Passive points, only respond when triggered by certain CFM messages. MPs should be explicitly provisioned on Cisco IOS devices. The level of a MIP (or level 7 MEP) defines the port level.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

50

CFM Technology Primer Customer Equipment

MEP

Operator A Bridges

MEP

MIP MIP MIPMIP

MIP

MEP MEP MIP

MEP MIP MIP MIP MIP

Customer Level

MEP MIP

MIP

Inward Facing

Provider Level Operator Level

Ethernet OAM Tutorial

Customer Equipment

MIP MEP

MIP MEP

Outward Facing

Operator B Bridges

Operator Level

© 2006 Cisco Systems, Inc. All rights reserved.

51

CFM Technology Primer ƒ CFM Messages All CFM Messages are per Maintenance Domain and per S-VLAN (PE-VLAN or Provider-VLAN). Regular Ethernet Frames, distinguishable by Destination MAC and/or Ethertype. Provider Bridges that cannot interpret CFM Messages must forward them as normal data frames. Four types of Messages: Continuity Check (CC) Loopback Traceroute Alarm Indication Signal (AIS)

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

52

CFM Technology Primer ƒ Continuity Check (CC) Per-Domain & per-VLAN Multicast “heart-beat” messages. Destination address format: well-known

45 bits

Maintenance Level (0 to 7)

3 bits

Transmitted at a configurable periodic interval by MEPs (default is 30 seconds, range from 10 sec to 65535 sec.) Catalogued by MIPs at the same Maintenance Level. Terminated by remote MEPs at the same Maintenance Level. Uni-directional and do not solicit a response

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

53

CFM Technology Primer ƒ Continuity Check (continued …) Customer Equipment

MEP

Ethernet OAM Tutorial

Operator A Bridges

catalogue catalogue MIP MIP

© 2006 Cisco Systems, Inc. All rights reserved.

Operator B Bridges

Customer Equipment

catalogue & terminate MEP

54

CFM Technology Primer ƒ Loopback Unicast frame, source must be a MEP, destination may be a MEP or a MIP. Reply is unicast too. Generated on-demand via MIB or CLI. Loopback is specific to a Maintenance Domain and a VLAN. Timestamps embedded in Loopback Message can be used to measure RoundTrip Delay and One-Way Jitter.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

55

CFM Technology Primer ƒ Loopback (continued…)

Customer Equipment

src

MEP

Ethernet OAM Tutorial

Operator A Bridges

dest

MIP MIP

© 2006 Cisco Systems, Inc. All rights reserved.

Operator B Bridges

Customer Equipment

MEP

56

CFM Technology Primer ƒ Traceroute Multicast message, source must be a MEP, destination must be a MEP too. Reply is a unicast. Generated on-demand via MIB or CLI. Traceroute is specific to a Maintenance Domain & a VLAN. Allows the discovery of all MIPs belonging to the same Maintenance Domain along the path to destination MEP. On each visible hop indicate: Ingress Action, Relay Action, Egress Action.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

57

CFM Technology Primer ƒ Traceroute (continued …)

Customer Equipment

src

MEP

Ethernet OAM Tutorial

Operator A Bridges

MIP MIP

© 2006 Cisco Systems, Inc. All rights reserved.

Operator B Bridges

dest

Customer Equipment

MEP

58

SNMP Support (cont’d) ƒ No standardization yet ƒ Traps Generated by MEPs Two classes of traps: CC MEP Up/Down, Remote Port Status Change, CC Loop, Configuration Error, Cross-connected Service Crosscheck (provisioned state against running state) Missing MEP, Unknown MEP, Service Operational

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

59

Sample Topology sandiego-c3845

newyork-c2851

Gi0/1

Gi0/1

101.1.1.1 110.1.1.1 denver-3750me

7 4 Fa1/0/1

4 7 4

101.1.1.2 110.1.1.2

dallas-c7606

Level 4 MIP

4 4

Fa1/0/23

Gi3/23

4 4

sanjose-3750me

Gi3/23

4

Gi3/48

Fa1/0/24

Fa1/0/1

Gi3/48

4

Level 7 MIP Level 4 MEP

7 4

7 4

miami-c1841 Gi3/2

Fa0/1

detroit-c7606 101.1.1.3

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

60

Configuring CFM ƒ

Network Provisioning Done once at network bring-up or when devices are added or removed.

ƒ

Service Provisioning Done every time a service is enabled on the network.

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

61

Configuring CFM Network Provisioning

1. Configure Global parameters/attributes Router (config)# ethernet cfm enable

2. Configure Global parameters/attributes (Optional) Router (config)# ethernet cfm traceroute cache [size entries | max-hold-time minutes]

3. Configure Domains Router (config)# ethernet cfm domain domain-name level level-id

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

62

Configuring CFM Network Provisioning

4. Configure Operator Level MIPs Router(config-if)# ethernet cfm mip level level-id

5. Configure per-Domain parameters (optional) Router (config-ether-cfm)# mep archive-hold-time minutes Router (config)# ethernet cfm cc {level level-id | any} vlan any [interval seconds] [loss-threshold num_msgs]

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

63

Sample Topology Network Provisioning sandiego-c3845 Gi0/1 101.1.1.1 110.1.1.1 denver-3750me

7 Fa1/0/1

4

Level 4 MIP

7

Level 7 MIP

4 Fa1/0/23

newyork-c2851 ethernet ethernet cfm cfm domain domain CUSTOMER_DOMAIN CUSTOMER_DOMAIN level level 77 ethernet 44 ethernet cfm cfm domain domain PROVIDER_DOMAIN PROVIDER_DOMAIN level level Gi0/1 mep mep archive-hold-time archive-hold-time 60 60 101.1.1.2 dallas-c7606 ethernet cfm enable 110.1.1.2 ethernet cfm enable ethernet cfm traceroute cache ethernet cfm traceroute cache sanjose-3750me 4 !! 4 7 interface Gi3/23 Gi3/23 4 FastEthernet1/0/1 interface FastEthernet1/0/1 4 4 description connected sandiego-c3845 description connected to to sandiego-c3845 Gi3/48 Fa1/0/24 Fa1/0/1 switchport switchport trunk trunk encapsulation encapsulation dot1q dot1q switchport switchport mode mode trunk trunk ethernet cfm mip ethernet cfm mip level level 77 !! Gi3/48 interface FastEthernet1/0/23 interface FastEthernet1/0/23 4 7 description description connected connected to to dallas-c7606 dallas-c7606 miami-c1841 switchport trunk encapsulation dot1q 4 switchport trunk encapsulation dot1q Gi3/2 Fa0/1 switchport switchport mode mode trunk trunk detroit-c7606 ethernet cfm mip ethernet cfm mip level level 44 101.1.1.3

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

64

Configuring CFM Service Provisioning

1. Configure Service IDs Router (config-ether-cfm)# service

csi-id vlan vlan-id

2. Configure Customer Level MIPs (optional) Router(config-if)# ethernet cfm mip level level-id

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

65

Configuring CFM Service Provisioning

3. Configure Service Provider Level MIPs Router(config-if)# ethernet cfm mip level level-id

4. Configure MEPs for all Maintenance Levels Router(config-if)# ethernet cfm mep level {level-id} [inward]

mpid id vlan {vlan-id | any | vlan-id-vlan-id [, vlan-id-vlan-id]}

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

66

Configuring CFM Service Provisioning 5.

Configure per-service parameters (optional) Router (config)# ethernet

cfm cc {level level-id | any} vlan {vlan-id | vlanid-vlan-id [, vlan-id-vlan-id]} [interval seconds] [loss-threshold num_msgs]

6.

Enable Traps (optional) Router (config)# snmp-server

enable traps ethernet cfm cc [mep-up | mep-down | config | loop | cross-connect]

Router (config)# snmp-server

enable traps ethernet cfm crosscheck [ mep-unknown | mep-missing | service-up]

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

67

Configuring CFM Service Provisioning 7.

Enable CC (all enabled by default) Router (config)# ethernet

cfm cc enable level {any | level-id | level-idlevel-id [, level-id-level-id]} vlan {vlan-id | any | vlan-id-vlan-id [, vlan-id-vlan-id]}

8.

Configure and Enable Crosscheck (optional) Router (config)# ethernet cfm mep crosscheck start-delay delay Router (config-ether-cfm)# mep crosscheck mpid id vlan vlan-id [mac macaddress] Router (# ethernet cfm mep crosscheck {enable | disable} level {level-id | level-id-level-id [,level-id-level-id]}vlan {vlan-id | any | vlan-id-vlan-id [,vlanid-vlan-id]}

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

68

Sample Topology Network Provisioning sandiego-c3845 Gi0/1 101.1.1.1 110.1.1.1 denver-3750me

7 4 Fa1/0/1

4

Level 4 MIP

7

Level 7 MIP

4

Level 4 MEP

4 Fa1/0/23

newyork-c2851 ethernet ethernet cfm cfm domain domain CUSTOMER_DOMAIN CUSTOMER_DOMAIN level level 77 ethernet 44 ethernet cfm cfm domain domain PROVIDER_DOMAIN PROVIDER_DOMAIN level level Gi0/1 mep mep archive-hold-time archive-hold-time 60 60 101.1.1.2 dallas-c7606 service customer_101_provider service customer_101_provider vlan vlan 101 101 110.1.1.2 service vlan service customer_110_provider customer_110_provider vlan 110 110 sanjose-3750me 4 4 ethernet cfm enable ethernet cfm enable 7 ethernet traceroute Gi3/23 4 cfm ethernet cfmGi3/23 traceroute cache cache 4 4 !! Gi3/48 Fa1/0/24 Fa1/0/1 interface interface FastEthernet1/0/1 FastEthernet1/0/1 description description connected connected to to sandiego-c3845 sandiego-c3845 switchport trunk encapsulation switchport trunk encapsulation dot1q dot1q switchport mode trunk switchport modeGi3/48 trunk ethernet cfm mip 77 ethernet cfm mip level level 4 7 ethernet ethernet cfm cfm mep mep level level 44 mpid mpid 1110 1110 vlan vlan 110 110 miami-c1841 ethernet cfm mep level 4 mpid 1101 vlan 101 ethernet cfm mep level4 4Gi3/2 mpid 1101 vlan 101 Fa0/1 !! detroit-c7606 interface interface FastEthernet1/0/23 FastEthernet1/0/23 description description connected connected to to dallas-c7606 dallas-c7606101.1.1.3 switchport switchport trunk trunk encapsulation encapsulation dot1q dot1q switchport mode trunk switchport mode trunk ethernet ethernet cfm cfm mip mip level level 44 !!

ethernet ethernet cfm cfm cc cc enable enable level level 0-7 0-7 vlan vlan 1-4095 1-4095

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

69

Sample Topology Network Provisioning sandiego-c3845 Gi0/1 101.1.1.1 110.1.1.1 denver-3750me

7 4 Fa1/0/1

4

Level 4 MIP

7

Level 7 MIP

4

Level 4 MEP

Ethernet OAM Tutorial

4 Fa1/0/23

ethernet cfm domain CUSTOMER_DOMAIN level 7 ethernet cfm domain CUSTOMER_DOMAIN level 7 newyork-c2851 ethernet cfm domain PROVIDER_DOMAIN level 4 ethernet cfm domain PROVIDER_DOMAIN level 4 service customer_101_provider vlan 101 service customer_101_provider vlan 101 service customer_110_provider vlan 110 service customer_110_provider Gi0/1 vlan 110 ethernet cfm enable ethernet cfm enable 101.1.1.2 ! dallas-c7606 ! 110.1.1.2 interface GigabitEthernet3/23 interface GigabitEthernet3/23 description connected to denver-c3750me description connected to denver-c3750me switchport sanjose-3750me 4 4 switchport switchport mode trunk 7 switchport mode trunk Gi3/23 Gi3/23 ethernet 4 cfm mip level 4 4 ethernet cfm mip level 44 ! ! Gi3/48 interface GigabitEthernet3/24 Fa1/0/24 Fa1/0/1 interface GigabitEthernet3/24 description connected to sanjose-c3750me description connected to sanjose-c3750me switchport switchport switchport mode trunk switchport mode trunk ethernet cfm mip level 4 ethernet cfm mip level 4 ! Gi3/48 ! interface GigabitEthernet3/48 interface GigabitEthernet3/48 connected to detroit-c7606 4description 7 description connected to detroit-c7606 switchport switchport miami-c1841 switchport mode trunk 4 switchport mode trunk Fa0/1 ethernet Gi3/2 cfm mip level 4 ethernet cfm mip level 4 ! detroit-c7606 ! ethernet cfm cc enable level 0-7 vlan 1-4095 ethernet cfm cc enable level 0-7 vlan 1-4095 101.1.1.3

© 2006 Cisco Systems, Inc. All rights reserved.

70

Sample Topology Network Provisioning

ethernet ethernet cfm cfm domain domain CUSTOMER_DOMAIN CUSTOMER_DOMAIN level level 77 sandiego-c3845 newyork-c2851 ethernet cfm domain PROVIDER_DOMAIN level ethernet cfm domain PROVIDER_DOMAIN level 44 mep 60 mep archive-hold-time archive-hold-time 60 Gi0/1 Gi0/1 service service customer_101_provider customer_101_provider vlan vlan 101 101 101.1.1.2 service 101.1.1.1 service customer_110_provider customer_110_provider vlan vlan 110 110 dallas-c7606 110.1.1.2 110.1.1.1 ethernet ethernet cfm cfm enable enable ethernet denver-3750mecache ethernet cfm cfm traceroute traceroute cache sanjose-3750me 4 4 !! 7 7 interface Gi3/23 Gi3/23 4 4 4 4 interface FastEthernet1/0/1 FastEthernet1/0/1 4 description connected to description connected Fa1/0/23 to newyork-c3851 newyork-c3851 Gi3/48 Fa1/0/1 Fa1/0/24 switchport Fa1/0/1 switchport trunk trunk encapsulation encapsulation dot1q dot1q switchport mode trunk switchport mode trunk ethernet ethernet cfm cfm mip mip level level 77 ethernet ethernet cfm cfm mep mep level level 44 mpid mpid 3101 3101 vlan vlan 101 101 ethernet cfm mep level 4 mpid 3110 vlan 110 Gi3/48 ethernet mep level 4 mpid 3110 vlan 110 4 MIP 4 Levelcfm !! 4 7 interface FastEthernet1/0/24 interface FastEthernet1/0/24 Level 7 MIP 7 description miami-c1841 description connected connected to to dallas-c7606 dallas-c7606 4 switchport trunk encapsulation dot1q Gi3/2 Fa0/1 switchport trunk encapsulation dot1q switchport 4 Level 4mode MEPtrunk switchport mode trunk detroit-c7606 ethernet ethernet cfm cfm mip mip level level 44 101.1.1.3 !! ethernet ethernet cfm cfm cc cc enable enable level level 0-7 0-7 vlan vlan 1-4095 1-4095

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

71

Sample Topology Network Provisioning

ethernet ethernet cfm cfm domain domain CUSTOMER_DOMAIN CUSTOMER_DOMAIN level level 77 sandiego-c3845 newyork-c2851 ethernet cfm domain PROVIDER_DOMAIN level ethernet cfm domain PROVIDER_DOMAIN level 44 mep 60 mep archive-hold-time archive-hold-time 60 Gi0/1 Gi0/1 service service customer_101_provider customer_101_provider vlan vlan 101 101 101.1.1.2 service 101.1.1.1 service customer_110_provider customer_110_provider vlan vlan 110 110 dallas-c7606 110.1.1.2 110.1.1.1 ethernet ethernet cfm cfm enable enable ethernet denver-3750mecache ethernet cfm cfm traceroute traceroute cache sanjose-3750me 4 4 !! 7 7 interface Gi3/23 Gi3/23 4 4 4 4 interface GigabitEthernet3/2 GigabitEthernet3/2 4 description connected to description connected Fa1/0/23 to miami-c1841 miami-c1841 Gi3/48 Fa1/0/1 Fa1/0/24 switchport Fa1/0/1 switchport switchport mode trunk switchport mode trunk ethernet ethernet cfm cfm mip mip level level 77 ethernet ethernet cfm cfm mep mep level level 44 mpid mpid 4101 4101 vlan vlan 101 101 !! Gi3/48 4 Level 4 MIP interface GigabitEthernet3/48 interface GigabitEthernet3/48 4 7 description connected to dallas-c7606 description connected to dallas-c7606 Level 7 MIP 7 switchport miami-c1841 switchport 4 switchport mode trunk Gi3/2 Fa0/1 switchport mode trunk ethernet mip 4 Levelcfm 4 MEP ethernet cfm mip level level 44 detroit-c7606 !! 101.1.1.3 ethernet ethernet cfm cfm cc cc enable enable level level 0-7 0-7 vlan vlan 1-4095 1-4095

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

72

Show Commands

Show Local Maintenance Points denver-c3750me#show ethernet cfm maintenance-points local MPID DomainName

Level Type VLAN Port

CC-Status MAC

1101 PROVIDER_DOMAIN 0013.c33c.5680

4

MEP

101

Fa1/0/1

Enabled

1110 PROVIDER_DOMAIN 0013.c33c.5680

4

MEP

110

Fa1/0/1

Enabled

Level Type

Port

MAC

7

MIP

Fa1/0/1

0013.c33c.5680

4

MIP

Fa1/0/23

0013.c33c.5680

dallas-c7606#show ethernet cfm maintenance-points local Level Type

Port

MAC

4

MIP

Gi3/48

0015.6215.3e85

4

MIP

Gi3/24

0015.6215.3e85

4

MIP

Gi3/23

0015.6215.3e85

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

73

Show Commands

Show Local Maintenance Points: CC-Status

Possible values for Local MEP CC-Status: Enabled Disabled Inactive denver-c3750me#show ethernet cfm maintenance-points local MPID DomainName

Level Type VLAN Port

CC-Status MAC

1101 PROVIDER_DOMAIN

4

MEP

101

Fa1/0/1

Enabled

0013.c33c.5680

1110 PROVIDER_DOMAIN

4

MEP

110

Fa1/0/1

Enabled

0013.c33c.5680

Level Type

Port

MAC

7

MIP

Fa1/0/1

0013.c33c.5680

4

MIP

Fa1/0/23

0013.c33c.5680

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

74

Show Commands

Show Local Maintenance Points: CC-Status denver-c3750me(config)#ethernet cfm cc enable level 4 vlan 101 denver-c3750me#show ethernet cfm maintenance-points local MPID DomainName

Level Type VLAN Port

CC-Status MAC

1101 PROVIDER_DOMAIN

4

MEP

101

Fa1/0/1

Enabled

0013.c33c.5680

1110 PROVIDER_DOMAIN

4

MEP

110

Fa1/0/1

Disabled

0013.c33c.5680

Level Type

Port

MAC

7

Fa1/0/1

0013.c33c.5680

Fa1/0/23

0013.c33c.5680

4

MIP MIP

detroit-c7606(config)#interface GigabitEthernet3/2 detroit-c7606(config-if)#switchport trunk allowed vlan 200 detroit-c7606#show ethernet cfm maintenance-points local MPID DomainName

Level Type VLAN Port

CC-Status MAC

4101 PROVIDER_DOMAIN

4

Inactive

MEP

101

Gi3/2

Level Type

Port

MAC

7

MIP

Gi3/2

0015.6215.46c5

4

MIP

Gi3/48

0015.6215.46c5

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

0015.6215.46c5

75

Show Commands Show Domains

denver-c3750me#show ethernet cfm domain

Domain Name : CUSTOMER_DOMAIN Index : 1 Level : 7 Total Services : 0 Domain Name : PROVIDER_DOMAIN Index : 2 Level : 4 Total Services : 2 Services: VLAN Crosscheck ServiceID

Ethernet OAM Tutorial

101

Disabled

110

Disabled

customer_101_provider customer_110_provider © 2006 Cisco Systems, Inc. All rights reserved.

76

Show Commands

Show Remote Maintenance Points

denver-c3750me#show ethernet cfm maintenance-points remote MPID 3101 4101 3110

Level 4 4 4

Mac Address 0015.637b.4e00 0015.6215.46c5 0015.637b.4e00

Vlan 101 101 110

PortState UP UP UP

InGressPort Fa1/0/23 Fa1/0/23 Fa1/0/23

Age(sec) 19 6 6

Service ID customer_101_provider customer_101_provider customer_110_provider

dallas-c7606#show ethernet cfm maintenance-points remote MPID 1101 3101 4101 1110 3110

Level 4 4 4 4 4

Mac Address 0013.c33c.5680 0015.637b.4e00 0015.6215.46c5 0013.c33c.5680 0015.637b.4e00

Ethernet OAM Tutorial

Vlan 101 101 101 110 110

PortState UP UP UP UP UP

InGressPort Gi3/23 Gi3/24 Gi3/48 Gi3/23 Gi3/24

© 2006 Cisco Systems, Inc. All rights reserved.

Age(sec) 12 25 2 3 12

Service ID customer_101_provider customer_101_provider customer_101_provider customer_110_provider customer_110_provider

77

Show Commands

Other CFM Show Commands denver-c3750me#show ethernet cfm traceroute-cache Traceroute to 0015.637b.4e00 on Domain PROVIDER_DOMAIN, Level 4, vlan 101 issued at 1d04h -------------------------------------------------------------------------------MAC Hops

Host

Forwarded

Ingress Ingress Action

Relay Action

Egress

Next Hop

Egress Action

-------------------------------------------------------------------------------B 1 ! 2

dallas-c7606 sanjose-c3750me

0015.6215.3e85 Gi3/23

IngOk

RlyCCDB

Forwarded

EgrOK

sanjose-c3750me

Gi3/24

0015.637b.4e00 Fa1/0/2 IngOk

RlyNone

Not Forwarded

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

78

Clear Commands denver-c3750me#clear ethernet cfm ? errors

CFM errors

maintenance-points

CFM Maintenance Points

traceroute-cache

Clear Contents of traceroute cache

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

79

CFM Crosscheck ƒ

Allows configuring static list of expected remote MEPs per service, and then crosschecks this list against what is learnt dynamically from CC messages. Generates appropriate alarms when errors are detected.

Configure and Enable Crosscheck: ƒ

ethernet cfm mep crosscheck start-delay delay

ƒ

mep crosscheck mpid id vlan vlan-id [mac macaddress]

ƒ

ethernet cfm mep crosscheck {enable | disable} level {level-id | level-id-level-id [,level-id-level-id]}vlan {vlan-id | any | vlan-id-vlan-id [,vlan-id-vlan-id]}

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

80

CFM Debugs Ethernet CFM Debugs:

debug ethernet cfm all [domain domain-name | level level-id] [vlan vlan-id] debug ethernet cfm diagnostic [events | packets] debug ethernet cfm errors debug ethernet cfm events [domain domain-name | level level-id] [vlan vlan-id] debug ethernet cfm packets [domain domain-name | level level-id] [vlan vlan-id]

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

81

CFM Debugs 21:56:15: CFM-PKT: Received a cc packet from interface FastEthernet1/0/24 21:56:15: CFM-PKT: cfm packet dump - 104 bytes, interface FastEthernet1/0/24, vlan 110 21:56:15: CFM-PKT: ethernet CFM message dump, dest: 0100.0ccc.ccc4 src: 0013.c33c.5680 Version: 0 Maintenance Level: 4 MsgType: CC(0) Transaction Id: 3334414845 21:56:15: 01 00 0C CC CC C4 00 13 C3 3C 56 80 00 5A AA AA 21:56:15: 03 00 00 0C 01 26 00 04 00 08 C6 BF 21 FD 01 00 21:56:15: 26 00 63 75 73 74 6F 6D 65 72 5F 31 31 30 5F 70 21:56:15: 72 6F 76 69 64 65 72 3A 50 52 4F 56 49 44 45 52 21:56:15: 5F 44 4F 4D 41 49 4E 02 00 02 04 56 03 00 02 00 21:56:15: 4B 04 00 02 00 01 05 00 0E 64 65 6E 76 65 72 2D 21:56:15: 63 33 37 35 30 6D 65 00 21:56:15: 21:56:15: CFM-PKT: TLV Service ID 'customer_110_provider:PROVIDER_DOMAIN' 21:56:15: CFM-PKT: TLV MPID 1110 21:56:15: CFM-PKT: TLV LIFETIME 75 21:56:15: CFM-PKT: TLV PORT_STATE 0x1 (UP) 21:56:15: CFM-PKT: Received a CC packet with MPID 1110, level 4, vlan 110 from interface FastEthernet1/0/24 Ethernet OAM Tutorial 21:56:15: CFM-EVT:

© 2006 Cisco Systems, Inc. All rights reserved. Found remote mep for level 4 svlan 110, mpid 1110

82

Sample Topology Crosscheck sandiego-c3845 Gi0/1 101.1.1.1 110.1.1.1 denver-3750me

7 4 Fa1/0/1

4 7 4

Level 4 MIP

4 Fa1/0/23

newyork-c2851 ethernet ethernet cfm cfm domain domain PROVIDER_DOMAIN PROVIDER_DOMAIN level level 44 mep mep archive-hold-time archive-hold-time 60 60 service customer_101_provider Gi0/1 service customer_101_provider vlan vlan 101 101 service customer_110_provider 101.1.1.2 service customer_110_provider vlan vlan 110 110 dallas-c7606 110.1.1.2 mep crosscheck mpid 3101 vlan 101 mac 0015.637b.4e00 mep crosscheck mpid 3101 vlan 101 mac 0015.637b.4e00 mep crosscheck mpid 101 mep crosscheck mpid 4101 4101 vlan vlan 101 mac mac 0015.6215.46c5 0015.6215.46c5 sanjose-3750me 4 crosscheck 4 mpid mep 3110 vlan 110 mac 0015.637b.4e00 mep crosscheck mpid 3110 vlan 110 mac 0015.637b.4e00 7 !!Gi3/23 Gi3/23 4 4 ethernet 4 ethernet cfm cfm cc cc enable enable level level 0-7 0-7 vlan vlan 1-4095 1-4095 Gi3/48 ethernet cfm mep crosscheck start-delay 60 Fa1/0/24 Fa1/0/1 ethernet cfm mep crosscheck start-delay 60

Gi3/48

4

Level 7 MIP Level 4 MEP

7 4

miami-c1841 Gi3/2

Fa0/1

detroit-c7606 101.1.1.3

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

83

CFM Crosscheck denver-c3750me#ethernet cfm mep crosscheck enable level any vlan any denver-c3750me#show ethernet cfm domain Domain Name : CUSTOMER_DOMAIN Index : 1 Level : 7 Total Services : 0 Domain Name : PROVIDER_DOMAIN Index : 2 Level : 4 Total Services : 2 Services: VLAN Crosscheck ServiceID 101

Enabled

customer_101_provider

110

Enabled

customer_110_provider

Crosscheck: MPID

Vlan

Remote-Mac

3101

101

0015.637b.4e00 Yes

4101

101

0015.6215.46c5 Yes

3110

110

0015.637b.4e00 Yes

Ethernet OAM Tutorial

Mep-Up

© 2006 Cisco Systems, Inc. All rights reserved.

84

CFM Crosscheck denver-c3750me#show ethernet cfm maintenance-points remote crosscheck

MPID Level

VLAN Mep-Up Remote Mac

3101

4

101

Yes 0015.637b.4e00

4101

4

101

Yes 0015.6215.46c5

3110

4

110

Yes 0015.637b.4e00

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

85

Troubleshooting with CFM ƒ Proactive Traps give asynchronous fault notification Use Loopback and Traceroute to verify and isolate faults

ƒ Reactive Use Loopback and Traceroute to verify and isolate faults

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

86

Troubleshooting with CFM Start with Highest-Level Maintenance Domain

Troubleshooting Workflow Jump to Lower Maintenance Domain

Check Bridge Error Status

Shows Error No Loopback Test

Confirms Problem

Traceroute to Destination

Failure Isolated?

Yes

Fault Verification

Fault Isolation

Take Corrective Action

Stop Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

87

Troubleshooting with CFM Commands ƒ Loopback ping ethernet mac-address {domain domain-name | level level-id} vlan vlan-id

ƒ Traceroute traceroute ethernet {mac-address}{domain domain-name | level level-id} vlan vlan-id

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

88

Troubleshooting with CFM sandiego-c3845

newyork-c2851

Gi0/1

Gi0/1

101.1.1.1 110.1.1.1 denver-3750me

7 4 Fa1/0/1

4 7 4

101.1.1.2 110.1.1.2

dallas-c7606

Level 4 MIP

4 4

Fa1/0/23

Gi3/23

4 4

sanjose-3750me

Gi3/23

4

Gi3/48

Fa1/0/24

Fa1/0/1

Gi3/48

4

Level 7 MIP Level 4 MEP

7 4

7 4

miami-c1841 Gi3/2

Fa0/1

detroit-c7606 101.1.1.3

Ethernet OAM Tutorial

© 2006 Cisco Systems, Inc. All rights reserved.

89

Troubleshooting with CFM ƒ

SNMP Traps are generated when a remote MEP is not heard from.

Received SNMPv2c Trap: Community: TEST From: 127.0.0.1 sysUpTimeInstance = 46593 snmpTrapOID.0 = cEtherCfmCcMepDown cEtherCfmEventServiceId.1.3.4 = customer_110_provider