Carrier Ethernet Exchange Robert J Huey Equinix, Inc. <[email protected]> 1 Overview
Multi-Segmented Ethernet Virtual Connection (EVC)
UNI
ENNI
UNI
ENNI
Ethernet Service
Carrier Ethernet
Ethernet Network
Provider
Exchange
Operator
OVC
OVC
E-­‐NNI = External Network Network Interface UNI = User Network Interface OVC = Operator Virtual Circuit 2 CEE: Key Objectives
•  Facilitate mulK-­‐segmented Ethernet services •  Accelerate Ethernet service delivery •  Increase geographic distribuKon & reach “If it makes sense to do this anywhere, it makes sense to do it everywhere” 3 CEE: Key Components
•  Ethernet Exchange switch fabric(s) –  Alcatel-­‐Lucent 7450 (SR/ESS Pla^orm) –  Metro-­‐Area/Redundant Topologies •  Exchange Portal Features –  The Marketplace (match buyers & sellers) –  Alcatel-­‐Lucent 5620SAM (SAM-­‐0) –  Automate Service Provisioning –  SLA Monitoring (staKsKcs distribuKon) –  TroubleshooKng 4 ECEE Portal Architecture
London
On-Net
Disk
Buildings
DB
Frankfurt
Service
Provider
Service
Provider
Paris
Primary
EMS
ECEE
PORTAL
Network
Tools
Backup
EMS
Service
Provider
New York
Chicago
Los Angeles
Tokyo
Customer
Disk
DB
Hong Kong
Singapore
5 Physical Interconnect Types
Carrier A
•  Port Types 1.  1GbE 2.  10GE •  ConnecKon Methods A. 
B. 
C. 
D. 
Single Circuit Link AggregaKon MulK-­‐Chassis LAG MulK-­‐Chassis w/
Redundant IBX ECEE
Switch
IBX-A
Carrier B
Metro ECEE Network
IBX-B
ECEE
Switch
IBX-C
ECEE
Switch
Carrier C
ECEE
Switch
Carrier D
6 Exchange Service Topologies
E-NNI Aggregation Switch Fabric
A
E-NNI
E-NNI
B
C
E-NNI
E-NNI
D
•  Point-­‐to-­‐Point Topology (E-­‐Line) •  MulK-­‐Point Topology (E-­‐LAN) 7 Exchange Fabric Behavior
ECEE Exchange
Switch
Client Data
e
es
Pr
rve
Preserve the original
end user data
Pr
e
se
rve
Carrier Frame
E-NNI
Translate
Ad
ap
t
VLAN Frame Type Translation
VLAN ID Translation
TPID Translation
CoS Bits
Translate
a
Ad
E-NNI
pt
QoS Marking &
Queue Adaptation
•  Preserve: Data & Protocol Transparency •  Translate: Frame Handling •  Adapt: QoS Behaviors 8 Quality of Service
•  The Bad News ECEE –  It’s wrijen into the service provider product descripKon •  The Good News –  It’s wrijen into the service provider product descripKon •  We have to support whatever comes our way •  Requires Good Network Queuing and Mapping –  ModificaKon from default behavior –  MPLS switching = MPLS EXP bit mapping to Queues –  Strict Priority Order Drop !"#"#
+
/
0
1
2
,
.
$%&'()*%
,,,
,,.
,.,
,..
.,,
.,.
..,
...
3456678(94:;(<#=5>7:4
Congestion
9 Ingress QoS Adaptation
•  Default Ingress CoS TranslaKon TECEE able –  Carriers need only create the policy once to match product descripKon –  Side AgnosKc –  All marking policies can be customized if desired •  Can only use a 802.1p bit once •  Can use more than one 802.1p bit to idenKfy traffic on ingress only !
"
#
)*+,-../0,12,134/5-6-7/32/89-9:9;<-,/2=/89-9-.
$
%
&
'
(
!
!
!
"
"
"
"
#
#
#
"
#
$
$
$
#
$
%
%
%
!
!
!
!/
!/
"
89-9-.
802.1p
Bits
&
&
"
#
$
%
&
'
'
(
Traffic Direction
10 Egress QoS Adaptation
•  Default Egress CoS TranslaKon Table ECEE –  Carriers need only create the policy once to match product descripKon –  Side AgnosKc –  All marking policies can be customized if desired •  Only one 802.1p bit (mark) per egress queue !
"
(
(
-./+,,0)*+*+,01203/42/41506+7+8
9*:;+/02<0)*+*+,
#
$
%
&
'
(
(
(
'
'
'
(
&
&
&
'
)*+*+,
%
%
%
&
'
802.1p
Bits
$
$
$
%
&
'
#
$
%
&
(
(0
(0
#
#
"
!
'
"
Traffic Direction
11 Ingress Scheduling
• 
• 
Weighted Queues (priority order drop) Per Queue Parameters (opKonal) –  Commijed InformaKon Rate (CIR) –  Peak InformaKon Rate (PIR) –  Maximum Rate •  Service Rate (opKonal) ECEE –  Typically match the carrier product descripKon –  Example: •  100M Service Rate •  1GbE Service Rate CIR, PIR, MAX
EVC #1
CIR, PIR, MAX
CIR, PIR, MAX
To Network
CIR, PIR, MAX
EVC #2
CIR, PIR, MAX
CIR, PIR, MAX
Service Rate
Scheduler
Port
Scheduler
12 Egress Scheduling
• 
Mirrors of Ingress QoS Policy –  Number of Queues –  Class maps • 
Weighted Queues (priority order drop) 111
•  All eight (8) MPLS EXP or 802.1p Bits ECEE expressed in class map policy •  Per Queue Parameters (opKonal) Queue #4
110
101
Queue #3
100
011
To Port
Queue #2
010
001
Queue #1
000
Egress
Class Map
Port
Scheduler
13 Ethernet OAM
• 
IEEE 802.1ag –  Hierarchal Maintenance Domain –  Maintenance AssociaKon, MIPs & MEP –  ConnecKvity Fault Management •  ITU-­‐T Y.1731 ECEE –  All that (plus) –  Frame loss measurement –  Frame delay measurement 14 Lessons
•  Field VerificaKon & TesKng DECEE ifficulKes •  RFC2544 TesKng – 
– 
– 
– 
– 
Throughput Burst Rate Frame loss Latency Not MulK-­‐Service Aware
•  The Stacked NIDs Problem •  Ethernet OAM (to much to expect?) •  What’s next? 15 References
ECEE • 
The Metro Ethernet Forum. Technical Specifica.on MEF 26, External Network Network Interface (ENNI) – Phase 1 . January 2010. hjp://metroetherne^orum.org/PDF_Documents/technical-­‐specificaKons/MEF26.pdf •  Balakrishnan, R. (May 2008). Advanced QoS for Mul.-­‐Service IP/MPLS Networks. (Wiley) •  ITU-­‐T RecommendaKon Y.1731 -­‐ OAM funcKons and mechanisms for Ethernet based networks •  ITU-­‐T RecommendaKon Y.156 -­‐ OAM funcKons and mechanisms for Ethernet based networks 16 QuesKons? Thank You
17