Cisco Support Community Presents
Tech-Talk Series
Carrier Routing System (CRS)
Multi-Chassis
Hitesh Kumar
Rahul Rammanohar
Vinay Kumar
CCIE SP (#38757)
CCIE R&S, SP (#13015)
CCIE R&S (#35210)
HTTS
HTTS
HTTS
1
Standalone Chassis
CRS-16/S, CRS-16/S-B
CRS1 - 1.12Tbps
CRS3 - 4.48Tbps
CRS-8/S, CRS-8/S-B
Back to Back (2+0)
Multi-Chassis (X+1, X+2, X+4)
X is from 3 to 9
CRS-16/S, CRS-16/S-B
CRS-16/S, CRS-16/S-B
CRS1 - 2.24Tbps
CRS3 - 8.96Tbps
CRS-8/S, CRS-8/S-B
CRS1 - 620Gbps
CRS3 - 2.24Tbps
CRS1 - 1.12Tbps
CRS3 - 4.48Tbps
CRS-4/S
CRS1 - 320Gbps
CRS3 - 1.12Tbps
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
2
Ingress --> 8 (planes) * 4 links * 2.5G * 8b/10b (encoding) * 120/136 (overhead) = 56 Gbps
Egress <-- 8 (planes) * 4 links * 2.5G * 8b/10b (encoding) * 120/136 (overhead) * 2 S3 ASICs = 112 Gbps
8
. . .
Line Card
0-7
2
. ..
8 of 8
S3
2 of 8
1 of 8
1
4 connections of 2.5G
to each plane.
S3
S3
S3
S2
S1
S2
S1
. .
S2
S1
S3
S3
S3
8
Line Card
8-15
S1
S2
S3
2
1
S1
8
S3
S2
S1
S3
S2
S3
Route Processor
S3
2
1
2 connections to each
plane to lower S1 only.
© 2010 Cisco and/or its affiliates. All rights reserved.
18 Links
18 Links
Cisco Confidential
3
Ingress --> 8 (planes) * 5 links * 5G * 8b/10b (encoding) * 120/136 (overhead) = 141 Gbps
Egress <-- 8 (planes) * 8 links * 5G * 8b/10b (encoding) * 120/136 (overhead) * 2 S3 ASICs = 225 Gbps
8
Line Card
2
. ..
8 of 8
S2
2 of 8
1 of 8
S1
. . . . .
1
5 connections of 5G
to each plane.
S3
S2
S1
S3
S1
S2
S3
S2
8
Line Card
S2
S1
S2
S3
2
S1
1
S2
S1
S3
S3
S2
8
S2
Route Processor
2
1
12 Links
© 2010 Cisco and/or its affiliates. All rights reserved.
24 Links
Cisco Confidential
4
OIM LED
Module
Line Card Chassis
Array Cables
Fabric Chassis
IngressQ
S2
FabricQ
MSC Card
S1
S13 Fabric Card
S3
S2
S1
S2 Fabric Card
S3
S2
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
5
Line Card Chassis
Back to Back
Cables
Line Card Chassis
IngressQ
S1
S3
IngressQ
S2
FabricQ
S1
FabricQ
S3
S1
MSC Card
S13 Fabric Card
S2
S1
S3
S13 Fabric Card
MSC Card
S3
S2
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
6
RP0
Intra-rack
LCC0
RP1
Inter-rack
SC0
RP0
Intra-rack
LCC1
RP1
Inter-rack
Forwarding Links
Blocked Links
© 2010 Cisco and/or its affiliates. All rights reserved.
SC1
FCC0
Cisco Confidential
7
Single Module Topology
Multi-Module Topology
• Full Plane Configuration
• Three Plane Configuration
• Each S2 SFC serves one plane
• Three S2 SFC’s are used to create a plane
•
The array cables for each fabric plane are
connected to a ONE SFC
• Each S13 card is connected to a single S2 card
The array cables for each fabric plane are connected to all
THREE cards
• Each S13 card is connected to 3 different S2
cards
To LC rack # 0
To LC rack # 0
To LC rack # 2
To LC rack # 1
Switch Fabric
Card (SFC)
© 2010 Cisco and/or its affiliates. All rights reserved.
To LC rack # 6
To LC rack # 8
Switch
Fabric
Cards
Cisco Confidential
8

Planes are not tied to specific slots in fabric rack

Admin-level config defines the slots for each plane
Count 3 - The cables from each
LCC for that plane connect to 3
different OIMs.
uses (and how big the plane is)
controllers fabric plane 0
oim count 1
oim width 1
oim instance 0 location F0/SM0/FM
Count 1- All cables in plane
connect to the same OIM.
controllers fabric plane 1
oim count 3
oim instance 0 location F0/SM8/FM
oim instance 1 location F0/SM7/FM
oim instance 2 location F0/SM6/FM
3 different cards makes one plane.
Plane 1 uses rack F0 slot SM6, SM7 and SM8.
Position of 1st card within the plane in fabric rack.
Plane 0 uses rack F0 slot SM0.
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
9
Assign a rack number to the S/N of each chassis. Serial numbers can be obtained from,
- ‘show diag chassis’
- rommon with ‘dumpplaneeeprom’
- rear of the FCC and front of the LCC
• Rack 0 or 1 = dSC (also an LCC)
• Rack 1 -> 127 = LCC
• Rack f0 -> f4 = FCC
Note: Rack numbers have to be unique
Example:
RP/0/RP0/CPU0:CRS3#admin show run | i dsc
Building configuration...
dsc serial TBA10080000 rack 1
dsc serial TBA10090001 rack 0
dsc serial TBA10120000 rack f0
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
10
Thank you.