Catalyst 6506E and WS-X6516-GBIC modules - connection to the fabric/bus

[Dmitriy Ivanov]

Dear Colleagues,

We have some number of 6506e switches and on one of them I see strange behavior:

c6k5-core-ff>sh mod
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 10 WiSM WLAN Service Module WS-SVC-WISM-1-K9 SAD114103EB
2 16 SFM-capable 16 port 1000mb GBIC WS-X6516-GBIC SAL0704BZ49
3 16 SFM-capable 16 port 1000mb GBIC WS-X6516-GBIC SAD054804BK
4 16 SFM-capable 16 port 1000mb GBIC WS-X6516-GBIC SAL0704BZ4K
5 2 Supervisor Engine 720 (Hot) WS-SUP720-3B SAL11488ANS
6 2 Supervisor Engine 720 (Active) WS-SUP720-3B SAL11488AHY
7 8 Network Analysis Module WS-SVC-NAM-2 SAD0739056W

c6k5-core-ff>sh fabric status
slot channel speed module fabric
status status
1 1 N/A OK OK
3 0 8G OK OK
5 0 20G OK OK
6 0 20G OK OK
7 0 8G OK OK

c6k5-core-ff>sh fabric switching-mode
Global switching mode is Truncated
dCEF mode is not enforced for system to operate
Fabric module is not required for system to operate
Modules are allowed to operate in bus mode
Truncated mode is allowed, due to presence of CEF720, Standby supervisor module

Module Slot Switching Mode
1 Crossbar
2 Bus
3 Crossbar
4 Bus
5 Crossbar
6 Bus
7 Crossbar
c6k5-core-ff>

As you see modules 2,3,4 are the same but mod 2 and 4 connected to Bus, mod 3 connected to crossbar.  My understanding is that SFM -compatible module must be connected to crossbar. Do i miss something?

Thanks a lot!

[Iulian Vaideanu]

Maybe mod 3 is equipped with a DFC (that would be shown in the rest of the "sh mod" output)...

[Dmitriy Ivanov]

Here it is:

c6k5-core-ff>sh mod
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 10 WiSM WLAN Service Module WS-SVC-WISM-1-K9 SAD114103EB
2 16 SFM-capable 16 port 1000mb GBIC WS-X6516-GBIC SAL0704BZ49
3 16 SFM-capable 16 port 1000mb GBIC WS-X6516-GBIC SAD054804BK
4 16 SFM-capable 16 port 1000mb GBIC WS-X6516-GBIC SAL0704BZ4K
5 2 Supervisor Engine 720 (Hot) WS-SUP720-3B SAL11488ANS
6 2 Supervisor Engine 720 (Active) WS-SUP720-3B SAL11488AHY
7 8 Network Analysis Module WS-SVC-NAM-2 SAD0739056W

Mod MAC addresses Hw Fw Sw Status
--- ---------------------------------- ------ ------------ ------------ -------
1 001d.45f9.72ca to 001d.45f9.72d9 2.2 12.2(14r)S5 12.2(18)SXF1 Ok
2 0009.11f3.5428 to 0009.11f3.5437 5.3 6.3(1) 8.5(0.46)RFW Ok
3 0002.7ee0.a3c0 to 0002.7ee0.a3cf 3.0 6.1(3) 8.5(0.46)RFW Ok
4 0009.11f3.5b78 to 0009.11f3.5b87 5.3 6.3(1) 8.5(0.46)RFW Ok
5 0016.4708.8334 to 0016.4708.8337 5.6 8.5(2) 12.2(18)SXF1 Ok
6 0016.46f9.7ff8 to 0016.46f9.7ffb 5.6 8.5(2) 12.2(18)SXF1 Ok
7 0003.feac.d2f4 to 0003.feac.d2fb 2.0 7.2(1) 5.1(1) Ok

Mod Sub-Module Model Serial Hw Status
---- --------------------------- ------------------ ----------- ------- -------
1 Centralized Forwarding Card WS-SVC-WISM-1-K9-D SAD11410105 2.1 Ok
5 Policy Feature Card 3 WS-F6K-PFC3B SAL11488B51 2.3 Ok
5 MSFC3 Daughterboard WS-SUP720 SAL11488HRY 3.1 Ok
6 Policy Feature Card 3 WS-F6K-PFC3B SAL11488B6D 2.3 Ok
6 MSFC3 Daughterboard WS-SUP720 SAL11488HT5 3.1 Ok

Mod Online Diag Status
---- -------------------
1 Pass
2 Pass
3 Pass
4 Pass
5 Pass
6 Pass
7 Pass
c6k5-core-ff>

[Iulian Vaideanu · Accepted solution]

This seems to be your case:

http://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst6500/ios/12-2SX/release/notes/ol_14271/hardware.html#WS-X6516-GBIC

"With a Supervisor Engine 720 but without a DFC3, WS-X6516-GBIC hardware revisions 5.0 through 5.4 operate in bus mode."

[Dmitriy Ivanov]

Thanks a lot! It explains everything.

• Supervisor Engine 720 does not support a DFC3 on WS-X6516-GBIC hardware revisions 5.0 through 5.4. With a Supervisor Engine 720 and with a DFC3 installed, WS-X6516-GBIC hardware revisions 5.0 through 5.4 do not power up.

I Do NOT have DFC3 that is why those 2 modules powered up

• With a Supervisor Engine 720 but without a DFC3, WS-X6516-GBIC hardware revisions 5.0 through 5.4 operate in bus mode.

Yep- that is what we see :-)

amazing ! Thanks a lot!