- Cisco Community
- Technology and Support
- Data Center and Cloud
- Unified Computing System (UCS)
- Unified Computing System Discussions
- Fabric Interconnect 6248 & 5548 Connectivity on 4G SFP with FC
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Fabric Interconnect 6248 & 5548 Connectivity on 4G SFP with FC
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 04:26 AM - edited 03-01-2019 11:25 AM
Hi,
Recently I came across a scenario when I connected a 4G SFP on Expansion Module of 6248 Fabric Interconnect at one end and at other end 4G SFP on 5548UP. I was unable to establish FC connectivity between both of the devices and the momemt I connected 4G SFP on Fixed Module of 6248 connectivity got established between both the devices
I would like to know do I have to do any changes on FI's Expansion module to get the connectivity working or this kind of behivor is expected behavior
Do let me know if you need any other information on this
Regards,
Amit Vyas
- Labels:
-
Unified Computing System (UCS)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 04:43 AM
Did you configure with the slider FC ports on the expansion module (this will require a reset of the module) ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 04:53 AM
Yes, I did that then too I was unable to see those port UP in UCSM
I tried changing the ports on expansion module but no luck
-Amit
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 06:27 AM
I assume you can exclude the cable + SFP ? (swapping from expansion module to fixed ports ?)
Is the port type (FC uplink), and VSAN ok ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 06:37 AM
Port type is FC uplink and VSAN is also configured same like 5548UP switch. This is applicable to both Fixed and Expansion module ports
If is exclude swapping from expansion to fixed i am unable to establish connection between both devices
-Amit
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 12:28 PM
Did you try another FC port on the expansion module ?
Did you try to reset the expansion module ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 12:46 PM
Yes, I tried changing the ports of expansion module from port 3 to 16 which didn't helped me
I haven't reset Expansion module. I can give a try on that on next maintenance window
I am still wondering why expansion module didn't detected 4G SFP module where same SFP got detected on Fixed module?
Should I raise a TAC SR for this ?
-Amit
Sent from Cisco Technical Support Android App
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 12:54 PM
Indeed very strange !
Q. do you have 2 Brocade switches (fabric A and B) or just one ?
Q. are both FI 6248 show the same error
Q. can you connect with SSH to both FI, and post the output of "show interface brief", specially the fc interfaces
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 05:52 PM
Q. do you have 2 Brocade switches (fabric A and B) or just one ?
A. No both are Cisco Nexus 5548UP Switches
Q. are both FI 6248 show the same error
A. Yes
Q. can you connect with SSH to both FI, and post the output of "show interface brief", specially the fc interfaces
A. Following is the output of "show interface brife" command for both 6248
Switch-A(nxos)# show interface brief
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
-------------------------------------------------------------------------------
fc1/31 100 NP off up swl NP 4 --
fc1/32 100 NP off up swl NP 4 --
fc2/13 1 NP off sfpAbsent -- -- --
fc2/14 1 NP off sfpAbsent -- -- --
fc2/15 100 NP off sfpAbsent -- -- --
fc2/16 100 NP off sfpAbsent -- -- --
--------------------------------------------------------------------------------
Ethernet VLAN Type Mode Status Reason Speed Port
Interface Ch #
--------------------------------------------------------------------------------
Eth1/1 1 eth access down SFP not inserted 10G(D) --
Eth1/2 1 eth fabric up none 10G(D) --
Eth1/3 1 eth fabric up none 10G(D) --
Eth1/4 1 eth fabric up none 10G(D) --
Eth1/5 1 eth fabric up none 10G(D) --
Eth1/6 1 eth fabric up none 10G(D) --
Eth1/7 1 eth fabric up none 10G(D) --
Eth1/8 1 eth fabric up none 10G(D) --
Eth1/9 1 eth fabric up none 10G(D) --
Eth1/10 1 eth fabric up none 10G(D) --
Eth1/11 1 eth fabric up none 10G(D) --
Eth1/12 1 eth fabric up none 10G(D) --
Eth1/13 1 eth fabric up none 10G(D) --
Eth1/14 1 eth fabric up none 10G(D) --
Eth1/15 1 eth fabric up none 10G(D) --
Eth1/16 1 eth fabric up none 10G(D) --
Eth1/17 1 eth fabric up none 10G(D) --
Eth1/18 1 eth access down SFP not inserted 10G(D) --
Eth1/19 1 eth access down SFP not inserted 10G(D) --
Eth1/20 1 eth access down SFP not inserted 10G(D) --
Eth1/21 1 eth trunk up none 10G(D) --
Eth1/22 1 eth trunk up none 10G(D) --
Eth1/23 1 eth access down SFP not inserted 10G(D) --
Eth1/24 1 eth access down SFP not inserted 10G(D) --
Eth1/25 1 eth access down SFP not inserted 10G(D) --
Eth1/26 1 eth fabric up none 10G(D) --
Eth1/27 1 eth fabric up none 10G(D) --
Eth1/28 1 eth fabric up none 10G(D) --
Eth1/29 1 eth fabric up none 10G(D) --
Eth1/30 1 eth access down SFP not inserted 10G(D) --
Eth2/1 1 eth access down Administratively down 10G(D) --
Eth2/2 1 eth access down Administratively down 10G(D) --
Eth2/3 1 eth access down SFP not inserted 10G(D) --
Eth2/4 1 eth access down SFP not inserted 10G(D) --
Eth2/5 1 eth access down SFP not inserted 10G(D) --
Eth2/6 1 eth access down SFP not inserted 10G(D) --
Eth2/7 1 eth access down SFP not inserted 10G(D) --
Eth2/8 1 eth access down SFP not inserted 10G(D) --
Eth2/9 1 eth access down SFP not inserted 10G(D) --
Eth2/10 1 eth access down SFP not inserted 10G(D) --
Eth2/11 1 eth access down SFP not inserted 10G(D) --
Eth2/12 1 eth access down SFP not inserted 10G(D) --
Switch-B(nxos)# show interface brief
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
-------------------------------------------------------------------------------
fc1/31 101 NP off up swl NP 4 --
fc1/32 101 NP off up swl NP 4 --
fc2/13 1 NP off sfpAbsent -- -- --
fc2/14 1 NP off sfpAbsent -- -- --
fc2/15 100 NP off sfpAbsent -- -- --
fc2/16 100 NP off sfpAbsent -- -- --
--------------------------------------------------------------------------------
Ethernet VLAN Type Mode Status Reason Speed Port
Interface Ch #
--------------------------------------------------------------------------------
Eth1/1 1 eth access down SFP not inserted 10G(D) --
Eth1/2 1 eth fabric up none 10G(D) --
Eth1/3 1 eth fabric up none 10G(D) --
Eth1/4 1 eth fabric up none 10G(D) --
Eth1/5 1 eth fabric up none 10G(D) --
Eth1/6 1 eth fabric up none 10G(D) --
Eth1/7 1 eth fabric up none 10G(D) --
Eth1/8 1 eth fabric up none 10G(D) --
Eth1/9 1 eth fabric up none 10G(D) --
Eth1/10 1 eth fabric up none 10G(D) --
Eth1/11 1 eth fabric up none 10G(D) --
Eth1/12 1 eth fabric up none 10G(D) --
Eth1/13 1 eth fabric up none 10G(D) --
Eth1/14 1 eth fabric up none 10G(D) --
Eth1/15 1 eth fabric up none 10G(D) --
Eth1/16 1 eth fabric up none 10G(D) --
Eth1/17 1 eth fabric up none 10G(D) --
Eth1/18 1 eth access down SFP not inserted 10G(D) --
Eth1/19 1 eth access down SFP not inserted 10G(D) --
Eth1/20 1 eth access down SFP not inserted 10G(D) --
Eth1/21 1 eth trunk up none 10G(D) --
Eth1/22 1 eth trunk up none 10G(D) --
Eth1/23 1 eth access down SFP not inserted 10G(D) --
Eth1/24 1 eth access down SFP not inserted 10G(D) --
Eth1/25 1 eth access down SFP not inserted 10G(D) --
Eth1/26 1 eth fabric up none 10G(D) --
Eth1/27 1 eth fabric up none 10G(D) --
Eth1/28 1 eth fabric up none 10G(D) --
Eth1/29 1 eth fabric up none 10G(D) --
Eth1/30 1 eth access down SFP not inserted 10G(D) --
Eth2/1 1 eth access down SFP not inserted 10G(D) --
Eth2/2 1 eth access down SFP not inserted 10G(D) --
Eth2/3 1 eth access down SFP not inserted 10G(D) --
Eth2/4 1 eth access down SFP not inserted 10G(D) --
Eth2/5 1 eth access down Administratively down 10G(D) --
Eth2/6 1 eth access down Administratively down 10G(D) --
Eth2/7 1 eth access down SFP not inserted 10G(D) --
Eth2/8 1 eth access down SFP not inserted 10G(D) --
Eth2/9 1 eth access down SFP not inserted 10G(D) --
Eth2/10 1 eth access down SFP not inserted 10G(D) --
Eth2/11 1 eth access down SFP not inserted 10G(D) --
Eth2/12 1 eth access down SFP not inserted 10G(D) --
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-30-2013 11:46 PM
ok, you have ports 31 and 32 on the fixed module, and ports 13-16 on the expansion module configured as FC.
how does the same command look on the 5548 ?
On FI-B, ports 15-16 are in Vsan 100, should probably be 101 ?
Can you insert the 4G SFP, and do a show interface brief ? check that SFP is discovered, typ=swl
Q. are you migrating the fc ports from the fixed to the expansion module ?
Is my understanding correct, that you have 2 links from each FI to a 5548, no port fc port-channel ?
if this is the case, best practise would be to define a fc port-channel (trunking port channel)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-31-2013 03:11 AM
Yes, On FI-B port 15-16 should be in VSAN 101 instead of 100, I have made that correction
Q. are you migrating the fc ports from the fixed to the expansion module ?
A: As off now I am not migrating FC port but in near future I have to migrate FC ports to Expansion module and I don't want to waste my time for troubleshooting at that time.
Is my understanding correct, that you have 2 links from each FI to a 5548, no port fc port-channel ?
A: Yes, your understanding is correct we have 2 links from each FI to 5548 and no FC port-channel is configured
I will do the FC port-channel later on once I am able to fix the connectivity issue
I will try to put 4G SFP on expansion module and will provide you output of "show interface brife"
Following is the out of "show interface brife" from both 5548UP switches
Primary5548_SW# show interface brief
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
-------------------------------------------------------------------------------
fc1/29 100 auto on up swl F 4 --
fc1/30 100 auto on up swl F 4 --
fc1/31 100 auto on up swl F 4 --
fc1/32 100 auto on up swl F 4 --
--------------------------------------------------------------------------------
Ethernet VLAN Type Mode Status Reason Speed Port
Interface Ch #
--------------------------------------------------------------------------------
Eth1/1 1 eth access down Link not connected 10G(D) --
Eth1/2 1 eth access down Link not connected 10G(D) --
Eth1/3 1 eth access down SFP not inserted 10G(D) --
Eth1/4 1 eth access down SFP not inserted 10G(D) --
Eth1/5 1 eth access down SFP not inserted 10G(D) --
Eth1/6 1 eth access down SFP not inserted 10G(D) --
Eth1/7 1 eth access down SFP not inserted 10G(D) --
Eth1/8 1 eth access down SFP not inserted 10G(D) --
Eth1/9 1 eth access down SFP not inserted 10G(D) --
Eth1/10 1 eth access down SFP not inserted 10G(D) --
Eth1/11 1 eth access down SFP not inserted 10G(D) --
Eth1/12 1 eth access down SFP not inserted 10G(D) --
Eth1/13 1 eth access down SFP not inserted 10G(D) --
Eth1/14 1 eth access down SFP not inserted 10G(D) --
Eth1/15 1 eth access down SFP not inserted 10G(D) --
Eth1/16 1 eth access down SFP not inserted 10G(D) --
Eth1/17 1 eth access down SFP not inserted 10G(D) --
Eth1/18 1 eth access down SFP not inserted 10G(D) --
Eth1/19 1 eth access down SFP not inserted 10G(D) --
Eth1/20 1 eth access down SFP not inserted 10G(D) --
Eth1/21 1 eth access down SFP not inserted 10G(D) --
Eth1/22 1 eth access down SFP not inserted 10G(D) --
Eth1/23 1 eth access down SFP not inserted 10G(D) --
Eth1/24 1 eth access down SFP not inserted 10G(D) --
Eth1/25 1 eth access down SFP not inserted 10G(D) --
Eth1/26 1 eth access down SFP not inserted 10G(D) --
Eth1/27 1 eth access down SFP not inserted 10G(D) --
Eth1/28 1 eth access down SFP not inserted 10G(D) --
Eth2/1 1 eth access down SFP not inserted 10G(D) --
Eth2/2 1 eth access down SFP not inserted 10G(D) --
Eth2/3 1 eth access down SFP not inserted 10G(D) --
Eth2/4 1 eth access down SFP not inserted 10G(D) --
Eth2/5 1 eth access down SFP not inserted 10G(D) --
Eth2/6 1 eth access down SFP not inserted 10G(D) --
Eth2/7 1 eth access down SFP not inserted 10G(D) --
Eth2/8 1 eth access down SFP not inserted 10G(D) --
Eth2/9 1 eth access down SFP not inserted 10G(D) --
Eth2/10 1 eth access down SFP not inserted 10G(D) --
Eth2/11 1 eth access down SFP not inserted 10G(D) --
Eth2/12 1 eth access down SFP not inserted 10G(D) --
Eth2/13 1 eth access down SFP not inserted 10G(D) --
Eth2/14 1 eth access down SFP not inserted 10G(D) --
Eth2/15 1 eth access down SFP not inserted 10G(D) --
Eth2/16 1 eth access down SFP not inserted 10G(D) --
--------------------------------------------------------------------------------
Port VRF Status IP Address Speed MTU
--------------------------------------------------------------------------------
mgmt0 -- up 172.20.10.82 1000 1500
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status Bind Oper Oper
Mode Trunk Info Mode Speed
Mode (Gbps)
-------------------------------------------------------------------------------
vfc1 100 F on errDisabled Ethernet1/1 --
Primary5548_SW#
Secondary5548_SW# show interface brief
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
-------------------------------------------------------------------------------
fc1/29 101 auto on up swl F 4 --
fc1/30 101 auto on up swl F 4 --
fc1/31 101 auto on up swl F 4 --
fc1/32 101 auto on up swl F 4 --
--------------------------------------------------------------------------------
Ethernet VLAN Type Mode Status Reason Speed Port
Interface Ch #
--------------------------------------------------------------------------------
Eth1/1 1 eth access down Link not connected 10G(D) --
Eth1/2 1 eth access down Link not connected 10G(D) --
Eth1/3 1 eth access down SFP not inserted 10G(D) --
Eth1/4 1 eth access down SFP not inserted 10G(D) --
Eth1/5 1 eth access down SFP not inserted 10G(D) --
Eth1/6 1 eth access down SFP not inserted 10G(D) --
Eth1/7 1 eth access down SFP not inserted 10G(D) --
Eth1/8 1 eth access down SFP not inserted 10G(D) --
Eth1/9 1 eth access down SFP not inserted 10G(D) --
Eth1/10 1 eth access down SFP not inserted 10G(D) --
Eth1/11 1 eth access down SFP not inserted 10G(D) --
Eth1/12 1 eth access down SFP not inserted 10G(D) --
Eth1/13 1 eth access down SFP not inserted 10G(D) --
Eth1/14 1 eth access down SFP not inserted 10G(D) --
Eth1/15 1 eth access down SFP not inserted 10G(D) --
Eth1/16 1 eth access down SFP not inserted 10G(D) --
Eth1/17 1 eth access down SFP not inserted 10G(D) --
Eth1/18 1 eth access down SFP not inserted 10G(D) --
Eth1/19 1 eth access down SFP not inserted 10G(D) --
Eth1/20 1 eth access down SFP not inserted 10G(D) --
Eth1/21 1 eth access down SFP not inserted 10G(D) --
Eth1/22 1 eth access down SFP not inserted 10G(D) --
Eth1/23 1 eth access down SFP not inserted 10G(D) --
Eth1/24 1 eth access down SFP not inserted 10G(D) --
Eth1/25 1 eth access down SFP not inserted 10G(D) --
Eth1/26 1 eth access down SFP not inserted 10G(D) --
Eth1/27 1 eth access down SFP not inserted 10G(D) --
Eth1/28 1 eth access down SFP not inserted 10G(D) --
Eth2/1 1 eth access down SFP not inserted 10G(D) --
Eth2/2 1 eth access down SFP not inserted 10G(D) --
Eth2/3 1 eth access down SFP not inserted 10G(D) --
Eth2/4 1 eth access down SFP not inserted 10G(D) --
Eth2/5 1 eth access down SFP not inserted 10G(D) --
Eth2/6 1 eth access down SFP not inserted 10G(D) --
Eth2/7 1 eth access down SFP not inserted 10G(D) --
Eth2/8 1 eth access down SFP not inserted 10G(D) --
Eth2/9 1 eth access down SFP not inserted 10G(D) --
Eth2/10 1 eth access down SFP not inserted 10G(D) --
Eth2/11 1 eth access down SFP not inserted 10G(D) --
Eth2/12 1 eth access down SFP not inserted 10G(D) --
Eth2/13 1 eth access down SFP not inserted 10G(D) --
Eth2/14 1 eth access down SFP not inserted 10G(D) --
Eth2/15 1 eth access down SFP not inserted 10G(D) --
Eth2/16 1 eth access down SFP not inserted 10G(D) --
--------------------------------------------------------------------------------
Port VRF Status IP Address Speed MTU
--------------------------------------------------------------------------------
mgmt0 -- up 172.20.10.84 1000 1500
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status Bind Oper Oper
Mode Trunk Info Mode Speed
Mode (Gbps)
-------------------------------------------------------------------------------
vfc1 1 F on errDisabled Ethernet1/1 --
Secondary5548_SW#
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide
