cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1051
Views
0
Helpful
10
Replies

Fabric Interconnect 6248 & 5548 Connectivity on 4G SFP with FC

Amit Vyas
Level 1
Level 1

Hi,

Recently I came across a scenario when I connected a 4G SFP on Expansion Module of 6248 Fabric Interconnect at one end and at other end 4G SFP on 5548UP. I was unable to establish FC connectivity between both of the devices and the momemt I connected 4G SFP on Fixed Module of 6248 connectivity got established between both the devices

I would like to know do I have to do any changes on FI's Expansion module to get the connectivity working or this kind of behivor is expected behavior

Do let me know if you need any other information on this

Regards,

Amit Vyas

10 Replies 10

Walter Dey
VIP Alumni
VIP Alumni

Did you configure with the slider FC ports on the expansion module (this will require a reset of the module) ?

Yes, I did that then too I was unable to see those port UP in UCSM

I tried changing the ports on expansion module but no luck

-Amit

I assume you can exclude the cable + SFP ? (swapping from expansion module to fixed ports ?)

Is the port type (FC uplink), and VSAN ok ?

Port type is FC uplink and VSAN is also configured same like 5548UP switch. This is applicable to both Fixed and Expansion module ports

If is exclude swapping from expansion to fixed i am unable to establish connection between both devices

-Amit

Did you try another FC port on the expansion module ?

Did you try to reset the expansion module ?

Amit Vyas
Level 1
Level 1

Yes, I tried changing the ports of expansion module from port 3 to 16 which didn't helped me

I haven't reset Expansion module. I can give a try on that on next maintenance window

I am still wondering why expansion module didn't detected 4G SFP module where same SFP got detected on Fixed module?

Should I raise a TAC SR for this ?

-Amit

Sent from Cisco Technical Support Android App

Indeed very strange !

Q. do you have 2 Brocade switches (fabric A and B) or just one ?

Q. are both FI 6248 show the same error

Q. can you connect with SSH to both FI, and post the output of "show interface brief", specially the fc interfaces

Q. do you have 2 Brocade switches (fabric A and B) or just one ?

     A. No both are Cisco Nexus 5548UP Switches

Q. are both FI 6248 show the same error

     A. Yes

Q. can you connect with SSH to both FI, and post the output of "show interface brief", specially the fc interfaces

     A. Following is the output of "show interface brife" command for both 6248

Switch-A(nxos)# show interface brief

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status          SFP    Oper  Oper   Port

                  Mode   Trunk                          Mode  Speed  Channel

                         Mode                                 (Gbps)

-------------------------------------------------------------------------------

fc1/31     100    NP     off     up               swl    NP      4    --

fc1/32     100    NP     off     up               swl    NP      4    --

fc2/13     1      NP     off     sfpAbsent        --     --           --

fc2/14     1      NP     off     sfpAbsent        --     --           --

fc2/15     100    NP     off     sfpAbsent        --     --           --

fc2/16     100    NP     off     sfpAbsent        --     --           --

--------------------------------------------------------------------------------

Ethernet      VLAN   Type Mode   Status  Reason                   Speed     Port

Interface                                                                   Ch #

--------------------------------------------------------------------------------

Eth1/1        1      eth  access down    SFP not inserted            10G(D) --

Eth1/2        1      eth  fabric up      none                        10G(D) --

Eth1/3        1      eth  fabric up      none                        10G(D) --

Eth1/4        1      eth  fabric up      none                        10G(D) --

Eth1/5        1      eth  fabric up      none                        10G(D) --

Eth1/6        1      eth  fabric up      none                        10G(D) --

Eth1/7        1      eth  fabric up      none                        10G(D) --

Eth1/8        1      eth  fabric up      none                        10G(D) --

Eth1/9        1      eth  fabric up      none                        10G(D) --

Eth1/10       1      eth  fabric up      none                        10G(D) --

Eth1/11       1      eth  fabric up      none                        10G(D) --

Eth1/12       1      eth  fabric up      none                        10G(D) --

Eth1/13       1      eth  fabric up      none                        10G(D) --

Eth1/14       1      eth  fabric up      none                        10G(D) --

Eth1/15       1      eth  fabric up      none                        10G(D) --

Eth1/16       1      eth  fabric up      none                        10G(D) --

Eth1/17       1      eth  fabric up      none                        10G(D) --

Eth1/18       1      eth  access down    SFP not inserted            10G(D) --

Eth1/19       1      eth  access down    SFP not inserted            10G(D) --

Eth1/20       1      eth  access down    SFP not inserted            10G(D) --

Eth1/21       1      eth  trunk  up      none                        10G(D) --

Eth1/22       1      eth  trunk  up      none                        10G(D) --

Eth1/23       1      eth  access down    SFP not inserted            10G(D) --

Eth1/24       1      eth  access down    SFP not inserted            10G(D) --

Eth1/25       1      eth  access down    SFP not inserted            10G(D) --

Eth1/26       1      eth  fabric up      none                        10G(D) --

Eth1/27       1      eth  fabric up      none                        10G(D) --

Eth1/28       1      eth  fabric up      none                        10G(D) --

Eth1/29       1      eth  fabric up      none                        10G(D) --

Eth1/30       1      eth  access down    SFP not inserted            10G(D) --

Eth2/1        1      eth  access down    Administratively down       10G(D) --

Eth2/2        1      eth  access down    Administratively down       10G(D) --

Eth2/3        1      eth  access down    SFP not inserted            10G(D) --

Eth2/4        1      eth  access down    SFP not inserted            10G(D) --

Eth2/5        1      eth  access down    SFP not inserted            10G(D) --

Eth2/6        1      eth  access down    SFP not inserted            10G(D) --

Eth2/7        1      eth  access down    SFP not inserted            10G(D) --

Eth2/8        1      eth  access down    SFP not inserted            10G(D) --

Eth2/9        1      eth  access down    SFP not inserted            10G(D) --

Eth2/10       1      eth  access down    SFP not inserted            10G(D) --

Eth2/11       1      eth  access down    SFP not inserted            10G(D) --

Eth2/12       1      eth  access down    SFP not inserted            10G(D) --

Switch-B(nxos)# show interface brief

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status          SFP    Oper  Oper   Port

                  Mode   Trunk                          Mode  Speed  Channel

                         Mode                                 (Gbps)

-------------------------------------------------------------------------------

fc1/31     101    NP     off     up               swl    NP      4    --

fc1/32     101    NP     off     up               swl    NP      4    --

fc2/13     1      NP     off     sfpAbsent        --     --           --

fc2/14     1      NP     off     sfpAbsent        --     --           --

fc2/15     100    NP     off     sfpAbsent        --     --           --

fc2/16     100    NP     off     sfpAbsent        --     --           --

--------------------------------------------------------------------------------

Ethernet      VLAN   Type Mode   Status  Reason                   Speed     Port

Interface                                                                   Ch #

--------------------------------------------------------------------------------

Eth1/1        1      eth  access down    SFP not inserted            10G(D) --

Eth1/2        1      eth  fabric up      none                        10G(D) --

Eth1/3        1      eth  fabric up      none                        10G(D) --

Eth1/4        1      eth  fabric up      none                        10G(D) --

Eth1/5        1      eth  fabric up      none                        10G(D) --

Eth1/6        1      eth  fabric up      none                        10G(D) --

Eth1/7        1      eth  fabric up      none                        10G(D) --

Eth1/8        1      eth  fabric up      none                        10G(D) --

Eth1/9        1      eth  fabric up      none                        10G(D) --

Eth1/10       1      eth  fabric up      none                        10G(D) --

Eth1/11       1      eth  fabric up      none                        10G(D) --

Eth1/12       1      eth  fabric up      none                        10G(D) --

Eth1/13       1      eth  fabric up      none                        10G(D) --

Eth1/14       1      eth  fabric up      none                        10G(D) --

Eth1/15       1      eth  fabric up      none                        10G(D) --

Eth1/16       1      eth  fabric up      none                        10G(D) --

Eth1/17       1      eth  fabric up      none                        10G(D) --

Eth1/18       1      eth  access down    SFP not inserted            10G(D) --

Eth1/19       1      eth  access down    SFP not inserted            10G(D) --

Eth1/20       1      eth  access down    SFP not inserted            10G(D) --

Eth1/21       1      eth  trunk  up      none                        10G(D) --

Eth1/22       1      eth  trunk  up      none                        10G(D) --

Eth1/23       1      eth  access down    SFP not inserted            10G(D) --

Eth1/24       1      eth  access down    SFP not inserted            10G(D) --

Eth1/25       1      eth  access down    SFP not inserted            10G(D) --

Eth1/26       1      eth  fabric up      none                        10G(D) --

Eth1/27       1      eth  fabric up      none                        10G(D) --

Eth1/28       1      eth  fabric up      none                        10G(D) --

Eth1/29       1      eth  fabric up      none                        10G(D) --

Eth1/30       1      eth  access down    SFP not inserted            10G(D) --

Eth2/1        1      eth  access down    SFP not inserted            10G(D) --

Eth2/2        1      eth  access down    SFP not inserted            10G(D) --

Eth2/3        1      eth  access down    SFP not inserted            10G(D) --

Eth2/4        1      eth  access down    SFP not inserted            10G(D) --

Eth2/5        1      eth  access down    Administratively down       10G(D) --

Eth2/6        1      eth  access down    Administratively down       10G(D) --

Eth2/7        1      eth  access down    SFP not inserted            10G(D) --

Eth2/8        1      eth  access down    SFP not inserted            10G(D) --

Eth2/9        1      eth  access down    SFP not inserted            10G(D) --

Eth2/10       1      eth  access down    SFP not inserted            10G(D) --

Eth2/11       1      eth  access down    SFP not inserted            10G(D) --

Eth2/12       1      eth  access down    SFP not inserted            10G(D) --

ok, you have ports 31 and 32 on the fixed module, and ports 13-16 on the expansion module configured as FC.

how does the same command look on the 5548 ?

On FI-B, ports 15-16 are in Vsan 100, should probably be 101 ?

Can you insert the 4G SFP, and do a show interface brief ? check that SFP is discovered, typ=swl

Q. are you migrating the fc ports from the fixed to the expansion module ?

Is my understanding correct, that you have 2 links from each FI to a 5548, no port fc port-channel ?

if this is the case, best practise would be to define a fc port-channel (trunking port channel)

Yes, On FI-B port 15-16 should be in VSAN 101 instead of 100, I have made that correction

Q. are you migrating the fc ports from the fixed to the expansion module ?

     A: As off now I am not migrating FC port but in near future I have to migrate FC ports to Expansion module and I don't want to waste my time for troubleshooting at that time.

Is my understanding correct, that you have 2 links from each FI to a 5548, no port fc port-channel ?

     A: Yes, your understanding is correct we have 2 links from each FI to 5548 and no FC port-channel is configured

I will do the FC port-channel later on once I am able to fix the connectivity issue

I will try to put 4G SFP on expansion module and will provide you output of "show interface brife"

Following is the out of "show interface brife" from both 5548UP switches

Primary5548_SW# show interface brief

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status          SFP    Oper  Oper   Port

                  Mode   Trunk                          Mode  Speed  Channel

                         Mode                                 (Gbps)

-------------------------------------------------------------------------------

fc1/29     100    auto   on      up               swl    F       4    --

fc1/30     100    auto   on      up               swl    F       4    --

fc1/31     100    auto   on      up               swl    F       4    --

fc1/32     100    auto   on      up               swl    F       4    --

--------------------------------------------------------------------------------

Ethernet      VLAN    Type Mode   Status  Reason                   Speed     Port

Interface                                                                    Ch #

--------------------------------------------------------------------------------

Eth1/1        1       eth  access down    Link not connected          10G(D) --

Eth1/2        1       eth  access down    Link not connected          10G(D) --

Eth1/3        1       eth  access down    SFP not inserted            10G(D) --

Eth1/4        1       eth  access down    SFP not inserted            10G(D) --

Eth1/5        1       eth  access down    SFP not inserted            10G(D) --

Eth1/6        1       eth  access down    SFP not inserted            10G(D) --

Eth1/7        1       eth  access down    SFP not inserted            10G(D) --

Eth1/8        1       eth  access down    SFP not inserted            10G(D) --

Eth1/9        1       eth  access down    SFP not inserted            10G(D) --

Eth1/10       1       eth  access down    SFP not inserted            10G(D) --

Eth1/11       1       eth  access down    SFP not inserted            10G(D) --

Eth1/12       1       eth  access down    SFP not inserted            10G(D) --

Eth1/13       1       eth  access down    SFP not inserted            10G(D) --

Eth1/14       1       eth  access down    SFP not inserted            10G(D) --

Eth1/15       1       eth  access down    SFP not inserted            10G(D) --

Eth1/16       1       eth  access down    SFP not inserted            10G(D) --

Eth1/17       1       eth  access down    SFP not inserted            10G(D) --

Eth1/18       1       eth  access down    SFP not inserted            10G(D) --

Eth1/19       1       eth  access down    SFP not inserted            10G(D) --

Eth1/20       1       eth  access down    SFP not inserted            10G(D) --

Eth1/21       1       eth  access down    SFP not inserted            10G(D) --

Eth1/22       1       eth  access down    SFP not inserted            10G(D) --

Eth1/23       1       eth  access down    SFP not inserted            10G(D) --

Eth1/24       1       eth  access down    SFP not inserted            10G(D) --

Eth1/25       1       eth  access down    SFP not inserted            10G(D) --

Eth1/26       1       eth  access down    SFP not inserted            10G(D) --

Eth1/27       1       eth  access down    SFP not inserted            10G(D) --

Eth1/28       1       eth  access down    SFP not inserted            10G(D) --

Eth2/1        1       eth  access down    SFP not inserted            10G(D) --

Eth2/2        1       eth  access down    SFP not inserted            10G(D) --

Eth2/3        1       eth  access down    SFP not inserted            10G(D) --

Eth2/4        1       eth  access down    SFP not inserted            10G(D) --

Eth2/5        1       eth  access down    SFP not inserted            10G(D) --

Eth2/6        1       eth  access down    SFP not inserted            10G(D) --

Eth2/7        1       eth  access down    SFP not inserted            10G(D) --

Eth2/8        1       eth  access down    SFP not inserted            10G(D) --

Eth2/9        1       eth  access down    SFP not inserted            10G(D) --

Eth2/10       1       eth  access down    SFP not inserted            10G(D) --

Eth2/11       1       eth  access down    SFP not inserted            10G(D) --

Eth2/12       1       eth  access down    SFP not inserted            10G(D) --

Eth2/13       1       eth  access down    SFP not inserted            10G(D) --

Eth2/14       1       eth  access down    SFP not inserted            10G(D) --

Eth2/15       1       eth  access down    SFP not inserted            10G(D) --

Eth2/16       1       eth  access down    SFP not inserted            10G(D) --

--------------------------------------------------------------------------------

Port   VRF          Status IP Address                              Speed    MTU

--------------------------------------------------------------------------------

mgmt0  --           up     172.20.10.82                            1000     1500

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status      Bind                 Oper    Oper

                  Mode   Trunk               Info                 Mode    Speed

                         Mode                                            (Gbps)

-------------------------------------------------------------------------------

vfc1       100    F     on     errDisabled Ethernet1/1              --

Primary5548_SW#

Secondary5548_SW# show interface brief

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status          SFP    Oper  Oper   Port

                  Mode   Trunk                          Mode  Speed  Channel

                         Mode                                 (Gbps)

-------------------------------------------------------------------------------

fc1/29     101    auto   on      up               swl    F       4    --

fc1/30     101    auto   on      up               swl    F       4    --

fc1/31     101    auto   on      up               swl    F       4    --

fc1/32     101    auto   on      up               swl    F       4    --

--------------------------------------------------------------------------------

Ethernet      VLAN    Type Mode   Status  Reason                   Speed     Port

Interface                                                                    Ch #

--------------------------------------------------------------------------------

Eth1/1        1       eth  access down    Link not connected          10G(D) --

Eth1/2        1       eth  access down    Link not connected          10G(D) --

Eth1/3        1       eth  access down    SFP not inserted            10G(D) --

Eth1/4        1       eth  access down    SFP not inserted            10G(D) --

Eth1/5        1       eth  access down    SFP not inserted            10G(D) --

Eth1/6        1       eth  access down    SFP not inserted            10G(D) --

Eth1/7        1       eth  access down    SFP not inserted            10G(D) --

Eth1/8        1       eth  access down    SFP not inserted            10G(D) --

Eth1/9        1       eth  access down    SFP not inserted            10G(D) --

Eth1/10       1       eth  access down    SFP not inserted            10G(D) --

Eth1/11       1       eth  access down    SFP not inserted            10G(D) --

Eth1/12       1       eth  access down    SFP not inserted            10G(D) --

Eth1/13       1       eth  access down    SFP not inserted            10G(D) --

Eth1/14       1       eth  access down    SFP not inserted            10G(D) --

Eth1/15       1       eth  access down    SFP not inserted            10G(D) --

Eth1/16       1       eth  access down    SFP not inserted            10G(D) --

Eth1/17       1       eth  access down    SFP not inserted            10G(D) --

Eth1/18       1       eth  access down    SFP not inserted            10G(D) --

Eth1/19       1       eth  access down    SFP not inserted            10G(D) --

Eth1/20       1       eth  access down    SFP not inserted            10G(D) --

Eth1/21       1       eth  access down    SFP not inserted            10G(D) --

Eth1/22       1       eth  access down    SFP not inserted            10G(D) --

Eth1/23       1       eth  access down    SFP not inserted            10G(D) --

Eth1/24       1       eth  access down    SFP not inserted            10G(D) --

Eth1/25       1       eth  access down    SFP not inserted            10G(D) --

Eth1/26       1       eth  access down    SFP not inserted            10G(D) --

Eth1/27       1       eth  access down    SFP not inserted            10G(D) --

Eth1/28       1       eth  access down    SFP not inserted            10G(D) --

Eth2/1        1       eth  access down    SFP not inserted            10G(D) --

Eth2/2        1       eth  access down    SFP not inserted            10G(D) --

Eth2/3        1       eth  access down    SFP not inserted            10G(D) --

Eth2/4        1       eth  access down    SFP not inserted            10G(D) --

Eth2/5        1       eth  access down    SFP not inserted            10G(D) --

Eth2/6        1       eth  access down    SFP not inserted            10G(D) --

Eth2/7        1       eth  access down    SFP not inserted            10G(D) --

Eth2/8        1       eth  access down    SFP not inserted            10G(D) --

Eth2/9        1       eth  access down    SFP not inserted            10G(D) --

Eth2/10       1       eth  access down    SFP not inserted            10G(D) --

Eth2/11       1       eth  access down    SFP not inserted            10G(D) --

Eth2/12       1       eth  access down    SFP not inserted            10G(D) --

Eth2/13       1       eth  access down    SFP not inserted            10G(D) --

Eth2/14       1       eth  access down    SFP not inserted            10G(D) --

Eth2/15       1       eth  access down    SFP not inserted            10G(D) --

Eth2/16       1       eth  access down    SFP not inserted            10G(D) --

--------------------------------------------------------------------------------

Port   VRF          Status IP Address                              Speed    MTU

--------------------------------------------------------------------------------

mgmt0  --           up     172.20.10.84                            1000     1500

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status      Bind                 Oper    Oper

                  Mode   Trunk               Info                 Mode    Speed

                         Mode                                            (Gbps)

-------------------------------------------------------------------------------

vfc1       1      F     on     errDisabled Ethernet1/1              --

Secondary5548_SW#

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: