Solved: Re: Nexus 5596 Port FC is UP/DOWN - Page 2

carmijo · ‎04-02-2018

Hi everyone.

I have a two nexus 5596 with unified port, I am using NPIV and FCOE, the VFC ports work correctly, however when you want to use the FC ports, they remain infinitely UP / DOWN.

2018 Apr 2 14:21:46 Nexus1 last message repeated 1 time
2018 Apr 2 14:21:46 Nexus1 %PORT-5-IF_UP: %$VSAN 200%$ Interface fc4/12 is up in mode F
2018 Apr 2 14:21:50 Nexus1 %PORT-5-IF_DOWN_OLS_RCVD: %$VSAN 200%$ Interface fc4/12 is down (OLS received)
2018 Apr 2 14:21:51 Nexus1 last message repeated 1 time
2018 Apr 2 14:21:51 Nexus1 %PORT-5-IF_UP: %$VSAN 200%$ Interface fc4/12 is up in mode F
2018 Apr 2 14:21:55 Nexus1 %PORT-5-IF_DOWN_OLS_RCVD: %$VSAN 200%$ Interface fc4/12 is down (OLS received)
2018 Apr 2 14:21:55 Nexus1 last message repeated 1 time
2018 Apr 2 14:21:55 Nexus1 %PORT-5-IF_UP: %$VSAN 200%$ Interface fc4/12 is up in mode F
2018 Apr 2 14:21:59 Nexus1 %PORT-5-IF_DOWN_OLS_RCVD: %$VSAN 200%$ Interface fc4/12 is down (OLS received)
2018 Apr 2 14:21:59 Nexus1 last message repeated 1 time
2018 Apr 2 14:21:59 Nexus1 %PORT-5-IF_UP: %$VSAN 200%$ Interface fc4/12 is up in mode F
2018 Apr 2 14:22:03 Nexus1 %PORT-5-IF_DOWN_OLS_RCVD: %$VSAN 200%$ Interface fc4/12 is down (OLS received)

when I check through a show flogi database, I can see the ID but after a moment it goes away

Nexus1# sh flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc4/12 200 0x0d00c0 21:00:00:24:ff:19:ae:46 20:00:00:24:ff:19:ae:46
fc4/13 200 0x0d00a0 50:01:43:80:27:2c:2d:c2 50:01:43:80:27:2c:2d:c1
fc4/14 200 0x0d0080 50:01:43:80:27:2c:2d:c5 50:01:43:80:27:2c:2d:c4
vfc43 200 0x0d0020 20:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc44 200 0x0d0000 21:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc45 200 0x0d0060 22:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc46 200 0x0d0040 23:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc4142 200 0x0d0100 50:06:0b:00:00:c3:5e:04 50:06:0b:00:00:c3:5e:05
vfc4142 200 0x0d0200 50:06:0b:00:00:c3:5e:0c 50:06:0b:00:00:c3:5e:0d
vfc4142 200 0x0d0300 50:06:0b:00:00:c3:5e:1c 50:06:0b:00:00:c3:5e:1d
vfc4142 200 0x0d0400 50:06:0b:00:00:c3:5e:14 50:06:0b:00:00:c3:5e:15
vfc4142 200 0x0d0500 50:06:0b:00:00:c3:5e:24 50:06:0b:00:00:c3:5e:25
vfc4142 200 0x0d0600 50:06:0b:00:00:c3:5e:2c 50:06:0b:00:00:c3:5e:2d

Total number of flogi = 13.

Nexus1# sh flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc4/12 200 0x0d00c0 21:00:00:24:ff:19:ae:46 20:00:00:24:ff:19:ae:46
fc4/14 200 0x0d0080 50:01:43:80:27:2c:2d:c5 50:01:43:80:27:2c:2d:c4
vfc43 200 0x0d0020 20:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc44 200 0x0d0000 21:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc45 200 0x0d0060 22:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc46 200 0x0d0040 23:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc4142 200 0x0d0100 50:06:0b:00:00:c3:5e:04 50:06:0b:00:00:c3:5e:05
vfc4142 200 0x0d0200 50:06:0b:00:00:c3:5e:0c 50:06:0b:00:00:c3:5e:0d
vfc4142 200 0x0d0300 50:06:0b:00:00:c3:5e:1c 50:06:0b:00:00:c3:5e:1d
vfc4142 200 0x0d0400 50:06:0b:00:00:c3:5e:14 50:06:0b:00:00:c3:5e:15
vfc4142 200 0x0d0500 50:06:0b:00:00:c3:5e:24 50:06:0b:00:00:c3:5e:25
vfc4142 200 0x0d0600 50:06:0b:00:00:c3:5e:2c 50:06:0b:00:00:c3:5e:2d

Total number of flogi = 12.

Nexus1# 2018 Apr 2 14:29:46 Nexus1 %PORT-5-IF_DOWN_OLS_RCVD: %$VSAN 200%$ Interface fc4/13 is down (OLS received)
2018 Apr 2 14:29:47 Nexus1 last message repeated 1 time
2018 Apr 2 14:29:47 Nexus1 %PORT-5-IF_DOWN_OLS_RCVD: %$VSAN 200%$ Interface fc4/14 is down (OLS received)
Nexus1# sh flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
fc4/12 200 0x0d00c0 21:00:00:24:ff:19:ae:46 20:00:00:24:ff:19:ae:46
vfc43 200 0x0d0020 20:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc44 200 0x0d0000 21:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc45 200 0x0d0060 22:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc46 200 0x0d0040 23:21:00:02:ac:01:f9:fb 2f:f7:00:02:ac:01:f9:fb
vfc4142 200 0x0d0100 50:06:0b:00:00:c3:5e:04 50:06:0b:00:00:c3:5e:05
vfc4142 200 0x0d0200 50:06:0b:00:00:c3:5e:0c 50:06:0b:00:00:c3:5e:0d
vfc4142 200 0x0d0300 50:06:0b:00:00:c3:5e:1c 50:06:0b:00:00:c3:5e:1d
vfc4142 200 0x0d0400 50:06:0b:00:00:c3:5e:14 50:06:0b:00:00:c3:5e:15
vfc4142 200 0x0d0500 50:06:0b:00:00:c3:5e:24 50:06:0b:00:00:c3:5e:25
vfc4142 200 0x0d0600 50:06:0b:00:00:c3:5e:2c 50:06:0b:00:00:c3:5e:2d

Total number of flogi = 11.

Thanks

some idea what could be happening

calopez2 · ‎04-02-2018

Can you open a TAC case?

They can look at your topology/solution in detail.

calopez2 · ‎04-02-2018

Also, if you are trying to connect 2 N5Ks via FC ports together then use Mode Port E and use trunking.

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5000/sw/san_switching/b_Cisco_Nexus_5000_Series_NX-OS_SAN_Switching_Configuration_Guide/configuring_fibre_channel_interfaces.html

Walter Dey · ‎04-03-2018

I don't understand your situation

- classical FC and FCoE are 2 different Things, you talk about fc x/y ports, has nothing to do with FCoE

- what do you connect to your F-Port on the 5596 ? a FC host, or a NPV switch ? or another FC switch ?

carmijo · ‎04-03-2018

Dear Walter:

- It is correct that things are very different, I just want to say that what goes with FCoE works well.

-I have connected all FC and FCOE hosts to the same Nexus switches, my problem is with FC host (Tape Library and backup Equipment), the interfaces are in state "error disable" after a few minutes.

- I'm not using other FC or NPV switches

Thank you.

Walter Dey · ‎04-03-2018

Q. could it be that the tape library has a Loop port (NL), and therefore the MDS requires a FL port ?

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/mds9000/sw/4_1/configuration/guides/cli_4_1/clibook/intf.html#82842

carmijo · ‎04-03-2018

Hi, the configuration for the tape is mode Fabric.

thanks.

Walter Dey · ‎04-03-2018

additional questions

- are there FC hosts that work ok ?

- are only the FC tape libraries causing the Problems ?

- can you do a "show interfaces status err-disabled"

- is the tape library on the interop matrix ?

carmijo · ‎04-04-2018

Finally we solved the problem by making a software update to the latest version. thanks to all.