Cisco Nexus: Flogi Keep Flapping

[Ismail Shakbodin]

Hi All,

My N5K going down yesterday and cannot bootup. We already replace the hardware with the new hardware.

But after changes, 1 of the solaris box san connectivity keep flapping. the log as below:

2017 May 23 16:59:46 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d logged OUT.
2017 May 23 16:59:46 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (waiting for flogi)  Solaris FCOE SAN Port
2017 May 23 16:59:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (Initializing)  Solaris FCOE SAN Port
2017 May 23 16:59:48 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_IN: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d with FCID 0x160120 log
ged IN.
2017 May 23 16:59:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_UP: %$VSAN 10%$ Interface vfc21, vsan 10 is up  Solaris FCOE SAN Port
2017 May 23 17:02:45 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d logged OUT.
2017 May 23 17:02:45 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (waiting for flogi)  Solaris FCOE SAN Port
2017 May 23 17:02:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (Initializing)  Solaris FCOE SAN Port
2017 May 23 17:02:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_UP: %$VSAN 10%$ Interface vfc21, vsan 10 is up  Solaris FCOE SAN Port
2017 May 23 17:02:48 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_IN: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d with FCID 0x160120 log
ged IN.
2017 May 23 17:03:08 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d logged OUT.
2017 May 23 17:03:08 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (waiting for flogi)  Solaris FCOE SAN Port
2017 May 23 17:03:18 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (Initializing)  Solaris FCOE SAN Port
2017 May 23 17:03:18 MBBKULSPJY100 %PORT-5-IF_TRUNK_UP: %$VSAN 10%$ Interface vfc21, vsan 10 is up  Solaris FCOE SAN Port
2017 May 23 17:03:18 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_IN: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d with FCID 0x160120 log
ged IN.
2017 May 23 17:06:39 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d logged OUT.
2017 May 23 17:06:39 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (waiting for flogi)  Solaris FCOE SAN Port
2017 May 23 17:06:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (Initializing)  Solaris FCOE SAN Port
2017 May 23 17:06:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_UP: %$VSAN 10%$ Interface vfc21, vsan 10 is up  Solaris FCOE SAN Port
2017 May 23 17:06:48 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_IN: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d with FCID 0x160120 log
ged IN.
2017 May 23 17:09:37 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d logged OUT.
2017 May 23 17:09:37 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (waiting for flogi)  Solaris FCOE SAN Port
2017 May 23 17:09:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (Initializing)  Solaris FCOE SAN Port
2017 May 23 17:09:48 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_IN: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d with FCID 0x160120 log
ged IN.
2017 May 23 17:09:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_UP: %$VSAN 10%$ Interface vfc21, vsan 10 is up  Solaris FCOE SAN Port
2017 May 23 17:10:40 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d logged OUT.
2017 May 23 17:10:40 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (waiting for flogi)  Solaris FCOE SAN Port
2017 May 23 17:10:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_DOWN: %$VSAN 10%$ Interface vfc21, vsan 10 is down (Initializing)  Solaris FCOE SAN Port
2017 May 23 17:10:48 MBBKULSPJY100 %FLOGI-5-MSG_PORT_LOGGED_IN: %$VSAN 10%$ [VSAN 10, Interface vfc21: mode[TF]] Nx Port 21:00:00:c0:dd:1a:0d:1d with FCID 0x160120 log
ged IN.
2017 May 23 17:10:48 MBBKULSPJY100 %PORT-5-IF_TRUNK_UP: %$VSAN 10%$ Interface vfc21, vsan 10 is up  Solaris FCOE SAN Port

Any idea on how to find any issue with N5K.

N5K using is C5596UP with NXOS 6.0(2)N2(3)

[Walter Dey]

Hi Ismail

Questions:

- did you restore the configuration ?

- are you using classical FC or FCoE ?

- is the Solaris connecting with classical FC ?

- do you have other Solaris hosts that are working ?

- can you post a layout of the network ? is this UCS based ?

- strange ? why is this a trunk port ? don't think that Solaris can handle a trunk port ?

[Ismail Shakbodin]

Questions:

- did you restore the configuration ?

# yes

- are you using classical FC or FCoE ?

#FCOE

- is the Solaris connecting with classical FC ?

# Nope, connected using FCOE

- do you have other Solaris hosts that are working ?

# Yes

- can you post a layout of the network ? is this UCS based ?

# Dont have the layout currently. Not UCS based.

- strange ? why is this a trunk port ? don't think that Solaris can handle a trunk port ?

# Its proven working.

The issue already resolve by change the SFP. The strange thing, no error on the physical. Just give a try by changing the SFP and the flapping gone.