Nexus 56720 stucks on Waiting for flogi

[CoolMAK]

Hi,

I have two nexus 5672UPs and two HP c7000 chassis each on containing x5 BL460 G9cblades using B22HP FEX. On blade servers I used HP 536FLB CNAs. the problem I am facing here is that only 5 of them can register in Nexus 5672. all the configuration for interfaces are exactly the same, but the first 5 blade server FCoE connection comes up, the other five stuck on (Waiting for flogi).

I have checked the FCoE parameters of all CNAs in BIOS settings, they are all using the same version of ESXi (6.5 U1).

here is the configuration for my interfaces 1 and 10 (1 works fine, 10 never comes up)

!Command: show running-config interface Ethernet101/1/1, Ethernet101/1/10
!Time: Wed Feb 14

version 7.3(0)N1(1)

interface Ethernet101/1/1
switchport mode trunk
spanning-tree port type edge
channel-group 1001
no shutdown

interface Ethernet101/1/10
switchport mode trunk
spanning-tree port type edge
channel-group 1010
no shutdown

!Command: show running-config interface port-channel1001, port-channel1010
!Time: Wed Feb 14

version 7.3(0)N1(1)

interface port-channel1001
switchport mode trunk
vpc 1001

interface port-channel1010
switchport mode trunk
vpc 1010

!Command: show running-config interface vfc1001, vfc1010
!Time: Wed Feb 14

version 7.3(0)N1(1)

interface vfc1001
bind interface port-channel1001
no shutdown

interface vfc1010
bind interface port-channel1010
no shutdown

vfc1001 is trunking
Bound interface is port-channel1001
Hardware is Ethernet
Port WWN is 23:e8:00:de:fb:ac:52:7f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 10
Trunk vsans (admin allowed and active) (10)
Trunk vsans (up) (10)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 6656 bits/sec, 832 bytes/sec, 1 frames/sec
1 minute output rate 960 bits/sec, 120 bytes/sec, 1 frames/sec
14404919 frames input, 27996462532 bytes
0 discards, 0 errors
6285160 frames output, 8022383644 bytes
0 discards, 0 errors
last clearing of "show interface" counters Tue Feb 13 17:37:34 2018

Interface last changed at Tue Feb 13 17:37:34 2018

vfc1010 is trunking
Bound interface is port-channel1010
Hardware is Ethernet
Port WWN is 23:f1:00:de:fb:ac:52:7f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 10
Trunk vsans (admin allowed and active) (10)
Trunk vsans (up) ()
Trunk vsans (isolated) ()
Trunk vsans (initializing) (10)
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
0 frames input, 0 bytes
0 discards, 0 errors
0 frames output, 0 bytes
0 discards, 0 errors
last clearing of "show interface" counters Wed Feb 14

I can use some help on this issue.

Thanx

[Rick1776]

Could you send the output from the "show flogi database" as well as the "show vsan membership"

[Rick1776]

Also make sure that the host on the port is configured for VSAN 10. I've seen in in the past where VSAN 10 wasn't configured on the host and it would stay stuck initializing.

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5000/sw/troubleshooting/guide/N5K_Troubleshooting_Guide/n5K_ts_sans.html

Here is an excerpt from the link I included above
If no downstream devices are logged in for a particular VSAN, that VSAN stays in initializing state.

[CoolMAK]

Thanx a lot, it just helped me to realize, maybe the hosts are the problem, which they were. FCoE is not enabled on HP 536FLB by default, and I have manually enabled them on first 5 ESXis but not on the second chassis. I updated the driver and enabled the FCoE on all FLB nics and now the problem is solved. 

here is a link on how to enable the FCoE in ESXi:
https://esxsi.com/2017/07/29/esxi65-missing-fcoe/

[Rick1776]

Awesome news. Glad I was able to help.

Can you marked as solved so no one else will try to work on the case and they can look up the solution.