No FLOGI on nexus 5020 switch - UCS C200 M1/P81E

giyoon · ‎05-14-2013

[update]

issue has been resolved.

switch# show flogi database

--------------------------------------------------------------------------------

INTERFACE VSAN FCID PORT NAME NODE NAME

--------------------------------------------------------------------------------

vfc1 1 0x8c0000 20:00:54:78:1a:86:f2:99 10:00:54:78:1a:86:f2:99

Total number of flogi = 1.

switch#

The problem was not setting the correct vlan id for the HBA in the CMIC.

I refered this link which has instruction on how to set the vlan in UCS C2000 via ssh.

https://supportforums.cisco.com/thread/2148788

-----------------------------------------------------------------------------------------------------------------------------

Hi,

I have been trying to get FCOE work with UCS C200 with P81E card, but I am not able to get flogi on the 5k.

Topology

UCS C200 (P81E) ------SFP+---------(E1/1)5020(fc2/1)-----(fc1/5)MDS(fc1/1)----------JBOD

I am running vmware build 469512 (that supports Cisco VIC) and CIMC is upgraded to the 1.4(3s).

ESXi does see the Cisco FCOE HBAs (two of them), so I am sure that the I am running correct vmware esxi version.

switch# show flogi database

No flogi sessions found.

switch#

- Also this is what I can see form the adaptor 1 of c200.

ucs-c200-m2 /chassis # show adapter 1 detail

PCI Slot 1:

Product Name: UCS VIC P81E

Serial Number: QCI1652A090

Product ID: N2XX-ACPCI01

Adapter Hardware Revision: 4

Current FW Version: 2.1(1a)

NIV: Disabled

FIP: Enabled

Configuration Pending: yes

CIMC Management Enabled : no

VID: V01

Vendor: Cisco Systems Inc

Description:

FW Image 1 Version: 2.1(1a)

FW Image 1 State: RUNNING ACTIVATED

FW Image 2 Version: 2.1(1a)

FW Image 2 State: BACKUP INACTIVATED

FW Update Status: Idle

FW Update Error: No error

FW Update Stage: No operation (0%)

FW Update Overall Progress: 0%

ucs-c200-m2 /chassis #

- 5k side info

switch# show int vfc 1

vfc1 is trunking

Bound interface is Ethernet1/1

Hardware is Ethernet

Port WWN is 20:00:00:0d:ec:b2:68:ff

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port mode is TF

Port vsan is 1

Trunk vsans (admin allowed and active) (1)

Trunk vsans (up) ()

Trunk vsans (isolated) ()

Trunk vsans (initializing) (1)

1 minute input rate 280 bits/sec, 35 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

12534 frames input, 2306256 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters Tue May 14 02:08:04 2013

Interface last changed at Tue May 14 02:36:07 2013

switch#

switch# show run

!Command: show running-config

!Time: Tue May 14 16:15:05 2013

version 5.2(1)N1(4)

feature fcoe

hostname switch

feature telnet

feature interface-vlan

feature lldp

role name default-role

description This is a system defined role and applies to all users.

username admin password 5 $1$22mjeUy/$M6wkiN5z67OpI.dJGVH9x. role network-admin

no password strength-check

banner motd #Nexus 5000 Switch

#

ip domain-lookup

ip host switch 172.27.168.194

class-map type qos class-fcoe

class-map type queuing class-all-flood

match qos-group 2

class-map type queuing class-ip-multicast

match qos-group 2

class-map type network-qos class-all-flood

match qos-group 2

class-map type network-qos class-ip-multicast

match qos-group 2

snmp-server user admin network-admin auth md5 0x87b2e87d3b4a91b8348655d178796ca9

priv 0x87b2e87d3b4a91b8348655d178796ca9 localizedkey

vrf context management

ip route 0.0.0.0/0 172.27.126.1

ip route 0.0.0.0/0 172.27.168.129

vlan configuration 1,1000

vlan 1,1000

vlan 1001

fcoe vsan 1

port-profile default max-ports 512

interface Vlan1

no shutdown

interface Vlan1001

no shutdown

interface vfc1

bind interface Ethernet1/1

no shutdown

interface fc2/1

no shutdown

interface fc2/2

interface fc2/3

interface fc2/4

interface Ethernet1/1

switchport mode trunk

switchport trunk allowed vlan 1,1001

spanning-tree port type edge trunk

interface Ethernet1/2

interface Ethernet1/3

interface Ethernet1/4

interface Ethernet1/5

interface Ethernet1/6

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

interface Ethernet1/16

interface Ethernet1/17

interface Ethernet1/18

interface Ethernet1/19

interface Ethernet1/20

interface Ethernet1/21

interface Ethernet1/22

interface Ethernet1/23

interface Ethernet1/24

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30

interface Ethernet1/31

interface Ethernet1/32

interface Ethernet1/33

interface Ethernet1/34

interface Ethernet1/35

interface Ethernet1/36

interface Ethernet1/37

interface Ethernet1/38

interface Ethernet1/39

interface Ethernet1/40

interface Ethernet2/1

switchport trunk allowed vlan 1001

interface Ethernet2/2

interface Ethernet2/3

interface Ethernet2/4

interface mgmt0

ip address 172.27.168.194/25

line console

line vty

boot kickstart bootflash:/n5000-uk9-kickstart.5.2.1.N1.4.bin

boot system bootflash:/n5000-uk9.5.2.1.N1.4.bin

interface fc2/1

interface fc2/2

interface fc2/3

interface fc2/4

!Full Zone Database Section for vsan 1

zone name DC-ZONE vsan 1

member pwwn 50:00:40:20:02:f4:1a:98

member pwwn 21:00:00:e0:8b:19:42:58

zoneset name DC-ZONESET vsan 1

member DC-ZONE

zoneset activate name DC-ZONESET vsan 1

switch#

switch# show int e1/1

Ethernet1/1 is up

Dedicated Interface

Hardware: 1000/10000 Ethernet, address: 000d.ecb2.68c8 (bia 000d.ecb2.68c8)

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 13:39:41

Last clearing of "show interface" counters never

30 seconds input rate 288 bits/sec, 0 packets/sec

30 seconds output rate 632 bits/sec, 1 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 208 bps, 0 pps; output rate 416 bps, 0 pps

RX

12553 unicast packets 1702 multicast packets 0 broadcast packets

14255 input packets 2496880 bytes

0 jumbo packets 0 storm suppression packets

0 runts 0 giants 0 CRC 0 no buffer

0 input error 0 short frame 0 overrun 0 underrun 0 ignored

0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 59994 multicast packets 0 broadcast packets

59994 output packets 4672305 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble 0 output discard

0 Tx pause

2 interface resets

switch#

switch# show lldp neighbors

Capability codes:

(R) Router, (B) Bridge, (T) Telephone, (C) DOCSIS Cable Device

(W) WLAN Access Point, (P) Repeater, (S) Station, (O) Other

Device ID Local Intf Hold-time Capability Port ID

5478.1a86.f294 Eth1/1 120 5478.1a86.f294

Total entries displayed: 1

switch#

Thank you for any pointers in this regard.

Giyoung.

--- added more debug on n5k side

switch# show system internal dcbx info interface e1/1

Interface info for if_index: 0x1a000000(Eth1/1)

tx_enabled: TRUE

rx_enabled: TRUE

dcbx_enabled: TRUE

DCX Protocol: CEE

DCX CEE NIV extension: disabled

Port MAC address: 00:0d:ec:b2:68:c8

DCX Control FSM Variables: seq_no: 0x1, ack_no: 0x1,my_ack_no: 0x1, peer_seq_no:

0x1 oper_version: 0x0, max_version: 0x0 fast_retries 0x0

Lock Status: UNLOCKED

PORT STATE: UP

LLDP Neighbors

Remote Peers Information on interface Eth1/1

Remote peer's MSAP: length 12 Bytes:

54 78 1a 86 f2 94 54 78 1a 86 f2 94

LLDP TLV's

LLDP TLV type:Chassis ID LLDP TLV Length: 7

04 54 78 1a 86 f2 94

Chassis type: 04 Chassis ID:54 78 1a 86 f2 94

LLDP TLV type:Port ID LLDP TLV Length: 7

03 54 78 1a 86 f2 94

Port ID subtype: 03 Port ID:54 78 1a 86 f2 94

LLDP TLV type:Time to Live LLDP TLV Length: 2

00 78

TTL = 00

LLDP TLV type:LLDP Organizationally Specific LLDP TLV Length: 55

00 1b 21 02 02 0a 00 00 00 00 00 01 00 00 00 01 08 0a 00 00

c0 00 89 06 00 1b 21 08 06 06 00 00 c0 00 ff 08 04 11 00 00

c0 00 ff ff ff ff 00 00 00 00 00 00 00 00 08

LLDP TLV type:LLDP Organizationally Specific LLDP TLV Length: 5

00 01 42 01 01

LLDP TLV type:END of LLDP PDU LLDP TLV Length: 0

Peer's DCX TLV:

DCBX TLV Proto(1) type: 1(Control) DCBX TLV Length: 10 DCBX TLV Value

00 00 01 00 00 00 01 00 00 00

sub_type 0, error 0, willing 0, enable 0, max_version 0, oper_version 0

DCBX TLV Proto(1) type: 4(App) DCBX TLV Length: 10 DCBX TLV Value

00 00 c0 00 89 06 00 1b 21 08

sub_type 0, error 0, willing 1, enable 1, max_version 0, oper_version 0

DCBX TLV Proto(1) type: 3(PFC) DCBX TLV Length: 6 DCBX TLV Value

00 00 c0 00 ff 08

sub_type 0, error 0, willing 1, enable 1, max_version 0, oper_version 0

DCBX TLV Proto(1) type: 2(PriGrp) DCBX TLV Length: 17 DCBX TLV Value

00 00 c0 00 ff ff ff ff 00 00 00 00 00 00 00 00 08

sub_type 0, error 0, willing 1, enable 1, max_version 0, oper_version 0

6 Features on this intf for Protocol DCX CIN(0)

Feature type LLS (6)sub_type FCoE Logical Link Status (0)

feature type 6(DCX CIN-LLS)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0

feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 0

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x1d9

Desired config cfg length: 1 data bytes:00

Operating config cfg length: 0 data bytes:

Peer config cfg length: 0 data bytes:

Feature type PFC (3)

feature type 3(DCX CIN-PFC)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0

feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 1 data bytes:08

Operating config cfg length: 0 data bytes:

Peer config cfg length: 0 data bytes:

Feature type App (5)sub_type FCoE iSCSI (0)

feature type 5(DCX CIN-App)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0

feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 1 data bytes:08

Operating config cfg length: 0 data bytes:

Peer config cfg length: 0 data bytes:

Feature type PriMtu (8)

feature type 8(DCX CIN-PriMtu)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0

feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 16 data bytes:05 dc 05 dc 05 dc 08

6e 05 dc 05 dc 05 dc 05 dc

Operating config cfg length: 0 data bytes:

Peer config cfg length: 0 data bytes:

Feature type PriGrp (2)

feature type 2(DCX CIN-PriGrp)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0

feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 24 data bytes:32 32 00 00 00 00 00

00 00 0f 00 0f 00 0e 20 64 00 0e 00 0e

00 0e 00 0e

Operating config cfg length: 0 data bytes:

Peer config cfg length: 0 data bytes:

Feature type LLS (6)sub_type LAN Logical Link Status (1)

feature type 6(DCX CIN-LLS)sub_type 1

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0

feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0xaf

Desired config cfg length: 1 data bytes:80

Operating config cfg length: 0 data bytes:

Peer config cfg length: 0 data bytes:

3 Features on this intf for Protocol DCX CEE(1)

Feature type PFC (3)

feature type 3(DCX CEE-PFC)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 1

feature_seq_no 0 remote_feature_tlv_present 1 remote_tlv_aged_out 0

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 2 data bytes:08 08

Operating config cfg length: 2 data bytes:08 08

Peer config cfg length: 0 data bytes:

Feature type App (4)sub_type FCoE iSCSI (0)

feature type 4(DCX CEE-App)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 1

feature_seq_no 0 remote_feature_tlv_present 1 remote_tlv_aged_out 0

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 6 data bytes:89 06 00 1b 21 08

Operating config cfg length: 6 data bytes:89 06 00 1b 21 08

Peer config cfg length: 0 data bytes:

Feature type PriGrp (2)

feature type 2(DCX CEE-PriGrp)sub_type 0

Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 1

feature_seq_no 0 remote_feature_tlv_present 1 remote_tlv_aged_out 0

remote_tlv_not_present_notification_sent 0

Feature Register Params: max_version 0, enable 1, willing 0 advertise 1

disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 13 data bytes:00 01 00 00 32 32 00

00 00 00 00 00 02

Operating config cfg length: 13 data bytes:00 01 00 00 32 32 0

0 00 00 00 00 00 02

Peer config cfg length: 0 data bytes:

Features on this intf for LLDP

lldp feature type 2(PriMtu)sub_type 0

lldp feature register params max_version 0, enable 1, willing 0 advertise 1, dis

ruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179

Desired config cfg length: 16 data bytes:05 dc 05 dc 05 dc 08

6e 05 dc 05 dc 05 dc 05 dc

Peer config cfg length: 0 data bytes:

lldp feature type 1(LLS)sub_type 1

lldp feature register params max_version 0, enable 1, willing 0 advertise 1, dis

ruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0xaf

Desired config cfg length: 1 data bytes:01

Peer config cfg length: 1 data bytes:01

Traffic Counters

DCBX pkt stats:

Total frames out: 2305

Total Entries aged: 9

Total frames in: 2295

DCBX frames in: 2295

Total frames received in error: 0

Total frames discarded: 0

Total TLVs unrecognized: 0

switch#