05-14-2013 09:24 AM - edited 03-01-2019 11:01 AM
[update]
issue has been resolved.
switch# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
vfc1 1 0x8c0000 20:00:54:78:1a:86:f2:99 10:00:54:78:1a:86:f2:99
Total number of flogi = 1.
switch#
The problem was not setting the correct vlan id for the HBA in the CMIC.
I refered this link which has instruction on how to set the vlan in UCS C2000 via ssh.
https://supportforums.cisco.com/thread/2148788
-----------------------------------------------------------------------------------------------------------------------------
Hi,
I have been trying to get FCOE work with UCS C200 with P81E card, but I am not able to get flogi on the 5k.
Topology
UCS C200 (P81E) ------SFP+---------(E1/1)5020(fc2/1)-----(fc1/5)MDS(fc1/1)----------JBOD
I am running vmware build 469512 (that supports Cisco VIC) and CIMC is upgraded to the 1.4(3s).
ESXi does see the Cisco FCOE HBAs (two of them), so I am sure that the I am running correct vmware esxi version.
switch# show flogi database
No flogi sessions found.
switch#
- Also this is what I can see form the adaptor 1 of c200.
ucs-c200-m2 /chassis # show adapter 1 detail
PCI Slot 1:
Product Name: UCS VIC P81E
Serial Number: QCI1652A090
Product ID: N2XX-ACPCI01
Adapter Hardware Revision: 4
Current FW Version: 2.1(1a)
NIV: Disabled
FIP: Enabled
Configuration Pending: yes
CIMC Management Enabled : no
VID: V01
Vendor: Cisco Systems Inc
Description:
FW Image 1 Version: 2.1(1a)
FW Image 1 State: RUNNING ACTIVATED
FW Image 2 Version: 2.1(1a)
FW Image 2 State: BACKUP INACTIVATED
FW Update Status: Idle
FW Update Error: No error
FW Update Stage: No operation (0%)
FW Update Overall Progress: 0%
ucs-c200-m2 /chassis #
- 5k side info
switch# show int vfc 1
vfc1 is trunking
Bound interface is Ethernet1/1
Hardware is Ethernet
Port WWN is 20:00:00:0d:ec:b2:68:ff
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 1
Trunk vsans (admin allowed and active) (1)
Trunk vsans (up) ()
Trunk vsans (isolated) ()
Trunk vsans (initializing) (1)
1 minute input rate 280 bits/sec, 35 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
12534 frames input, 2306256 bytes
0 discards, 0 errors
0 frames output, 0 bytes
0 discards, 0 errors
last clearing of "show interface" counters Tue May 14 02:08:04 2013
Interface last changed at Tue May 14 02:36:07 2013
switch#
switch# show run
!Command: show running-config
!Time: Tue May 14 16:15:05 2013
version 5.2(1)N1(4)
feature fcoe
hostname switch
feature telnet
feature interface-vlan
feature lldp
role name default-role
description This is a system defined role and applies to all users.
username admin password 5 $1$22mjeUy/$M6wkiN5z67OpI.dJGVH9x. role network-admin
no password strength-check
banner motd #Nexus 5000 Switch
#
ip domain-lookup
ip host switch 172.27.168.194
class-map type qos class-fcoe
class-map type queuing class-all-flood
match qos-group 2
class-map type queuing class-ip-multicast
match qos-group 2
class-map type network-qos class-all-flood
match qos-group 2
class-map type network-qos class-ip-multicast
match qos-group 2
snmp-server user admin network-admin auth md5 0x87b2e87d3b4a91b8348655d178796ca9
priv 0x87b2e87d3b4a91b8348655d178796ca9 localizedkey
vrf context management
ip route 0.0.0.0/0 172.27.126.1
ip route 0.0.0.0/0 172.27.168.129
vlan configuration 1,1000
vlan 1,1000
vlan 1001
fcoe vsan 1
port-profile default max-ports 512
interface Vlan1
no shutdown
interface Vlan1001
no shutdown
interface vfc1
bind interface Ethernet1/1
no shutdown
interface fc2/1
no shutdown
interface fc2/2
interface fc2/3
interface fc2/4
interface Ethernet1/1
switchport mode trunk
switchport trunk allowed vlan 1,1001
spanning-tree port type edge trunk
interface Ethernet1/2
interface Ethernet1/3
interface Ethernet1/4
interface Ethernet1/5
interface Ethernet1/6
interface Ethernet1/7
interface Ethernet1/8
interface Ethernet1/9
interface Ethernet1/10
interface Ethernet1/11
interface Ethernet1/12
interface Ethernet1/13
interface Ethernet1/14
interface Ethernet1/15
interface Ethernet1/16
interface Ethernet1/17
interface Ethernet1/18
interface Ethernet1/19
interface Ethernet1/20
interface Ethernet1/21
interface Ethernet1/22
interface Ethernet1/23
interface Ethernet1/24
interface Ethernet1/25
interface Ethernet1/26
interface Ethernet1/27
interface Ethernet1/28
interface Ethernet1/29
interface Ethernet1/30
interface Ethernet1/31
interface Ethernet1/32
interface Ethernet1/33
interface Ethernet1/34
interface Ethernet1/35
interface Ethernet1/36
interface Ethernet1/37
interface Ethernet1/38
interface Ethernet1/39
interface Ethernet1/40
interface Ethernet2/1
switchport trunk allowed vlan 1001
interface Ethernet2/2
interface Ethernet2/3
interface Ethernet2/4
interface mgmt0
ip address 172.27.168.194/25
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.2.1.N1.4.bin
boot system bootflash:/n5000-uk9.5.2.1.N1.4.bin
interface fc2/1
interface fc2/2
interface fc2/3
interface fc2/4
!Full Zone Database Section for vsan 1
zone name DC-ZONE vsan 1
member pwwn 50:00:40:20:02:f4:1a:98
member pwwn 21:00:00:e0:8b:19:42:58
zoneset name DC-ZONESET vsan 1
member DC-ZONE
zoneset activate name DC-ZONESET vsan 1
switch#
switch# show int e1/1
Ethernet1/1 is up
Dedicated Interface
Hardware: 1000/10000 Ethernet, address: 000d.ecb2.68c8 (bia 000d.ecb2.68c8)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped 13:39:41
Last clearing of "show interface" counters never
30 seconds input rate 288 bits/sec, 0 packets/sec
30 seconds output rate 632 bits/sec, 1 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 208 bps, 0 pps; output rate 416 bps, 0 pps
RX
12553 unicast packets 1702 multicast packets 0 broadcast packets
14255 input packets 2496880 bytes
0 jumbo packets 0 storm suppression packets
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
0 unicast packets 59994 multicast packets 0 broadcast packets
59994 output packets 4672305 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
2 interface resets
switch#
switch# show lldp neighbors
Capability codes:
(R) Router, (B) Bridge, (T) Telephone, (C) DOCSIS Cable Device
(W) WLAN Access Point, (P) Repeater, (S) Station, (O) Other
Device ID Local Intf Hold-time Capability Port ID
5478.1a86.f294 Eth1/1 120 5478.1a86.f294
Total entries displayed: 1
switch#
switch#
Thank you for any pointers in this regard.
Giyoung.
--- added more debug on n5k side
switch# show system internal dcbx info interface e1/1
Interface info for if_index: 0x1a000000(Eth1/1)
tx_enabled: TRUE
rx_enabled: TRUE
dcbx_enabled: TRUE
DCX Protocol: CEE
DCX CEE NIV extension: disabled
Port MAC address: 00:0d:ec:b2:68:c8
DCX Control FSM Variables: seq_no: 0x1, ack_no: 0x1,my_ack_no: 0x1, peer_seq_no:
0x1 oper_version: 0x0, max_version: 0x0 fast_retries 0x0
Lock Status: UNLOCKED
PORT STATE: UP
LLDP Neighbors
Remote Peers Information on interface Eth1/1
Remote peer's MSAP: length 12 Bytes:
54 78 1a 86 f2 94 54 78 1a 86 f2 94
LLDP TLV's
LLDP TLV type:Chassis ID LLDP TLV Length: 7
04 54 78 1a 86 f2 94
Chassis type: 04 Chassis ID:54 78 1a 86 f2 94
LLDP TLV type:Port ID LLDP TLV Length: 7
03 54 78 1a 86 f2 94
Port ID subtype: 03 Port ID:54 78 1a 86 f2 94
LLDP TLV type:Time to Live LLDP TLV Length: 2
00 78
TTL = 00
LLDP TLV type:LLDP Organizationally Specific LLDP TLV Length: 55
00 1b 21 02 02 0a 00 00 00 00 00 01 00 00 00 01 08 0a 00 00
c0 00 89 06 00 1b 21 08 06 06 00 00 c0 00 ff 08 04 11 00 00
c0 00 ff ff ff ff 00 00 00 00 00 00 00 00 08
LLDP TLV type:LLDP Organizationally Specific LLDP TLV Length: 5
00 01 42 01 01
LLDP TLV type:END of LLDP PDU LLDP TLV Length: 0
Peer's DCX TLV:
DCBX TLV Proto(1) type: 1(Control) DCBX TLV Length: 10 DCBX TLV Value
00 00 01 00 00 00 01 00 00 00
sub_type 0, error 0, willing 0, enable 0, max_version 0, oper_version 0
DCBX TLV Proto(1) type: 4(App) DCBX TLV Length: 10 DCBX TLV Value
00 00 c0 00 89 06 00 1b 21 08
sub_type 0, error 0, willing 1, enable 1, max_version 0, oper_version 0
DCBX TLV Proto(1) type: 3(PFC) DCBX TLV Length: 6 DCBX TLV Value
00 00 c0 00 ff 08
sub_type 0, error 0, willing 1, enable 1, max_version 0, oper_version 0
DCBX TLV Proto(1) type: 2(PriGrp) DCBX TLV Length: 17 DCBX TLV Value
00 00 c0 00 ff ff ff ff 00 00 00 00 00 00 00 00 08
sub_type 0, error 0, willing 1, enable 1, max_version 0, oper_version 0
6 Features on this intf for Protocol DCX CIN(0)
Feature type LLS (6)sub_type FCoE Logical Link Status (0)
feature type 6(DCX CIN-LLS)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0
feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 0
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x1d9
Desired config cfg length: 1 data bytes:00
Operating config cfg length: 0 data bytes:
Peer config cfg length: 0 data bytes:
Feature type PFC (3)
feature type 3(DCX CIN-PFC)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0
feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 1 data bytes:08
Operating config cfg length: 0 data bytes:
Peer config cfg length: 0 data bytes:
Feature type App (5)sub_type FCoE iSCSI (0)
feature type 5(DCX CIN-App)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0
feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 1 data bytes:08
Operating config cfg length: 0 data bytes:
Peer config cfg length: 0 data bytes:
Feature type PriMtu (8)
feature type 8(DCX CIN-PriMtu)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0
feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 16 data bytes:05 dc 05 dc 05 dc 08
6e 05 dc 05 dc 05 dc 05 dc
Operating config cfg length: 0 data bytes:
Peer config cfg length: 0 data bytes:
Feature type PriGrp (2)
feature type 2(DCX CIN-PriGrp)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0
feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 24 data bytes:32 32 00 00 00 00 00
00 00 0f 00 0f 00 0e 20 64 00 0e 00 0e
00 0e 00 0e
Operating config cfg length: 0 data bytes:
Peer config cfg length: 0 data bytes:
Feature type LLS (6)sub_type LAN Logical Link Status (1)
feature type 6(DCX CIN-LLS)sub_type 1
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 0
feature_seq_no 0 remote_feature_tlv_present 0 remote_tlv_aged_out 1
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0xaf
Desired config cfg length: 1 data bytes:80
Operating config cfg length: 0 data bytes:
Peer config cfg length: 0 data bytes:
3 Features on this intf for Protocol DCX CEE(1)
Feature type PFC (3)
feature type 3(DCX CEE-PFC)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 1
feature_seq_no 0 remote_feature_tlv_present 1 remote_tlv_aged_out 0
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 2 data bytes:08 08
Operating config cfg length: 2 data bytes:08 08
Peer config cfg length: 0 data bytes:
Feature type App (4)sub_type FCoE iSCSI (0)
feature type 4(DCX CEE-App)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 1
feature_seq_no 0 remote_feature_tlv_present 1 remote_tlv_aged_out 0
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 6 data bytes:89 06 00 1b 21 08
Operating config cfg length: 6 data bytes:89 06 00 1b 21 08
Peer config cfg length: 0 data bytes:
Feature type PriGrp (2)
feature type 2(DCX CEE-PriGrp)sub_type 0
Feature State Variables: oper_version 0 error 0 local error 0 oper_mode 1
feature_seq_no 0 remote_feature_tlv_present 1 remote_tlv_aged_out 0
remote_tlv_not_present_notification_sent 0
Feature Register Params: max_version 0, enable 1, willing 0 advertise 1
disruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 13 data bytes:00 01 00 00 32 32 00
00 00 00 00 00 02
Operating config cfg length: 13 data bytes:00 01 00 00 32 32 0
0 00 00 00 00 00 02
Peer config cfg length: 0 data bytes:
Features on this intf for LLDP
lldp feature type 2(PriMtu)sub_type 0
lldp feature register params max_version 0, enable 1, willing 0 advertise 1, dis
ruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0x179
Desired config cfg length: 16 data bytes:05 dc 05 dc 05 dc 08
6e 05 dc 05 dc 05 dc 05 dc
Peer config cfg length: 0 data bytes:
lldp feature type 1(LLS)sub_type 1
lldp feature register params max_version 0, enable 1, willing 0 advertise 1, dis
ruptive_error 0 mts_addr_node 0x101 mts_addr_sap 0xaf
Desired config cfg length: 1 data bytes:01
Peer config cfg length: 1 data bytes:01
Traffic Counters
DCBX pkt stats:
Total frames out: 2305
Total Entries aged: 9
Total frames in: 2295
DCBX frames in: 2295
Total frames received in error: 0
Total frames discarded: 0
Total TLVs unrecognized: 0
switch#