05-10-2013 07:28 AM - edited 03-07-2019 01:17 PM
Dear experts,
I have the following errordisabled state on VFc as below.
(Trying to get FCoE up and running for FC and automatically read WWN from Dell blades (M1000e) with two Nexus B22 FEX for Dell)
The Eth interfaces are showiing
N5KMR2E1-1(config-if)# sh int vfc1033
vfc1033 is down (Error disabled) !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Why
Bound interface is Ethernet1/3
Hardware is Ethernet !!!!!!!!!!!!!!!!!!!!!!!!!!!!!! should this be VFC
Port WWN is 24:08:00:2a:6a:0d:db:3f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port vsan is 2
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
0 frames input, 0 bytes
0 discards, 0 errors
0 frames output, 0 bytes
0 discards, 0 errors
last clearing of "show interface" counters Mon Mar 2 12:32:00 2009
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
N5KMR2E1-1# sh fcoe
Global FCF details
FCF-MAC is 00:2a:6a:0d:db:00
FC-MAP is 0e:fc:00
FCF Priority is 128
FKA Advertisement period for FCF is 8 seconds
VFC MAC details
vfc1033 FCF-MAC is 00:2a:6a:0d:db:0a
N5KMR2E1-1# sh fcoe database
-------------------------------------------------------------------------------
INTERFACE FCID PORT NAME MAC ADDRESS
-------------------------------------------------------------------------------
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!------------------------------ nothing is displayed here----------why?
N5KMR2E1-1#
N5KMR2E1-1# sh int port-channel 3 fex-intf
Fabric FEX
Interface Interfaces
---------------------------------------------------
Po3 Eth103/1/1 Eth103/1/2 Eth103/1/3 Eth103/1/4
Eth103/1/5 Eth103/1/6 Eth103/1/7 Eth103/1/8
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! should this show the FiberChennel from Dell VM NICs???????????????/
N5KMR2E1-1#
N5KMR2E1-1# sh int status
--------------------------------------------------------------------------------
Port Name Status Vlan Duplex Speed Type
--------------------------------------------------------------------------------
Eth1/1 VPC Peer Link connected trunk full 10G SFP-H10GB-C
Eth1/2 VPC Peer Link connected trunk full 10G SFP-H10GB-C
Eth1/3 SIT FEX-B22 DEll_C connected 1 full 10G SFP-H10GB-C ------------ why only 1, not trunk??? (connects to FEX)
Eth1/4 SIT FEX-B22 DEll_C disabled 1 full 10G SFP-H10GB-C ------------ why only 1, not trunk???
Eth1/5 -- sfpAbsent 1 full 10G --
05-10-2013 07:39 AM
And what firmware is your N5K running?
05-10-2013 07:45 AM
Nexus 5596UP
NX 5.2 (1) N1 (4)
05-11-2013 08:32 AM
Hi Leo and others,
Is the Nexus version i have is suitable for B22 FEX for Dell?
Asking this because of the following web info:
Added support for the Cisco Nexus B22 DELL fabric extender.
05-11-2013 04:50 PM
B22DELL supported started on N5K firmware 5.2(1)N1(3). So you are covered. However, for other reasons, I'd recommend you use the 6.X NX OS because it's classified as a "long" version. Long version means that all the improvements found in the 5.X will be incorporated here.
05-11-2013 05:36 PM
Two config files and one diagram attached.
We have two Cisco B22 fabric extenders in our M1000e chassis, and are single homed to the two Cisco Nexus 5596UP, with 2 links on each switch. We are unable to see the WWN’s of the servers in the blade chassis from Nexus switches. [sh flogi database]
We also experienced the VFC interface (eg 103/1/1) appear with FEX-FABRIC mode but not in Trunk mode.
Eth1/3 is FCoE up, which is the only member of Port-channel 3 (Nexus1), but PoCh 3 is FCoE is down.
VFC1033 are down on both Nexus1 and Nexus2.
Strangely, with my earlier configs the VFCs were in VSAN 2, but now VFCs are in VSAN 1, even though configured to be in VSAN 2.
Configuration from Nexus1 and Nexus2 are attached.
Notes on current troubleshooting info is given below. Please note when I changed the uplink Po3 to Trunk, from FEX-Fabric, the ErrorDisabled message has gone however in “sh int vfs 1033” showing as hardware Ethernet, where I expect Hardware virtual fibre channel.
N5KMR2E1-2# sh int vfc1033
vfc1033 is down (Error Disabled - VLAN L2 down on Eth interface)
Bound interface is port-channel4
Hardware is Ethernet
Port WWN is 24:08:00:2a:6a:14:0f:3f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port vsan is 1
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
0 frames input, 0 bytes
0 discards, 0 errors
0 frames output, 0 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2# sh int vfc1033
vfc1033 is down (Error Disabled - VLAN L2 down on Eth interface)
Bound interface is port-channel4
Hardware is Ethernet
Port WWN is 24:08:00:2a:6a:14:0f:3f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port vsan is 1
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
0 frames input, 0 bytes
0 discards, 0 errors
0 frames output, 0 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
N5KMR2E1-2# ^C
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2# sh int fcoe
Ethernet1/1 is FCoE UP
Ethernet1/2 is FCoE UP
Ethernet1/3 is FCoE UP
Ethernet1/4 is FCoE UP
Ethernet1/5 is FCoE down
Ethernet1/6 is FCoE down
Ethernet1/7 is FCoE down
Ethernet1/8 is FCoE down
Ethernet1/9 is FCoE down
Ethernet1/10 is FCoE down
Ethernet1/11 is FCoE UP
Ethernet1/12 is FCoE UP
Ethernet1/13 is FCoE UP
Ethernet1/14 is FCoE down
Ethernet1/15 is FCoE down
Ethernet1/16 is FCoE down
Ethernet1/17 is FCoE down
Ethernet1/18 is FCoE down
Ethernet1/19 is FCoE down
Ethernet1/20 is FCoE down
Ethernet1/21 is FCoE down
Ethernet1/22 is FCoE down
Ethernet1/23 is FCoE down
Ethernet1/24 is FCoE down
Ethernet1/25 is FCoE down
Ethernet1/26 is FCoE down
Ethernet1/27 is FCoE down
Ethernet1/28 is FCoE down
Ethernet1/29 is FCoE down
Ethernet1/30 is FCoE down
Ethernet1/31 is FCoE down
Ethernet1/32 is FCoE down
Ethernet1/33 is FCoE down
Ethernet1/34 is FCoE down
Ethernet1/35 is FCoE down
Ethernet1/36 is FCoE down
Ethernet1/37 is FCoE down
Ethernet1/38 is FCoE down
Ethernet1/39 is FCoE down
Ethernet1/40 is FCoE down
port-channel1 is FCoE down
port-channel4 is FCoE down
port-channel11 is FCoE down
port-channel32 is FCoE UP
Ethernet104/1/1 is FCoE down
Ethernet104/1/2 is FCoE down
Ethernet104/1/3 is FCoE down
Ethernet104/1/4 is FCoE down
Ethernet104/1/5 is FCoE down
Ethernet104/1/6 is FCoE down
Ethernet104/1/7 is FCoE down
Ethernet104/1/8 is FCoE down
Ethernet104/1/9 is FCoE UP
Ethernet104/1/10 is FCoE UP
Ethernet104/1/11 is FCoE UP
Ethernet104/1/12 is FCoE UP
Ethernet104/1/13 is FCoE UP
Ethernet104/1/14 is FCoE UP
Ethernet104/1/15 is FCoE UP
Ethernet104/1/16 is FCoE down
N5KMR2E1-2# ^C
N5KMR2E1-2#
N5KMR2E1-2# sh int eth1/3
Ethernet1/3 is up
Dedicated Interface
Belongs to Po4
Hardware: 1000/10000 Ethernet, address: 002a.6a14.0f0a (bia 002a.6a14.0f0a)
Description: UAT FEX-B22 DEll_C2-1
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is fex-fabric
full-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped 01:05:26
Last clearing of "show interface" counters never
30 seconds input rate 13952 bits/sec, 1 packets/sec
30 seconds output rate 2512 bits/sec, 1 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 14.08 Kbps, 1 pps; output rate 2.05 Kbps, 0 pps
RX
6623 unicast packets 1288 multicast packets 1 broadcast packets
7912 input packets 5853743 bytes
2497 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
4124 unicast packets 1365 multicast packets 0 broadcast packets
5489 output packets 1331087 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
1 interface resets
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2# sh int po3
Invalid range at '' marker.
N5KMR2E1-2# sh int po4
port-channel4 is up
Hardware: Port-Channel, address: 002a.6a14.0f0a (bia 002a.6a14.0f0a)
Description: UAT_DellB22
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is fex-fabric
full-duplex, 10 Gb/s
Input flow-control is off, output flow-control is off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth1/3
Last clearing of "show interface" counters never
30 seconds input rate 13464 bits/sec, 1 packets/sec
30 seconds output rate 2216 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 14.12 Kbps, 1 pps; output rate 2.09 Kbps, 0 pps
RX
6672 unicast packets 1298 multicast packets 1 broadcast packets
7971 input packets 5899403 bytes
2517 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
4153 unicast packets 1375 multicast packets 0 broadcast packets
5528 output packets 1340587 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
1 interface resets
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2# sh flogi database
--
INTERFACE VSAN FCID PORT NAME NODE NAME
--
fc1/41 2 0x3f0000 21:00:00:1b:32:90:19:44 20:00:00:1b:32:90:19:44
fc1/43 2 0x3f01ef 50:06:01:61:3c:e0:0b:d2 50:06:01:60:bc:e0:0b:d2
fc1/44 2 0x3f02ef 50:06:01:69:3c:e0:0b:d2 50:06:01:60:bc:e0:0b:d2
fc1/45 2 0x3f03ef 50:06:01:69:46:e0:28:57 50:06:01:60:c6:e0:28:57
fc1/46 2 0x3f04ef 50:06:01:6d:46:e0:28:57 50:06:01:60:c6:e0:28:57
fc1/47 2 0x3f05ef 50:06:01:61:46:e0:28:57 50:06:01:60:c6:e0:28:57
fc1/48 2 0x3f06ef 50:06:01:65:46:e0:28:57 50:06:01:60:c6:e0:28:57
Total number of flogi = 7.
N5KMR2E1-2#
mcestyle="text-align: justify;">
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide