cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1303
Views
0
Helpful
5
Replies

Nexus B22 FEX for Dell to Nexus 5596UP VFC errordisabled

S.Srivas_2
Level 1
Level 1

Dear experts,

I have the following errordisabled state on VFc as below.

(Trying to get FCoE up and running for FC and automatically read WWN from Dell blades (M1000e) with two Nexus B22 FEX for Dell)

The Eth interfaces are showiing

N5KMR2E1-1(config-if)# sh int vfc1033

vfc1033 is down (Error disabled)                 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Why

    Bound interface is Ethernet1/3

    Hardware is Ethernet                                !!!!!!!!!!!!!!!!!!!!!!!!!!!!!! should this be VFC

    Port WWN is 24:08:00:2a:6a:0d:db:3f

    Admin port mode is F, trunk mode is on

    snmp link state traps are enabled

    Port vsan is 2

    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

      0 frames input, 0 bytes

        0 discards, 0 errors

      0 frames output, 0 bytes

        0 discards, 0 errors

    last clearing of "show interface" counters Mon Mar  2 12:32:00 2009

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

N5KMR2E1-1# sh fcoe

Global FCF details

        FCF-MAC is 00:2a:6a:0d:db:00

        FC-MAP is 0e:fc:00

        FCF Priority is 128

        FKA Advertisement period for FCF is 8 seconds

VFC MAC details

        vfc1033 FCF-MAC is 00:2a:6a:0d:db:0a

N5KMR2E1-1# sh fcoe database

-------------------------------------------------------------------------------

INTERFACE       FCID            PORT NAME               MAC ADDRESS

-------------------------------------------------------------------------------

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!------------------------------ nothing is displayed here----------why?

N5KMR2E1-1#

N5KMR2E1-1# sh int port-channel 3 fex-intf

Fabric           FEX

Interface        Interfaces

---------------------------------------------------

Po3             Eth103/1/1    Eth103/1/2    Eth103/1/3    Eth103/1/4

                 Eth103/1/5    Eth103/1/6    Eth103/1/7    Eth103/1/8

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! should this show the FiberChennel from Dell VM NICs???????????????/

N5KMR2E1-1#

N5KMR2E1-1# sh int status

--------------------------------------------------------------------------------

Port          Name                   Status            Vlan      Duplex  Speed   Type

--------------------------------------------------------------------------------

Eth1/1        VPC Peer Link      connected     trunk     full    10G     SFP-H10GB-C

Eth1/2        VPC Peer Link      connected     trunk     full    10G     SFP-H10GB-C

Eth1/3        SIT FEX-B22 DEll_C connected     1         full    10G     SFP-H10GB-C  ------------ why only 1, not trunk??? (connects to FEX)

Eth1/4        SIT FEX-B22 DEll_C disabled        1         full    10G     SFP-H10GB-C ------------ why only 1, not trunk???

Eth1/5        --                 sfpAbsent                  1         full    10G     --

5 Replies 5

Leo Laohoo
Hall of Fame
Hall of Fame

And what firmware is your N5K running?

Nexus 5596UP

NX 5.2 (1) N1 (4)

Hi Leo and others,

Is the Nexus version i have is suitable for B22 FEX for Dell?

Asking this because of the following web info:

Support for DELL FEX

Added support for the Cisco Nexus B22 DELL fabric extender.

http://www.cisco.com/en/US/docs/switches/datacenter/nexus5500/sw/release/notes/Rel_6_0_2_N1_1/Nexus5500_Release_Notes_6_0_2_N1.html

B22DELL supported started on N5K firmware 5.2(1)N1(3).  So you are covered.  However, for other reasons, I'd recommend you use the 6.X NX OS because it's classified as a "long" version.  Long version means that all the improvements found in the 5.X will be incorporated here.

Two config files and one diagram attached.

We have two Cisco B22 fabric extenders in our M1000e chassis, and are single homed to the two Cisco Nexus 5596UP, with 2 links on each switch. We are unable to see the WWN’s of the servers in the blade chassis from Nexus switches. [sh flogi database]

We also experienced the VFC interface (eg 103/1/1) appear with FEX-FABRIC mode  but not in Trunk mode. 

Eth1/3 is FCoE up, which is the only member of Port-channel 3 (Nexus1), but PoCh 3 is FCoE is down.

VFC1033 are down on both Nexus1 and Nexus2.

Strangely, with my earlier configs the VFCs were in VSAN 2, but now VFCs are in VSAN 1, even though configured to be in VSAN 2.

Configuration from Nexus1 and Nexus2 are attached.

Notes on current troubleshooting info is given below. Please note when I changed the uplink Po3 to Trunk, from FEX-Fabric, the ErrorDisabled message has gone however in “sh int vfs 1033” showing as hardware Ethernet, where I expect Hardware virtual fibre channel.


N5KMR2E1-2# sh int vfc1033
vfc1033 is down (Error Disabled - VLAN L2 down on Eth interface)
    Bound interface is port-channel4
    Hardware is Ethernet
    Port WWN is 24:08:00:2a:6a:14:0f:3f
    Admin port mode is F, trunk mode is on
    snmp link state traps are enabled
    Port vsan is 1
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      0 frames input, 0 bytes
        0 discards, 0 errors
      0 frames output, 0 bytes
        0 discards, 0 errors
    last clearing of "show interface" counters never

N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2# sh int vfc1033
vfc1033 is down (Error Disabled - VLAN L2 down on Eth interface)
    Bound interface is port-channel4
    Hardware is Ethernet
    Port WWN is 24:08:00:2a:6a:14:0f:3f
    Admin port mode is F, trunk mode is on
    snmp link state traps are enabled
    Port vsan is 1
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      0 frames input, 0 bytes
        0 discards, 0 errors
      0 frames output, 0 bytes
        0 discards, 0 errors
    last clearing of "show interface" counters never

N5KMR2E1-2# ^C
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2#
N5KMR2E1-2# sh int fcoe
Ethernet1/1 is FCoE UP
Ethernet1/2 is FCoE UP
Ethernet1/3 is FCoE UP
Ethernet1/4 is FCoE UP
Ethernet1/5 is FCoE down
Ethernet1/6 is FCoE down
Ethernet1/7 is FCoE down
Ethernet1/8 is FCoE down
Ethernet1/9 is FCoE down
Ethernet1/10 is FCoE down
Ethernet1/11 is FCoE UP
Ethernet1/12 is FCoE UP
Ethernet1/13 is FCoE UP
Ethernet1/14 is FCoE down
Ethernet1/15 is FCoE down
Ethernet1/16 is FCoE down
Ethernet1/17 is FCoE down
Ethernet1/18 is FCoE down
Ethernet1/19 is FCoE down
Ethernet1/20 is FCoE down
Ethernet1/21 is FCoE down
Ethernet1/22 is FCoE down
Ethernet1/23 is FCoE down
Ethernet1/24 is FCoE down
Ethernet1/25 is FCoE down
Ethernet1/26 is FCoE down
Ethernet1/27 is FCoE down
Ethernet1/28 is FCoE down
Ethernet1/29 is FCoE down
Ethernet1/30 is FCoE down
Ethernet1/31 is FCoE down
Ethernet1/32 is FCoE down
Ethernet1/33 is FCoE down
Ethernet1/34 is FCoE down
Ethernet1/35 is FCoE down
Ethernet1/36 is FCoE down
Ethernet1/37 is FCoE down
Ethernet1/38 is FCoE down
Ethernet1/39 is FCoE down
Ethernet1/40 is FCoE down
port-channel1 is FCoE down
port-channel4 is FCoE down
port-channel11 is FCoE down
port-channel32 is FCoE UP
Ethernet104/1/1 is FCoE down
Ethernet104/1/2 is FCoE down
Ethernet104/1/3 is FCoE down
Ethernet104/1/4 is FCoE down
Ethernet104/1/5 is FCoE down
Ethernet104/1/6 is FCoE down
Ethernet104/1/7 is FCoE down
Ethernet104/1/8 is FCoE down
Ethernet104/1/9 is FCoE UP
Ethernet104/1/10 is FCoE UP
Ethernet104/1/11 is FCoE UP
Ethernet104/1/12 is FCoE UP
Ethernet104/1/13 is FCoE UP
Ethernet104/1/14 is FCoE UP
Ethernet104/1/15 is FCoE UP
Ethernet104/1/16 is FCoE down
N5KMR2E1-2#  ^C
N5KMR2E1-2#

N5KMR2E1-2# sh int eth1/3

Ethernet1/3 is up

Dedicated Interface

  Belongs to Po4

  Hardware: 1000/10000 Ethernet, address: 002a.6a14.0f0a (bia 002a.6a14.0f0a)

  Description: UAT FEX-B22 DEll_C2-1

  MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec

  reliability 255/255, txload 1/255, rxload 1/255

  Encapsulation ARPA

  Port mode is fex-fabric

  full-duplex, 10 Gb/s, media type is 10G

  Beacon is turned off

  Input flow-control is off, output flow-control is off

  Rate mode is dedicated

  Switchport monitor is off

  EtherType is 0x8100

  Last link flapped 01:05:26

  Last clearing of "show interface" counters never

  30 seconds input rate 13952 bits/sec, 1 packets/sec

  30 seconds output rate 2512 bits/sec, 1 packets/sec

  Load-Interval #2: 5 minute (300 seconds)

    input rate 14.08 Kbps, 1 pps; output rate 2.05 Kbps, 0 pps

  RX

    6623 unicast packets  1288 multicast packets  1 broadcast packets

    7912 input packets  5853743 bytes

    2497 jumbo packets  0 storm suppression bytes

    0 runts  0 giants  0 CRC  0 no buffer

    0 input error  0 short frame  0 overrun   0 underrun  0 ignored

    0 watchdog  0 bad etype drop  0 bad proto drop  0 if down drop

    0 input with dribble  0 input discard

    0 Rx pause

  TX

    4124 unicast packets  1365 multicast packets  0 broadcast packets

    5489 output packets  1331087 bytes

    0 jumbo packets

    0 output errors  0 collision  0 deferred  0 late collision

    0 lost carrier  0 no carrier  0 babble 0 output discard

    0 Tx pause

  1 interface resets

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2# sh int po3

                    

Invalid range at '' marker.

N5KMR2E1-2# sh int po4

port-channel4 is up

  Hardware: Port-Channel, address: 002a.6a14.0f0a (bia 002a.6a14.0f0a)

  Description: UAT_DellB22

  MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec

  reliability 255/255, txload 1/255, rxload 1/255

  Encapsulation ARPA

  Port mode is fex-fabric

  full-duplex, 10 Gb/s

  Input flow-control is off, output flow-control is off

  Switchport monitor is off

  EtherType is 0x8100

  Members in this channel: Eth1/3

  Last clearing of "show interface" counters never

  30 seconds input rate 13464 bits/sec, 1 packets/sec

  30 seconds output rate 2216 bits/sec, 0 packets/sec

  Load-Interval #2: 5 minute (300 seconds)

    input rate 14.12 Kbps, 1 pps; output rate 2.09 Kbps, 0 pps

  RX

    6672 unicast packets  1298 multicast packets  1 broadcast packets

    7971 input packets  5899403 bytes

    2517 jumbo packets  0 storm suppression bytes

    0 runts  0 giants  0 CRC  0 no buffer

    0 input error  0 short frame  0 overrun   0 underrun  0 ignored

    0 watchdog  0 bad etype drop  0 bad proto drop  0 if down drop

    0 input with dribble  0 input discard

    0 Rx pause

  TX

    4153 unicast packets  1375 multicast packets  0 broadcast packets

    5528 output packets  1340587 bytes

    0 jumbo packets

    0 output errors  0 collision  0 deferred  0 late collision

    0 lost carrier  0 no carrier  0 babble 0 output discard

    0 Tx pause

  1 interface resets

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2#

N5KMR2E1-2# sh flogi database

--


INTERFACE        VSAN    FCID           PORT NAME               NODE NAME

--


fc1/41           2     0x3f0000  21:00:00:1b:32:90:19:44 20:00:00:1b:32:90:19:44

fc1/43           2     0x3f01ef  50:06:01:61:3c:e0:0b:d2 50:06:01:60:bc:e0:0b:d2

fc1/44           2     0x3f02ef  50:06:01:69:3c:e0:0b:d2 50:06:01:60:bc:e0:0b:d2

fc1/45           2     0x3f03ef  50:06:01:69:46:e0:28:57 50:06:01:60:c6:e0:28:57

fc1/46           2     0x3f04ef  50:06:01:6d:46:e0:28:57 50:06:01:60:c6:e0:28:57

fc1/47           2     0x3f05ef  50:06:01:61:46:e0:28:57 50:06:01:60:c6:e0:28:57

fc1/48           2     0x3f06ef  50:06:01:65:46:e0:28:57 50:06:01:60:c6:e0:28:57

Total number of flogi = 7.

N5KMR2E1-2#

mcestyle="width: 313px;" cellpadding="0" cellspacing="0" align="left" height="240">



mcestyle="text-align: justify;">

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: