cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1115
Views
0
Helpful
1
Replies

FCoE between FI and Nexus 5548UP

Jiri Tyl
Level 1
Level 1

Hello exports,

I have fabric interconnect UCS6248 OS ver 5.0(3)N2(2.11e) in FC switching mode and Nexus 5548UP OS ver 5.0(3)N2(1). These two devices are directly connected with twinax cable, on both devices Im using port 1/17.

I want to use fcoe multihop from server HBA to EMC VNX through FI and Nexus. On the FI I configured the VSAN 850 using VLAN 850 and set the port 1/17 as FCoE uplunk.

On the Nexus I have the following configuration:

feature fcoe

vlan 850

name VSAN_A

fcoe vsan 850

vsan database

  vsan 850

interface vfc850

  bind interface Ethernet1/17

  switchport mode E

  switchport trunk allowed vsan 850

  no shutdown

vsan database

  vsan 850 interface vfc850

interface Ethernet1/17

  switchport mode trunk

  switchport trunk allowed vlan 850

VSAN 850 between the FI and Nexus dont want to come up. Related output from FI:

A348-UCS6248-A-A(nxos)# sh vsan

vsan 1 information

         name:VSAN0001  state:active

         interoperability mode:default

         loadbalancing:src-id/dst-id/oxid

         operational state:down

vsan 850 information

         name:VSAN0850  state:active

         interoperability mode:default

         loadbalancing:src-id/dst-id/oxid

         operational state:down

vsan 4079:evfp_isolated_vsan

vsan 4094:isolated_vsan

A348-UCS6248-A-A(nxos)# sh int vfc 712

vfc712 is trunking (Not all VSANs UP on the trunk)

    Bound interface is Ethernet1/17

    Hardware is Virtual Fibre Channel

    Port WWN is 22:c7:00:2a:6a:0b:aa:3f

    Admin port mode is E, trunk mode is on

    snmp link state traps are enabled

    Port mode is TE

    Port vsan is 850

    Trunk vsans (admin allowed and active) (1,850)

    Trunk vsans (up)                       ()

    Trunk vsans (isolated)                 (850)

    Trunk vsans (initializing)             (1)

    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

      98 frames input, 8232 bytes

        0 discards, 0 errors

      307 frames output, 28688 bytes

        0 discards, 0 errors

    last clearing of "show interface" counters never

    Interface last changed at Sun May  5 14:06:43 2013

Related output from Nexus:

A348-N5548UP-A# sh int vfc 850

vfc850 is trunking (Not all VSANs UP on the trunk)

    Bound interface is Ethernet1/17

    Hardware is Virtual Fibre Channel

    Port WWN is 23:51:00:2a:6a:09:7c:7f

    Admin port mode is E, trunk mode is on

    snmp link state traps are enabled

    Port mode is TE

    Port vsan is 850

    Trunk vsans (admin allowed and active) (850)

    Trunk vsans (up)                       ()

    Trunk vsans (isolated)                 (850)

    Trunk vsans (initializing)             ()

    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

      918 frames input, 71340 bytes

        0 discards, 0 errors

      300 frames output, 30300 bytes

        0 discards, 0 errors

    last clearing of "show interface" counters never

    Interface last changed at Sun May  5 14:05:43 2013

A348-N5548UP-A# sh int e 1/17

Ethernet1/17 is up

  Hardware: 1000/10000 Ethernet, address: 002a.6a09.7c38 (bia 002a.6a09.7c38)

  MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

     reliability 255/255, txload 1/255, rxload 1/255

  Encapsulation ARPA

  Port mode is trunk

  full-duplex, 10 Gb/s, media type is 10G

  Beacon is turned off

  Input flow-control is off, output flow-control is off

  Rate mode is dedicated

  Switchport monitor is off

  EtherType is 0x8100

  Last link flapped 04:10:33

  Last clearing of "show interface" counters never

  30 seconds input rate 288 bits/sec, 36 bytes/sec, 0 packets/sec

  30 seconds output rate 200 bits/sec, 25 bytes/sec, 0 packets/sec

  Load-Interval #2: 5 minute (300 seconds)

    input rate 312 bps, 0 pps; output rate 192 bps, 0 pps

  RX

    931 unicast packets  37209 multicast packets  0 broadcast packets

    38140 input packets  4184855 bytes

    5 jumbo packets  0 storm suppression bytes

    0 giants  0 input error  0 short frame  0 overrun   0 underrun

    0 watchdog  0 if down drop

    0 input with dribble  0 input discard

    0 Rx pause

  TX

    316 unicast packets  18196 multicast packets  0 broadcast packets

    18512 output packets  2642762 bytes

    7 jumbo packets

    0 output errors  0 collision  0 deferred  0 late collision

    0 lost carrier  0 no carrier  0 babble

    0 Tx pause

  11 interface resets

A348-N5548UP-A# sh fc

fc2               fcdroplatency     fcoe              fctimer

fc2d              fcflow            fcoe-npv

fcalias           fcid-allocation   fcroute

fcdomain          fcns              fcs

A348-N5548UP-A# sh fcs database

FCS Local Database in VSAN: 1

------------------------------

Switch WWN               : 20:01:00:2a:6a:09:7c:41

Switch Domain Id         : 0x79(121)

Switch Mgmt-Addresses    :

Fabric-Name              : 20:01:00:2a:6a:09:7c:41

Switch Logical-Name      : A348-N5548UP-A

Switch Information List  : [Cisco Systems, Inc.*N5K-C5548UP*5.0(3)N2(1)*20:00:00

:2a:6a:09:7c:40]

Switch Ports:

------------------------------------------------------------------------

Interface      fWWN                     Type     Attached-pWWNs

                                                 (Device-alias)

------------------------------------------------------------------------

FCS Local Database in VSAN: 850

------------------------------

Switch WWN               : 23:52:00:2a:6a:09:7c:41

Switch Domain Id         : 0x3b(59)

Switch Mgmt-Addresses    :

Fabric-Name              : 23:52:00:2a:6a:09:7c:41

Switch Logical-Name      : A348-N5548UP-A

Switch Information List  : [Cisco Systems, Inc.*N5K-C5548UP*5.0(3)N2(1)*20:00:00

:2a:6a:09:7c:40]

Switch Ports:

------------------------------------------------------------------------

Interface      fWWN                     Type     Attached-pWWNs

                                                 (Device-alias)

------------------------------------------------------------------------

vfc850              23:51:00:2a:6a:09:7c:7f  Unknown  None

Please help, Thanks and Regards Jiri

1 Reply 1

Jiri Tyl
Level 1
Level 1

There was qos configuration missing. After configuring this:

system qos

  service-policy type qos input system_qos_policy

  service-policy type queuing input system_q_in_policy

  service-policy type queuing output system_q_out_policy

  service-policy type network-qos system_nq_policy

The FCoE ports are up !!!

Regards Jiri

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Review Cisco Networking products for a $25 gift card