Solved: hi jimthanks for your

Mohammadreza Aminian · ‎08-31-2015

Hi

I've configured this topology for FCoE on 5k

include IBM BaldeCenter with HS23 LOM Emulex , 2 Nexus4001i , Nexus 5k and MDS 9148 and IBM storwise .

I've configured Fip-snooping on the 4001 and Fcoe on the 5k

please see output config

4001i______

username USERID role network-admin
ip domain-lookup
ip host BC1-N4K-B7 192.168.70.133
switchname BC1-N4K-B7
policy-map type queuing policy-fcoe-bandwidth
class type queuing 1p7q4t-out-q-default
    bandwidth percent 50
class type queuing 1p7q4t-out-pq1
    bandwidth percent 7
class type queuing 1p7q4t-out-q2
    bandwidth percent 7
class type queuing 1p7q4t-out-q3
    bandwidth percent 7
class type queuing 1p7q4t-out-q4
    bandwidth percent 7
class type queuing 1p7q4t-out-q5
    bandwidth percent 7
class type queuing 1p7q4t-out-q6
    bandwidth percent 7
class type queuing 1p7q4t-out-q7
    bandwidth percent 7
class-map type network-qos Jumbo1
match cos 4
class-map type network-qos class-fcoe
match cos 3
class-map type network-qos class-non-fcoe
match cos 0-2,4-7
policy-map type network-qos Jumbo
class type network-qos Jumbo1
    mtu 9216
policy-map type network-qos policy-fcoe
class type network-qos class-fcoe
    pause no-drop
    mtu 2500
class type network-qos class-non-fcoe
system qos
service-policy type network-qos policy-fcoe
service-policy type queuing output policy-fcoe-bandwidth
snmp-server user admin network-admin auth md5 0xe2bdf918466aea3f614a95deb96670d6 priv 0xe2bdf918466aea3f614a95deb96670d6 localizedkey
snmp-server user USERID network-admin auth md5 0xb84c99a9aa12cdebac674985ecd3eeda priv 0xb84c99a9aa12cdebac674985ecd3eeda localizedkey

vrf context management
ip route 0.0.0.0/0 10.10.10.2
ip route 0.0.0.0/0 172.20.16.254
ip route 0.0.0.0/0 192.168.70.126
vlan 1
vlan 10,30
fip-snooping enable
ele-fwd pause rate threshold is 1000 pps

interface port-channel2
switchport mode trunk
fip-snooping port-mode fcf
speed 10000

interface Ethernet1/1
description Blade 1
switchport mode trunk
switchport trunk allowed vlan 1,10,30
spanning-tree port type edge trunk
speed auto

interface Ethernet1/2
description balde 2
switchport mode trunk
switchport trunk allowed vlan 1,10,30
spanning-tree port type edge trunk
speed auto
service-policy type queuing output policy-fcoe-bandwidth

interface Ethernet1/3
description Blade 3
switchport mode trunk

class type queuing 1p7q4t-out-q7
    bandwidth percent 7
class-map type network-qos Jumbo1
match cos 4
class-map type network-qos class-fcoe
match cos 3
class-map type network-qos class-non-fcoe
match cos 0-2,4-7
policy-map type network-qos Jumbo
class type network-qos Jumbo1
    mtu 9216
policy-map type network-qos policy-fcoe
class type network-qos class-fcoe
    pause no-drop
    mtu 2500
class type network-qos class-non-fcoe
system qos
service-policy type network-qos policy-fcoe
service-policy type queuing output policy-fcoe-bandwidth
snmp-server user admin network-admin auth md5 0xe2bdf918466aea3f614a95deb96670d6 priv 0xe2bdf918466aea3f614a95deb96670d6 localizedkey
snmp-server user USERID network-admin auth md5 0xb84c99a9aa12cdebac674985ecd3eeda priv 0xb84c99a9aa12cdebac674985ecd3eeda localizedkey

vrf context management
ip route 0.0.0.0/0 10.10.10.2
ip route 0.0.0.0/0 172.20.16.254
ip route 0.0.0.0/0 192.168.70.126
vlan 1
vlan 10,30
fip-snooping enable
ele-fwd pause rate threshold is 1000 pps

interface port-channel2
switchport mode trunk
fip-snooping port-mode fcf
speed 10000

interface port-channel20
fip-snooping port-mode fcf
speed 10000

interface Ethernet1/1
description Blade 1
switchport mode trunk
switchport trunk allowed vlan 1,10,30
spanning-tree port type edge trunk
speed auto

interface Ethernet1/2
description balde 2
switchport mode trunk
switchport trunk allowed vlan 1,10,30
spanning-tree port type edge trunk
speed auto
service-policy type queuing output policy-fcoe-bandwidth

interface Ethernet1/3
description Blade 3
switchport mode trunk
spanning-tree port type edge trunk
speed auto

i

interface Ethernet1/15
switchport mode trunk
speed 10000
channel-group 2 mode active

interface Ethernet1/16
switchport mode trunk
speed 10000
channel-group 2 mode active

--------------------------------------------------------------------

BC1-N4K-B7# sh fip-snooping enode

Legend:
-------------------------------------------------------------------------------
Interface   VLAN     NODE NAME        FIP MAC         FCOE MAC         FC_MAP
-------------------------------------------------------------------------------
Eth1/3      10   20:00:40:f2:e 40:f2:e9:87:9f:d9 0e:fc:00:ca:00:00 0x0efc00
                 9:87:9f:d9

Eth1/2 10 20:00:40:f2:e 40:f2:e9:87:9e:89 0e:fc:00:ca:00:40 0x0efc00
9:87:9e:89

Eth1/1 10 20:00:40:f2:e 40:f2:e9:87:aa:81 0e:fc:00:ca:00:20 0x0efc00
9:87:aa:81

BC1-N4K-B7# sh fip-snooping sessions

Legend:
-------------------------------------------------------------------------------
FCF MAC ENode MAC VLAN FCoE MAC N_PORT_ID

-------------------------------------------------------------------------------
00:2a:6a:e6:7a:b8 40:f2:e9:87:9f:d9 10 0e:fc:00:ca:00:00 ca:00:00

00:2a:6a:e6:7a:b8 40:f2:e9:87:9e:89 10 0e:fc:00:ca:00:40 ca:00:40

00:2a:6a:e6:7a:b8 40:f2:e9:87:aa:81 10 0e:fc:00:ca:00:20 ca:00:20

BC1-N4K-B7# sh fip-snooping fcf

Legend:
-------------------------------------------------------------------------------
Interface VLAN Active FPMA/ FCMAP      FCF-MAC   Pri   Switch WWN Fabric Name
               Enodes SPMA
-------------------------------------------------------------------------------
por2      10   3      FPMA 0x0efc00 00:2a:6a:e6 128 20:01:00:2a: 20:01:00:2a:
                                    :7a:b8            6a:e6:7a:81 6a:bd:d0:89

Configuration 5K

no password strength-check
fips mode enable
ip domain-lookup
system qos
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type qos input fcoe-default-in-policy
service-policy type network-qos fcoe-default-nq-policy
slot 1
port 43-48 type fc
snmp-server user admin network-admin auth md5 0xa2cb00ecf5b7620a73e5eaf25979420c
priv 0xa2cb00ecf5b7620a73e5eaf25979420c localizedkey
rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

vrf context management
ip route 0.0.0.0/0 172.20.16.254
fcdomain fcid database
vsan 1 wwn 10:00:40:f2:e9:87:9f:d9 fcid 0x00ca0000 dynamic
vsan 1 wwn 10:00:40:f2:e9:87:aa:81 fcid 0x00ca0020 dynamic
vsan 1 wwn 10:00:40:f2:e9:87:9e:89 fcid 0x00ca0040 dynamic

interface san-port-channel 1

interface port-channel2
switchport mode trunk
speed 10000

interface vfc101
bind mac-address 40F2.E987.AA81
no shutdown

interface vfc102
bind mac-address 40F2.E987.9E89
no shutdown

interface vfc103
bind mac-address 40F2.E987.9FD9
no shutdown

interface fc1/43

interface fc1/44

interface fc1/45

interface fc1/46

interface fc1/47
channel-group 1 force
no shutdown

interface fc1/48
channel-group 1 force
no shutdown

interface Ethernet1/1

interface Ethernet1/2

interface Ethernet1/3

interface Ethernet1/4

interface Ethernet1/5
switchport mode trunk

interface Ethernet1/6
switchport mode trunk

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

.

interface Ethernet1/32

interface Ethernet1/33
switchport mode trunk
channel-group 2 mode active

interface Ethernet1/34
switchport mode trunk
channel-group 2 mode active

interface Ethernet1/35

interface Ethernet1/42

interface mgmt0
vrf member management
ip address 172.20.16.181/24
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.7.0.2.N1.1.bin
boot system bootflash:/n5000-uk9.7.0.2.N1.1.bin
interface fc1/43
interface fc1/44
interface fc1/45
interface fc1/46
interface fc1/47
interface fc1/48
zoneset activate name ZONESET_V1 vsan 1

N5K96UP-1# show flogi database
--------------------------------------------------------------------------------
INTERFACE        VSAN    FCID           PORT NAME               NODE NAME
--------------------------------------------------------------------------------
vfc101           1     0xca0020 10:00:40:f2:e9:87:aa:81 20:00:40:f2:e9:87:aa:81
vfc102           1     0xca0040 10:00:40:f2:e9:87:9e:89 20:00:40:f2:e9:87:9e:89
vfc103           1     0xca0000 10:00:40:f2:e9:87:9f:d9 20:00:40:f2:e9:87:9f:d9

Total number of flogi = 3.

N5K96UP-1# sh fcoe database

-------------------------------------------------------------------------------
INTERFACE       FCID            PORT NAME               MAC ADDRESS
-------------------------------------------------------------------------------
vfc101          0xca0020        10:00:40:f2:e9:87:aa:81 40:f2:e9:87:aa:81
vfc102          0xca0040        10:00:40:f2:e9:87:9e:89 40:f2:e9:87:9e:89
vfc103          0xca0000        10:00:40:f2:e9:87:9f:d9 40:f2:e9:87:9f:d9

N5K96UP-1# sh int vfc 102
vfc102 is trunking
    Bound MAC is 40:f2:e9:87:9e:89
    Hardware is Ethernet
    Port WWN is 20:65:00:2a:6a:e6:7a:bf
    Admin port mode is F, trunk mode is on
    snmp link state traps are enabled
    Port mode is TF
    Port vsan is 1
    Trunk vsans (admin allowed and active) (1)
    Trunk vsans (up)                       (1)
    Trunk vsans (isolated)                 ()
    Trunk vsans (initializing)             ()
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      0 frames input, 0 bytes
        0 discards, 0 errors
      0 frames output, 0 bytes
        0 discards, 0 errors
    last clearing of "show interface" counters never
    Interface last changed at Mon Aug 31 14:23:21 2015

N5K96UP-1# sh fcns database

VSAN 1:
--------------------------------------------------------------------------
FCID        TYPE PWWN                    (VENDOR)        FC4-TYPE:FEATURE
--------------------------------------------------------------------------
0x8f0000    N     50:05:07:68:03:11:3c:11 (IBM)           scsi-fcp:target
0x8f0100    N     50:05:07:68:03:0d:3c:11 (IBM)           scsi-fcp:target
0x8f0200    N     50:05:07:68:03:05:3c:10 (IBM)           scsi-fcp:target
0x8f0300    N     50:05:07:68:03:09:3c:10 (IBM)           scsi-fcp:target
0x8f0400    N     50:05:07:68:03:05:3e:b3 (IBM)           scsi-fcp:target
0x8f0500    N     50:05:07:68:03:09:3e:b3 (IBM)           scsi-fcp:target
0x8f0700    N     50:05:07:68:03:11:3e:b3 (IBM)           scsi-fcp:target
0x8f0900    N     20:05:00:c0:dd:28:8b:56 (Qlogic)
0x8f0a00    N     20:04:00:c0:dd:28:8b:56 (Qlogic)
0x8f0b00    N     20:03:00:c0:dd:28:8b:56 (Qlogic)
0x8f0c00    N     50:01:43:80:28:ca:b5:e2 (HP)            scsi-fcp:init
0xca0000    N     10:00:40:f2:e9:87:9f:d9                 scsi-fcp:init
0xca0020    N     10:00:40:f2:e9:87:aa:81                 scsi-fcp:init
0xca0040    N     10:00:40:f2:e9:87:9e:89                 scsi-fcp:init

Total number of entries = 14

flogi database is ok but i don't see any LUN on the Vmware

please see screenshot from vmware in the attachment.

i want to know why i dont see LUN on the vmware or why counter is zero in interface VFC 102 ?

thanks

jihicks · ‎09-01-2015

Hi Mohammadreza,

Yes, I see you used "Quick Config" with Device Manager to zone, zoned by interface and switch WWN.

That is fine for a standalone switch and the devices connected to it.

You will need to zone these devices to whichever storage they need to see:

N5K96UP-1# sh fcoe database

-------------------------------------------------------------------------------
INTERFACE       FCID            PORT NAME               MAC ADDRESS
-------------------------------------------------------------------------------
vfc101          0xca0020        10:00:40:f2:e9:87:aa:81 40:f2:e9:87:aa:81
vfc102          0xca0040        10:00:40:f2:e9:87:9e:89 40:f2:e9:87:9e:89
vfc103          0xca0000        10:00:40:f2:e9:87:9f:d9 40:f2:e9:87:9f:d9

Zone using the "PORT NAMEs".

MDS Quick Config - Zoning

Best regards,

Jim

View solution in original post

jihicks · ‎08-31-2015

Hi Mohammadreza,

How about your zoning, do you have the host on the blade center zoned with storage?

Counters being zero is a little odd

Best regards,

Jim.

Mohammadreza Aminian · ‎09-01-2015

Dear Jihicks

Do I really need to do configuration zone on the MDS between Host and Storage?

please see configuration of MDS

rule 5 permit show feature environment
rule 4 permit show feature hardware
rule 3 permit show feature module
rule 2 permit show feature snmp
rule 1 permit show feature system
username admin password 5 $1$vI5/VKLH$h6Nfa0sTjmk0XEs6dxRnr0 role network-admin
no password strength-check
ip domain-lookup
ip host 172.20.16.246 172.20.16.246
aaa group server radius radius
snmp-server user admin network-admin auth md5 0x073f899d951d1aee6f460addededf71a priv 0x073f899d951d1aee6f460addededf71a localizedkey
snmp-server host 172.20.12.40 traps version 2c public udp-port 1163
snmp-server host 172.20.12.40 traps version 2c public udp-port 1164
snmp-server host 172.20.12.40 traps version 2c public udp-port 1167
fcdomain fcid database
vsan 1 wwn 50:05:07:68:03:11:3c:11 fcid 0x8f0000 dynamic
vsan 1 wwn 50:05:07:68:03:0d:3c:11 fcid 0x8f0100 dynamic
vsan 1 wwn 50:05:07:68:03:05:3c:10 fcid 0x8f0200 dynamic
vsan 1 wwn 50:05:07:68:03:09:3c:10 fcid 0x8f0300 dynamic
vsan 1 wwn 50:05:07:68:03:05:3e:b3 fcid 0x8f0400 dynamic
vsan 1 wwn 50:05:07:68:03:09:3e:b3 fcid 0x8f0500 dynamic
vsan 1 wwn 50:05:07:68:03:0d:3e:b3 fcid 0x8f0600 dynamic
vsan 1 wwn 50:05:07:68:03:11:3e:b3 fcid 0x8f0700 dynamic
vsan 1 wwn 21:00:00:24:ff:36:7e:85 fcid 0x8f0800 dynamic
vsan 1 wwn 20:05:00:c0:dd:28:8b:56 fcid 0x8f0900 dynamic
vsan 1 wwn 20:04:00:c0:dd:28:8b:56 fcid 0x8f0a00 dynamic
vsan 1 wwn 20:03:00:c0:dd:28:8b:56 fcid 0x8f0b00 dynamic

interface port-channel 1
channel mode active
switchport rate-mode dedicated

interface port-channel 2
switchport rate-mode dedicated
ip default-gateway 172.20.16.254
[7m--More--[m
line console
[7m--More--[m
boot kickstart bootflash:/m9100-s3ek9-kickstart-mz.5.0.1a.bin
boot system bootflash:/m9100-s3ek9-mz.5.0.1a.bin
interface fc1/1
switchport rate-mode dedicated
interface fc1/2
switchport rate-mode dedicated
interface fc1/3
interface fc1/4
interface fc1/5
interface fc1/6
interface fc1/7
interface fc1/8
interface fc1/9
interface fc1/10
interface fc1/11
interface fc1/12
interface fc1/13
interface fc1/14
interface fc1/15
interface fc1/16
interface fc1/17
interface fc1/18
interface fc1/19
interface fc1/20
interface fc1/21
interface fc1/22
interface fc1/23
interface fc1/24
interface fc1/25
interface fc1/26
interface fc1/27
interface fc1/28
interface fc1/29
interface fc1/30
interface fc1/31
interface fc1/32
interface fc1/33
interface fc1/34
interface fc1/35
interface fc1/36
interface fc1/37
[7m--More--[m
interface fc1/38
interface fc1/39
interface fc1/40
interface fc1/41
interface fc1/42
interface fc1/43
interface fc1/44
interface fc1/45
interface fc1/46
interface fc1/47
interface fc1/48
interface fc1/1
interface fc1/2
!Full Zone Database Section for vsan 1
zone name Z_FC1_14_FC1_3_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/3 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_14_FC1_4_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/4 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_14_FC1_5_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/5 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_14_FC1_6_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/6 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_14_FC1_7_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/7 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_14_FC1_8_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/8 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_14_FC1_9_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/9 swwn 20:00:00:2a:6a:bd:d0:88
[7m--More--[m

[K
zone name Z_FC1_14_FC1_10_V1 vsan 1
member interface fc1/14 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/10 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_3_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/3 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_4_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/4 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_5_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/5 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_6_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/6 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_7_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/7 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_8_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/8 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_9_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/9 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_47_FC1_10_V1 vsan 1
member interface fc1/47 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/10 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_3_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/3 swwn 20:00:00:2a:6a:bd:d0:88

[7m--More--[m
zone name Z_FC1_48_FC1_4_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/4 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_5_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/5 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_6_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/6 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_7_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/7 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_8_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/8 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_9_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/9 swwn 20:00:00:2a:6a:bd:d0:88

zone name Z_FC1_48_FC1_10_V1 vsan 1
member interface fc1/48 swwn 20:00:00:2a:6a:bd:d0:88
member interface fc1/10 swwn 20:00:00:2a:6a:bd:d0:88

zoneset name ZONESET_V1 vsan 1
    member Z_FC1_14_FC1_3_V1
    member Z_FC1_14_FC1_4_V1
    member Z_FC1_14_FC1_5_V1
    member Z_FC1_14_FC1_6_V1
    member Z_FC1_14_FC1_7_V1
    member Z_FC1_14_FC1_8_V1
    member Z_FC1_14_FC1_9_V1
    member Z_FC1_14_FC1_10_V1
    member Z_FC1_47_FC1_3_V1
    member Z_FC1_47_FC1_4_V1
    member Z_FC1_47_FC1_5_V1
    member Z_FC1_47_FC1_6_V1
    member Z_FC1_47_FC1_7_V1
    member Z_FC1_47_FC1_8_V1
    member Z_FC1_47_FC1_9_V1
    member Z_FC1_47_FC1_10_V1
    member Z_FC1_48_FC1_3_V1
    member Z_FC1_48_FC1_4_V1
    member Z_FC1_48_FC1_5_V1
    member Z_FC1_48_FC1_6_V1
    member Z_FC1_48_FC1_7_V1
    member Z_FC1_48_FC1_8_V1
    member Z_FC1_48_FC1_9_V1
    member Z_FC1_48_FC1_10_V1

zoneset activate name ZONESET_V1 vsan 1

interface fc1/1
port-license acquire
channel-group 1 force
no shutdown

interface fc1/2
port-license acquire
channel-group 1 force
no shutdown

interface fc1/3
port-license acquire
no shutdown

interface fc1/4
port-license acquire
no shutdown

interface fc1/5
port-license acquire
no shutdown

interface fc1/6
port-license acquire
no shutdown

[7m--More--[m
interface fc1/7
port-license acquire
no shutdown

interface fc1/8
port-license acquire
no shutdown

interface fc1/9
port-license acquire
no shutdown

interface fc1/10
port-license acquire
no shutdown

interface fc1/11
port-license acquire
no shutdown

interface fc1/12
port-license acquire
no shutdown

interface fc1/13
port-license acquire
no shutdown

interface fc1/14
port-license acquire
no shutdown

interface fc1/15
port-license acquire
no shutdown

interface fc1/16
port-license acquire
no shutdown

interface fc1/17
[7m--More--[m
port-license acquire
no shutdown

interface fc1/18
port-license acquire
no shutdown

interface fc1/19
port-license acquire

interface fc1/20
port-license acquire

interface fc1/21
port-license acquire

interface fc1/22
port-license acquire

interface fc1/23
port-license acquire

interface fc1/24
port-license acquire

interface fc1/25
port-license acquire

interface fc1/26
port-license acquire

interface fc1/27
port-license acquire

interface fc1/28
port-license acquire

interface fc1/29
port-license acquire

interface fc1/30
[7m--More--[m
port-license acquire

interface fc1/31
port-license acquire

interface fc1/32
port-license acquire

interface fc1/33
port-license acquire

interface fc1/34
port-license acquire

interface fc1/35
port-license acquire

interface fc1/36
port-license acquire

interface fc1/37
port-license acquire

interface fc1/38
port-license acquire

interface fc1/39
port-license acquire

interface fc1/40
port-license acquire

interface fc1/41
port-license acquire

interface fc1/42
port-license acquire

interface fc1/43
port-license acquire
no shutdown
[7m--More--[m

[K
interface fc1/44
port-license acquire

interface fc1/45
port-license acquire

interface fc1/46
port-license acquire

interface fc1/47 ----> Nexus 5K
port-license acquire
channel-group 2 force
no shutdown

interface fc1/48 ----> Nexus 5K
port-license acquire
channel-group 2 force
no shutdown

interface mgmt0
ip address 172.20.16.246 255.255.255.0

switch#

many thanks

jihicks · ‎09-01-2015

Hi Mohammadreza,

Yes, I see you used "Quick Config" with Device Manager to zone, zoned by interface and switch WWN.

That is fine for a standalone switch and the devices connected to it.

You will need to zone these devices to whichever storage they need to see:

N5K96UP-1# sh fcoe database

-------------------------------------------------------------------------------
INTERFACE       FCID            PORT NAME               MAC ADDRESS
-------------------------------------------------------------------------------
vfc101          0xca0020        10:00:40:f2:e9:87:aa:81 40:f2:e9:87:aa:81
vfc102          0xca0040        10:00:40:f2:e9:87:9e:89 40:f2:e9:87:9e:89
vfc103          0xca0000        10:00:40:f2:e9:87:9f:d9 40:f2:e9:87:9f:d9

Zone using the "PORT NAMEs".

MDS Quick Config - Zoning

Best regards,

Jim

Mohammadreza Aminian · ‎09-02-2015

Hi Jihicks

thanks your support . I could use your help for solved this issue .

but i have little problem. the speed between blade and storage is very slow ,less than 1Mbps. Do Low speed is because of the QOS settings or Something else.

many thanks

jihicks · ‎09-02-2015

Hi Mohammadreza

Looks like you have a port-channel between the N5K and the N4K.

Try this command as a test to see if it fixes the throughput problem.

N5K(config)# port-channel load-balance ethernet source-dest-port <-- Default is src/dst mac. This way, only one link will be utilized, which is why we change it to src/dst port.

Best regards,

Jim

Mohammadreza Aminian · ‎09-05-2015

hi jim

thanks for your support.

I did change that you said , i did port-channel between the N5K and the N4K.

But still have problems. This scenario is not now under operation.sometime traffic between esxi and storage is good but This relation is suddenly interrupted or slow speed.i think this issue is due to qos or jumbo frame.please tell your comment.

many thanks

jihicks · ‎09-08-2015

Hi Mohammadreza,

Please take a look at Bug ID CSCts95953:

https://tools.cisco.com/bugsearch/bug/CSCts95953

This is a bug where the system QOS is not being applied to the port-channel and the workaround is to apply it directly to the port-channel but this is quite old.

Please look at each of these:

CSCts56466    N4k: Uplink interfaces err-disable with fix of CSCtq71652 ...
CSCtq71652    N4k stops processing FIP when it receives excessive pause frames
CSCtx34517    PFC frames increasing RX PAUSE counter for all Queues
CSCue18865    Auto-recovery on server ports err-disable
CSCty66618    FIP snooping stops working after some time
CSCts95953    System Queuing Policy does not get applied to port-channel

Best regards,

Jim

Mohammadreza Aminian · ‎09-22-2015

Hi Jim

thanks you for support .your previous post was very helpful.

I've changed the configuration in the 4k please see the attachment .each Blade has two nexus 4k and two 4K connect one 5k.window server in a blade see LUN of storage and also attach to disk in the windows but i have a problem in the transferring file to storage please see attachment also i have a problem with Esxi in the others blades .they see LUNs on both path but i could not add to storage of Esxi .

also i see on interface connect to cna adaptor this error

Rx
    81256318 input packets 81237230 unicast packets 17730 multicast packets
    1352 broadcast packets 77204828 jumbo packets 0 storm suppression packets
    164668129378 bytes
    22 Rx pause
    510 input discard

please help me about this problem

FCoE Problem on Nexus 5k