FCoE Northbound Connectivity ISSUES - Page 2

marco.mosangini · ‎04-03-2013

Hi all,

i've configured this topology for Ethernet and FCoE uplink from 6248UP to 5548UP:

When i check flogi database from n5k the result is:

n5kA --> no vfc to 6248A was logged
n5kB --> vfc to 6248B is up and running

This is sh int vfc21 (n5kA FCoE Po to 6248A):

vfc21 is down (Initializing)

Bound interface is port-channel21

Hardware is Ethernet

Port WWN is 20:14:54:7f:ee:b2:fa:7f

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port vsan is 101

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

0 frames input, 0 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

This is sh int vfc22 (n5kB FCoE Po to 6248A):

vfc22 is trunking

Bound interface is port-channel22

Hardware is Ethernet

Port WWN is 20:15:54:7f:ee:af:49:bf

Admin port mode is F, trunk mode is on

snmp link state traps are enabled

Port mode is TF

Port vsan is 102

Trunk vsans (admin allowed and active) (102)

Trunk vsans (up) (102)

Trunk vsans (isolated) ()

Trunk vsans (initializing) ()

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

740 frames input, 73824 bytes

0 discards, 648 errors

759 frames output, 132936 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

Interface last changed at Wed Apr 3 09:32:57 2013

This is sh ru int vfc755 (6248A FCoE Po to n5kA):

vfc755 is trunking (Not all VSANs UP on the trunk)

Bound interface is port-channel21

Hardware is Virtual Fibre Channel

Port WWN is 22:f2:54:7f:ee:aa:cf:3f

Admin port mode is NP, trunk mode is on

snmp link state traps are enabled

Port mode is TNP

Port vsan is 101

Trunk vsans (admin allowed and active) (1,101)

Trunk vsans (up) ()

Trunk vsans (isolated) ()

Trunk vsans (initializing) (1,101)

1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

0 frames input, 0 bytes

0 discards, 0 errors

0 frames output, 0 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

Interface last changed at Wed Apr 3 19:53:21 2013

This is sh ru int vfc756 (6248B FCoE Po to n5kB):

vfc756 is trunking (Not all VSANs UP on the trunk)

Bound interface is port-channel22

Hardware is Virtual Fibre Channel

Port WWN is 22:f3:54:7f:ee:aa:d2:3f

Admin port mode is NP, trunk mode is on

snmp link state traps are enabled

Port mode is TNP

Port vsan is 102

Trunk vsans (admin allowed and active) (1,102)

Trunk vsans (up) (102)

Trunk vsans (isolated) ()

Trunk vsans (initializing) (1)

1 minute input rate 8 bits/sec, 1 bytes/sec, 0 frames/sec

1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec

1187 frames input, 163868 bytes

0 discards, 0 errors

1930 frames output, 202972 bytes

0 discards, 0 errors

last clearing of "show interface" counters never

Interface last changed at Wed Apr 3 07:22:45 2013

Could someone help me solving this painful issue??

Thanks

marco.mosangini · ‎04-05-2013

This was the output from N5KA and B (swp01201 is N5KA swp01202 is N5KB):

swp01201# show run int e2/11-12

!Command: show running-config interface Ethernet2/11-12

!Time: Fri Apr 5 17:05:57 2013

version 6.0(2)N1(2)

interface Ethernet2/11

description -- mgp01200A Eth1/27 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 101

channel-group 21 mode active

interface Ethernet2/12

description -- mgp01200A Eth1/28 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 101

channel-group 21 mode active

swp01201# show int e2/11-12

Ethernet2/11 is up

Dedicated Interface

Belongs to Po21

Hardware: 1000/10000 Ethernet, address: 547f.eeb0.dc0a (bia 547f.eeb0.dc0a)

Description: -- mgp01200A Eth1/27 (Cisco UCS FI 6248UP) --

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 02:29:47

Last clearing of "show interface" counters never

4 interface resets

30 seconds input rate 120 bits/sec, 0 packets/sec

30 seconds output rate 1168 bits/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 144 bps, 0 pps; output rate 520 bps, 0 pps

RX

0 unicast packets 2348 multicast packets 0 broadcast packets

2348 input packets 540429 bytes

0 jumbo packets 0 storm suppression bytes

0 runts 0 giants 0 CRC 0 no buffer

0 input error 0 short frame 0 overrun 0 underrun 0 ignored

0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

1721 unicast packets 5772 multicast packets 0 broadcast packets

7493 output packets 4611803 bytes

1721 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble 0 output discard

0 Tx pause

Ethernet2/12 is up

Dedicated Interface

Belongs to Po21

Hardware: 1000/10000 Ethernet, address: 547f.eeb0.dc0b (bia 547f.eeb0.dc0b)

Description: -- mgp01200A Eth1/28 (Cisco UCS FI 6248UP) --

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 02:29:47

Last clearing of "show interface" counters never

4 interface resets

30 seconds input rate 120 bits/sec, 0 packets/sec

30 seconds output rate 104 bits/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 208 bps, 0 pps; output rate 160 bps, 0 pps

RX

0 unicast packets 5794 multicast packets 0 broadcast packets

5794 input packets 761442 bytes

0 jumbo packets 0 storm suppression bytes

0 runts 0 giants 0 CRC 0 no buffer

0 input error 0 short frame 0 overrun 0 underrun 0 ignored

0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

1 unicast packets 2363 multicast packets 0 broadcast packets

2364 output packets 589812 bytes

1 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble 0 output discard

0 Tx pause

swp01201# show vsan database

^

% Invalid command at '^' marker.

swp01201# show vsan ?

<1-4094> VSAN id range

> Redirect it to a file

>> Redirect it to a file in append mode

internal Show various event logs of VSAN Mgr

membership Show membership information

usage Show vsan usage in the system

| Pipe command output to filter

swp01201# show vsan usage

2 vsan configured

configured vsans:1,101

vsans available for configuration:2-100,102-4078,4080-4093

swp01201# show flogi database

--------------------------------------------------------------------------------

INTERFACE VSAN FCID PORT NAME NODE NAME

--------------------------------------------------------------------------------

fc2/16 101 0x1c0020 50:03:08:c3:8c:83:50:01 50:03:08:c3:8c:83:50:00

[Quantum-i40-1]

Total number of flogi = 1.

This are the N5KA and B confs:

!Command: show running-config

!Time: Fri Apr 5 17:09:12 2013

version 6.0(2)N1(2)

feature fcoe

hostname swp01201

feature npiv

feature fport-channel-trunk

feature telnet

cfs eth distribute

feature interface-vlan

feature hsrp

feature lacp

feature vpc

feature lldp

logging level flogi 5

no password strength-check

ip domain-lookup

logging event link-status default

class-map type qos class-fcoe

class-map type queuing class-fcoe

match qos-group 1

class-map type queuing class-all-flood

match qos-group 2

class-map type queuing class-ip-multicast

match qos-group 2

class-map type network-qos class-fcoe

match qos-group 1

class-map type network-qos class-all-flood

match qos-group 2

class-map type network-qos class-ip-multicast

match qos-group 2

policy-map type network-qos jumbo

class type network-qos class-fcoe

pause no-drop

mtu 2158

class type network-qos class-default

mtu 9000

multicast-optimize

system qos

service-policy type qos input fcoe-default-in-policy

service-policy type queuing input fcoe-default-in-policy

service-policy type queuing output fcoe-default-out-policy

service-policy type network-qos fcoe-default-nq-policy

control-plane

service-policy input copp-system-policy-customized

slot 1

slot 2

port 13-16 type fc

snmp-server user admin network-admin auth md5 0x00b24de1ed629c0b8cb2cbd016993285 priv 0x00b24de1ed629c0b8cb2cbd016993285 localizedkey

ntp server 172.16.4.10 use-vrf management

ntp server 172.16.4.11 use-vrf management

aaa authentication login default group AD local

vrf context PIPPO

ip route 0.0.0.0/0 172.16.3.254

vrf context management

ip domain-name lab.lan

ip name-server 172.16.4.10 172.16.4.11

ip route 0.0.0.0/0 172.16.2.254

vlan 1-2

vlan 101

fcoe vsan 101

name TST_FCOE_FABRIC_A

vlan 1000

name TST_MIR_TEST

vlan 1722

name TST_INT_MGMT

vlan 1723

name TST_INT_VRF

vlan 1724

name TST_INT_SRV

vlan 4048

fcoe vsan 1

name FCOE_NATIVE_VSAN

vlan 4065

name TST_PRIV_CONTROL

vlan 4066

name TST_PRIV_PACKETS

vlan 4070

name TST_PRIV_NFS

vlan 4081

name TST_PRIV_ISCSI_1

vlan 4082

name TST_PRIV_ISCSI_2

vlan 4090

name TST_PRIV_VMOTION

spanning-tree port type edge bpduguard default

spanning-tree port type edge bpdufilter default

spanning-tree port type network default

vpc domain 10

role priority 10

peer-keepalive destination 172.16.2.242 source 172.16.2.241

delay restore 150

port-profile default max-ports 512

vsan database

vsan 101 name "FABRIC_A"

device-alias database

device-alias name Quantum-i40-1 pwwn 50:03:08:c3:8c:83:50:01

device-alias name srp01201-vmhba1 pwwn 20:00:00:25:b5:aa:00:0f

device-alias name srp01202-vmhba1 pwwn 20:00:00:25:b5:aa:00:1f

device-alias commit

fcdomain fcid database

vsan 101 wwn 22:f2:54:7f:ee:aa:cf:3f fcid 0x1c0000 dynamic

vsan 101 wwn 20:00:00:25:b5:aa:00:0f fcid 0x1c0001 dynamic

! [srp01201-vmhba1]

vsan 101 wwn 50:03:08:c3:8c:83:50:01 fcid 0x1c0020 dynamic

! [Quantum-i40-1]

vsan 101 wwn 20:00:00:25:b5:aa:00:1f fcid 0x1c0002 dynamic

! [srp01202-vmhba1]

vsan 101 wwn 20:00:00:25:b5:aa:00:0e fcid 0x1c0003 dynamic

vsan 101 wwn 20:00:00:25:b5:aa:00:1e fcid 0x1c0004 dynamic

interface Vlan1

interface Vlan1723

description TST VRF TO FW

no shutdown

vrf member PIPPO

ip address 172.16.3.252/24

hsrp version 2

hsrp 1723

preempt

priority 200

ip 172.16.3.253

interface Vlan1724

description TST SERVER

no shutdown

vrf member PIPPO

ip address 172.16.4.253/24

hsrp version 2

hsrp 1724

preempt

priority 200

ip 172.16.4.254

interface port-channel1

description -- VPC fwp01201A (Fortinet Fortigate 200B) --

switchport mode trunk

spanning-tree port type edge trunk

speed 1000

interface port-channel2

description -- VPC fwp01201B (Fortinet Fortigate 200B) --

interface port-channel10

description -- VPC PEER LINK --

switchport mode trunk

spanning-tree port type network

vpc peer-link

interface port-channel11

description -- VPC stp01201 (Netapp FAS2240-4) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 11

interface port-channel12

description -- VPC stp01202 (Netapp FAS2240-4) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 12

interface port-channel13

description -- VPC mgp01200A (Cisco UCS FI 6248UP) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 13

interface port-channel14

description -- VPC mgp01200B (Cisco UCS FI 6248UP) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 14

interface port-channel15

description -- VPC swp01203 (Cisco Catalyst 2960S) --

switchport mode trunk

spanning-tree port type normal

speed 1000

vpc 15

interface port-channel16

description -- VPC stp01210 (Netgear ReadyNAS 3200) --

switchport access vlan 1724

spanning-tree port type edge

speed 1000

vpc 16

interface port-channel21

description -- mgp01200A (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 101

spanning-tree port type edge trunk

spanning-tree bpdufilter enable

interface vfc21

bind interface port-channel21

switchport trunk allowed vsan 101

switchport description -- mgp01200A (Cisco UCS FI 6248UP) --

no shutdown

vsan database

vsan 101 interface vfc21

vsan 101 interface fc2/15

vsan 101 interface fc2/16

interface fc2/13

interface fc2/14

interface fc2/15

interface fc2/16

no shutdown

interface Ethernet1/1

description -- stp01201 e1a (Netapp FAS2240-4) --

switchport mode trunk

channel-group 11 mode active

interface Ethernet1/2

description -- stp01202 e1a (Netapp FAS2240-4) --

switchport mode trunk

channel-group 12 mode active

interface Ethernet1/3

description -- mgp01200A Eth1/19 (Cisco UCS FI 6248UP) --

switchport mode trunk

channel-group 13 mode active

interface Ethernet1/4

description -- mgp01200B Eth1/19 (Cisco UCS FI 6248UP) --

switchport mode trunk

channel-group 14 mode active

interface Ethernet1/5

description -- swp01202 Eth1/5 (Cisco Nexus 5548UP) --

switchport mode trunk

channel-group 10 mode active

interface Ethernet1/6

description -- swp01202 Eth1/6 (Cisco Nexus 5548UP) --

switchport mode trunk

channel-group 10 mode active

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

description -- stp01210 eth0 (Netgear ReadyNAS 3200) --

switchport access vlan 1724

speed 1000

channel-group 16 mode active

interface Ethernet1/16

interface Ethernet1/17

description -- swp01203A Gi1/11 (Cisco Catalyst 2960S) --

switchport mode trunk

speed 1000

channel-group 15 mode active

interface Ethernet1/18

description -- swp01203B Gi1/11 (Cisco Catalyst 2960S) --

switchport mode trunk

speed 1000

channel-group 15 mode active

interface Ethernet1/19

interface Ethernet1/20

interface Ethernet1/21

description -- fw01201A port13 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/22

description -- fw01201A port14 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/23

description -- fw01201B port15 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/24

description -- fw01201B port16 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30

interface Ethernet1/31

interface Ethernet1/32

interface Ethernet2/1

interface Ethernet2/2

interface Ethernet2/3

interface Ethernet2/4

interface Ethernet2/5

interface Ethernet2/6

interface Ethernet2/7

interface Ethernet2/8

interface Ethernet2/9

interface Ethernet2/10

interface Ethernet2/11

description -- mgp01200A Eth1/27 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 101

channel-group 21 mode active

interface Ethernet2/12

description -- mgp01200A Eth1/28 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 101

channel-group 21 mode active

interface mgmt0

vrf member management

ip address 172.16.2.241/24

clock timezone CET 1 0

clock summer-time CET 5 Sun Mar 02:00 5 Sun Oct 03:00 60

line console

line vty

exec-timeout 15

boot kickstart bootflash:/n5000-uk9-kickstart.6.0.2.N1.2.bin

boot system bootflash:/n5000-uk9.6.0.2.N1.2.bin

interface fc2/15

interface fc2/16

interface fc2/13

interface fc2/14

interface fc2/15

interface fc2/16

!Full Zone Database Section for vsan 101

zone name Tape-Area-Network vsan 101

member pwwn 50:03:08:c3:8c:83:50:01

! [Quantum-i40-1]

member pwwn 20:00:00:25:b5:aa:00:0f

! [srp01201-vmhba1]

member pwwn 20:00:00:25:b5:aa:00:1f

! [srp01202-vmhba1]

zone name TAN vsan 101

zoneset name TAN vsan 101

member Tape-Area-Network

zoneset activate name TAN vsan 101

!Command: show running-config

!Time: Fri Apr 5 17:09:28 2013

version 6.0(2)N1(2)

feature fcoe

hostname swp01202

feature npiv

feature fport-channel-trunk

feature telnet

cfs eth distribute

feature interface-vlan

feature hsrp

feature lacp

feature vpc

feature lldp

logging level flogi 5

no password strength-check

ip domain-lookup

logging event link-status default

class-map type qos class-fcoe

class-map type queuing class-fcoe

match qos-group 1

class-map type queuing class-all-flood

match qos-group 2

class-map type queuing class-ip-multicast

match qos-group 2

class-map type network-qos class-fcoe

match qos-group 1

class-map type network-qos class-all-flood

match qos-group 2

class-map type network-qos class-ip-multicast

match qos-group 2

policy-map type network-qos jumbo

class type network-qos class-fcoe

pause no-drop

mtu 2158

class type network-qos class-default

mtu 9000

multicast-optimize

system qos

service-policy type qos input fcoe-default-in-policy

service-policy type queuing input fcoe-default-in-policy

service-policy type queuing output fcoe-default-out-policy

service-policy type network-qos fcoe-default-nq-policy

policy-map type control-plane copp-system-policy-customized

class copp-system-class-hsrp-vrrp

police cir 1024 kbps bc 256000 bytes

class copp-system-class-l3dest-miss

police cir 64 kbps bc 16000 bytes

control-plane

service-policy input copp-system-policy-customized

slot 1

slot 2

port 13-16 type fc

snmp-server user admin network-admin auth md5 0x6c6734dd7ef798d74d574992557b2b1d priv 0x6c6734dd7ef798d74d574992557b2b1d localizedkey

ntp server 172.16.4.10 use-vrf management

ntp server 172.16.4.11 use-vrf management

aaa authentication login default group AD local

vrf context PIPPO

ip route 0.0.0.0/0 172.16.3.254

vrf context management

ip domain-name lab.lan

ip name-server 172.16.4.10 172.16.4.11

ip route 0.0.0.0/0 172.16.2.254

vlan 1-2

vlan 102

fcoe vsan 102

name TST_FCOE_FABRIC_B

vlan 1000

name TST_MIR_TEST

vlan 1722

name TST_INT_MGMT

vlan 1723

name TST_INT_VRF

vlan 1724

name TST_INT_SRV

vlan 4048

fcoe vsan 1

name FCOE_NATIVE_VSAN

vlan 4065

name TST_PRIV_CONTROL

vlan 4066

name TST_PRIV_PACKETS

vlan 4070

name TST_PRIV_NFS

vlan 4081

name TST_PRIV_ISCSI_1

vlan 4082

name TST_PRIV_ISCSI_2

vlan 4090

name TST_PRIV_VMOTION

spanning-tree port type edge bpduguard default

spanning-tree port type edge bpdufilter default

spanning-tree port type network default

vpc domain 10

role priority 20

peer-keepalive destination 172.16.2.241 source 172.16.2.242

delay restore 150

port-profile default max-ports 512

vsan database

vsan 102 name "FABRIC_B"

device-alias database

device-alias name Quantum-i40-1 pwwn 50:03:08:c3:8c:83:50:01

device-alias name srp01201-vmhba2 pwwn 20:00:00:25:b5:bb:00:0f

device-alias name srp01202-vmhba2 pwwn 20:00:00:25:b5:bb:00:1f

device-alias commit

fcdomain fcid database

vsan 102 wwn 24:03:54:7f:ee:aa:d2:00 fcid 0x0f0000 dynamic

vsan 102 wwn 20:00:00:25:b5:bb:00:0f fcid 0x0f0001 dynamic

! [srp01201-vmhba2]

vsan 102 wwn 20:00:00:25:b5:bb:00:1f fcid 0x0f0002 dynamic

! [srp01202-vmhba2]

vsan 102 wwn 20:00:00:25:b5:bb:00:0e fcid 0x0f0003 dynamic

vsan 102 wwn 20:00:00:25:b5:bb:00:1e fcid 0x0f0004 dynamic

vsan 102 wwn 22:f3:54:7f:ee:aa:d2:3f fcid 0x0f0040 dynamic

vsan 102 wwn 50:03:08:c3:8c:83:50:01 fcid 0x0f0080 dynamic

! [Quantum-i40-1]

interface Vlan1

interface Vlan1723

description TST VRF TO FW

no shutdown

vrf member PIPPO

ip address 172.16.3.251/24

hsrp version 2

hsrp 1723

ip 172.16.3.253

interface Vlan1724

description TST SERVER

no shutdown

vrf member PIPPO

ip address 172.16.4.252/24

hsrp version 2

hsrp 1724

ip 172.16.4.254

interface port-channel1

description -- VPC fwp01201A (Fortinet Fortigate 200B) --

switchport mode trunk

spanning-tree port type edge trunk

speed 1000

interface port-channel2

description -- VPC fwp01201B (Fortinet Fortigate 200B) --

interface port-channel10

description -- VPC PEER LINK --

switchport mode trunk

spanning-tree port type network

vpc peer-link

interface port-channel11

description -- VPC stp01201 (Netapp FAS2240-4) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 11

interface port-channel12

description -- VPC stp01202 (Netapp FAS2240-4) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 12

interface port-channel13

description -- VPC mgp01200A (Cisco UCS FI 6248UP) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 13

interface port-channel14

description -- VPC mgp01200B (Cisco UCS FI 6248UP) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 14

interface port-channel15

description -- VPC swp01203 (Cisco Catalyst 2960S) --

switchport mode trunk

spanning-tree port type normal

speed 1000

vpc 15

interface port-channel16

description -- VPC stp01210 (Netgear ReadyNAS 3200) --

switchport access vlan 1724

spanning-tree port type edge

speed 1000

vpc 16

interface port-channel22

description -- mgp01200B (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 102

spanning-tree port type edge trunk

spanning-tree bpdufilter enable

interface vfc22

bind interface port-channel22

switchport trunk allowed vsan 102

switchport description -- mgp01200B (Cisco UCS FI 6248UP) --

no shutdown

vsan database

vsan 102 interface vfc22

vsan 102 interface fc2/15

vsan 102 interface fc2/16

interface fc2/13

interface fc2/14

interface fc2/15

interface fc2/16

no shutdown

interface Ethernet1/1

description -- stp01201 e1b (Netapp FAS2240-4) --

switchport mode trunk

channel-group 11 mode active

interface Ethernet1/2

description -- stp01202 e1b (Netapp FAS2240-4) --

switchport mode trunk

channel-group 12 mode active

interface Ethernet1/3

description -- mgp01200A Eth1/20 (Cisco UCS FI 6248UP) --

switchport mode trunk

channel-group 13 mode active

interface Ethernet1/4

description -- mgp01200B Eth1/20 (Cisco UCS FI 6248UP) --

switchport mode trunk

channel-group 14 mode active

interface Ethernet1/5

description -- swp01201 Eth1/5 (Cisco Nexus 5548UP) --

switchport mode trunk

channel-group 10 mode active

interface Ethernet1/6

description -- swp01201 Eth1/6 (Cisco Nexus 5548UP) --

switchport mode trunk

channel-group 10 mode active

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

description -- stp01210 eth1 (Netgear ReadyNAS 3200) --

switchport access vlan 1724

speed 1000

channel-group 16 mode active

interface Ethernet1/16

interface Ethernet1/17

description -- swp01203A Gi1/12 (Cisco Catalyst 2960S) --

switchport mode trunk

speed 1000

channel-group 15 mode active

interface Ethernet1/18

description -- swp01203B Gi1/12 (Cisco Catalyst 2960S) --

switchport mode trunk

speed 1000

channel-group 15 mode active

interface Ethernet1/19

interface Ethernet1/20

interface Ethernet1/21

description -- fw01201B port13 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/22

description -- fw01201B port14 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/23

description -- fw01201A port15 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/24

description -- fw01201A port16 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30

interface Ethernet1/31

interface Ethernet1/32

interface Ethernet2/1

interface Ethernet2/2

interface Ethernet2/3

interface Ethernet2/4

interface Ethernet2/5

interface Ethernet2/6

interface Ethernet2/7

interface Ethernet2/8

interface Ethernet2/9

interface Ethernet2/10

interface Ethernet2/11

description -- mgp01200B Eth1/27 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 102

channel-group 22 mode active

interface Ethernet2/12

description -- mgp01200B Eth1/28 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 102

channel-group 22 mode active

interface mgmt0

vrf member management

ip address 172.16.2.242/24

clock timezone CET 1 0

clock summer-time CET 5 Sun Mar 02:00 5 Sun Oct 03:00 60

line console

line vty

exec-timeout 15

boot kickstart bootflash:/n5000-uk9-kickstart.6.0.2.N1.2.bin

boot system bootflash:/n5000-uk9.6.0.2.N1.2.bin

interface fc2/15

interface fc2/16

interface fc2/13

interface fc2/14

interface fc2/15

interface fc2/16

!Full Zone Database Section for vsan 102

zone name Tape-Area-Network vsan 102

member pwwn 50:03:08:c3:8c:83:50:01

! [Quantum-i40-1]

member pwwn 20:00:00:25:b5:bb:00:0f

! [srp01201-vmhba2]

member pwwn 20:00:00:25:b5:bb:00:1f

! [srp01202-vmhba2]

zone name TAN vsan 102

zoneset name TAN vsan 102

member Tape-Area-Network

zoneset activate name TAN vsan 102

!Command: show running-config

!Time: Fri Apr 5 17:09:28 2013

version 6.0(2)N1(2)

feature fcoe

hostname swp01202

feature npiv

feature fport-channel-trunk

feature telnet

cfs eth distribute

feature interface-vlan

feature hsrp

feature lacp

feature vpc

feature lldp

logging level flogi 5

no password strength-check

ip domain-lookup

radius-server host bdc.lab.lan key 7 "vst01202k3mw3p" authentication accounting

radius-server host pdc.lab.lan key 7 "vst01202k3mw3p" authentication accounting

aaa group server radius AD

server pdc.lab.lan

server bdc.lab.lan

use-vrf management

logging event link-status default

class-map type qos class-fcoe

class-map type queuing class-fcoe

match qos-group 1

class-map type queuing class-all-flood

match qos-group 2

class-map type queuing class-ip-multicast

match qos-group 2

class-map type network-qos class-fcoe

match qos-group 1

class-map type network-qos class-all-flood

match qos-group 2

class-map type network-qos class-ip-multicast

match qos-group 2

policy-map type network-qos jumbo

class type network-qos class-fcoe

pause no-drop

mtu 2158

class type network-qos class-default

mtu 9000

multicast-optimize

system qos

service-policy type qos input fcoe-default-in-policy

service-policy type queuing input fcoe-default-in-policy

service-policy type queuing output fcoe-default-out-policy

service-policy type network-qos fcoe-default-nq-policy

policy-map type control-plane copp-system-policy-customized

class copp-system-class-hsrp-vrrp

police cir 1024 kbps bc 256000 bytes

class copp-system-class-l3dest-miss

police cir 64 kbps bc 16000 bytes

control-plane

service-policy input copp-system-policy-customized

slot 1

slot 2

port 13-16 type fc

snmp-server user admin network-admin auth md5 0x6c6734dd7ef798d74d574992557b2b1d priv 0x6c6734dd7ef798d74d574992557b2b1d localizedkey

ntp server 172.16.4.10 use-vrf management

ntp server 172.16.4.11 use-vrf management

aaa authentication login default group AD local

vrf context PIPPO

ip route 0.0.0.0/0 172.16.3.254

vrf context management

ip domain-name lab.lan

ip name-server 172.16.4.10 172.16.4.11

ip route 0.0.0.0/0 172.16.2.254

vlan 1-2

vlan 102

fcoe vsan 102

name TST_FCOE_FABRIC_B

vlan 1000

name TST_MIR_TEST

vlan 1722

name TST_INT_MGMT

vlan 1723

name TST_INT_VRF

vlan 1724

name TST_INT_SRV

vlan 4048

fcoe vsan 1

name FCOE_NATIVE_VSAN

vlan 4065

name TST_PRIV_CONTROL

vlan 4066

name TST_PRIV_PACKETS

vlan 4070

name TST_PRIV_NFS

vlan 4081

name TST_PRIV_ISCSI_1

vlan 4082

name TST_PRIV_ISCSI_2

vlan 4090

name TST_PRIV_VMOTION

spanning-tree port type edge bpduguard default

spanning-tree port type edge bpdufilter default

spanning-tree port type network default

vpc domain 10

role priority 20

peer-keepalive destination 172.16.2.241 source 172.16.2.242

delay restore 150

port-profile default max-ports 512

vsan database

vsan 102 name "FABRIC_B"

device-alias database

device-alias name Quantum-i40-1 pwwn 50:03:08:c3:8c:83:50:01

device-alias name srp01201-vmhba2 pwwn 20:00:00:25:b5:bb:00:0f

device-alias name srp01202-vmhba2 pwwn 20:00:00:25:b5:bb:00:1f

device-alias commit

fcdomain fcid database

vsan 102 wwn 24:03:54:7f:ee:aa:d2:00 fcid 0x0f0000 dynamic

vsan 102 wwn 20:00:00:25:b5:bb:00:0f fcid 0x0f0001 dynamic

! [srp01201-vmhba2]

vsan 102 wwn 20:00:00:25:b5:bb:00:1f fcid 0x0f0002 dynamic

! [srp01202-vmhba2]

vsan 102 wwn 20:00:00:25:b5:bb:00:0e fcid 0x0f0003 dynamic

vsan 102 wwn 20:00:00:25:b5:bb:00:1e fcid 0x0f0004 dynamic

vsan 102 wwn 22:f3:54:7f:ee:aa:d2:3f fcid 0x0f0040 dynamic

vsan 102 wwn 50:03:08:c3:8c:83:50:01 fcid 0x0f0080 dynamic

! [Quantum-i40-1]

interface Vlan1

interface Vlan1723

description TST VRF TO FW

no shutdown

vrf member PIPPO

ip address 172.16.3.251/24

hsrp version 2

hsrp 1723

ip 172.16.3.253

interface Vlan1724

description TST SERVER

no shutdown

vrf member PIPPO

ip address 172.16.4.252/24

hsrp version 2

hsrp 1724

ip 172.16.4.254

interface port-channel1

description -- VPC fwp01201A (Fortinet Fortigate 200B) --

switchport mode trunk

spanning-tree port type edge trunk

speed 1000

interface port-channel2

description -- VPC fwp01201B (Fortinet Fortigate 200B) --

interface port-channel10

description -- VPC PEER LINK --

switchport mode trunk

spanning-tree port type network

vpc peer-link

interface port-channel11

description -- VPC stp01201 (Netapp FAS2240-4) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 11

interface port-channel12

description -- VPC stp01202 (Netapp FAS2240-4) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 12

interface port-channel13

description -- VPC mgp01200A (Cisco UCS FI 6248UP) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 13

interface port-channel14

description -- VPC mgp01200B (Cisco UCS FI 6248UP) --

switchport mode trunk

spanning-tree port type edge trunk

vpc 14

interface port-channel15

description -- VPC swp01203 (Cisco Catalyst 2960S) --

switchport mode trunk

spanning-tree port type normal

speed 1000

vpc 15

interface port-channel16

description -- VPC stp01210 (Netgear ReadyNAS 3200) --

switchport access vlan 1724

spanning-tree port type edge

speed 1000

vpc 16

interface port-channel22

description -- mgp01200B (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 102

spanning-tree port type edge trunk

spanning-tree bpdufilter enable

interface vfc22

bind interface port-channel22

switchport trunk allowed vsan 102

switchport description -- mgp01200B (Cisco UCS FI 6248UP) --

no shutdown

vsan database

vsan 102 interface vfc22

vsan 102 interface fc2/15

vsan 102 interface fc2/16

interface fc2/13

interface fc2/14

interface fc2/15

interface fc2/16

no shutdown

interface Ethernet1/1

description -- stp01201 e1b (Netapp FAS2240-4) --

switchport mode trunk

channel-group 11 mode active

interface Ethernet1/2

description -- stp01202 e1b (Netapp FAS2240-4) --

switchport mode trunk

channel-group 12 mode active

interface Ethernet1/3

description -- mgp01200A Eth1/20 (Cisco UCS FI 6248UP) --

switchport mode trunk

channel-group 13 mode active

interface Ethernet1/4

description -- mgp01200B Eth1/20 (Cisco UCS FI 6248UP) --

switchport mode trunk

channel-group 14 mode active

interface Ethernet1/5

description -- swp01201 Eth1/5 (Cisco Nexus 5548UP) --

switchport mode trunk

channel-group 10 mode active

interface Ethernet1/6

description -- swp01201 Eth1/6 (Cisco Nexus 5548UP) --

switchport mode trunk

channel-group 10 mode active

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

interface Ethernet1/10

interface Ethernet1/11

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

description -- stp01210 eth1 (Netgear ReadyNAS 3200) --

switchport access vlan 1724

speed 1000

channel-group 16 mode active

interface Ethernet1/16

interface Ethernet1/17

description -- swp01203A Gi1/12 (Cisco Catalyst 2960S) --

switchport mode trunk

speed 1000

channel-group 15 mode active

interface Ethernet1/18

description -- swp01203B Gi1/12 (Cisco Catalyst 2960S) --

switchport mode trunk

speed 1000

channel-group 15 mode active

interface Ethernet1/19

interface Ethernet1/20

interface Ethernet1/21

description -- fw01201B port13 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/22

description -- fw01201B port14 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/23

description -- fw01201A port15 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/24

description -- fw01201A port16 (Fortinet Fortigate 200B) --

switchport mode trunk

speed 1000

channel-group 1 mode active

interface Ethernet1/25

interface Ethernet1/26

interface Ethernet1/27

interface Ethernet1/28

interface Ethernet1/29

interface Ethernet1/30

interface Ethernet1/31

interface Ethernet1/32

interface Ethernet2/1

interface Ethernet2/2

interface Ethernet2/3

interface Ethernet2/4

interface Ethernet2/5

interface Ethernet2/6

interface Ethernet2/7

interface Ethernet2/8

interface Ethernet2/9

interface Ethernet2/10

interface Ethernet2/11

description -- mgp01200B Eth1/27 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 102

channel-group 22 mode active

interface Ethernet2/12

description -- mgp01200B Eth1/28 (Cisco UCS FI 6248UP) --

switchport mode trunk

switchport trunk allowed vlan 102

channel-group 22 mode active

interface mgmt0

vrf member management

ip address 172.16.2.242/24

clock timezone CET 1 0

clock summer-time CET 5 Sun Mar 02:00 5 Sun Oct 03:00 60

line console

line vty

exec-timeout 15

boot kickstart bootflash:/n5000-uk9-kickstart.6.0.2.N1.2.bin

boot system bootflash:/n5000-uk9.6.0.2.N1.2.bin

interface fc2/15

interface fc2/16

interface fc2/13

interface fc2/14

interface fc2/15

interface fc2/16

!Full Zone Database Section for vsan 102

zone name Tape-Area-Network vsan 102

member pwwn 50:03:08:c3:8c:83:50:01

! [Quantum-i40-1]

member pwwn 20:00:00:25:b5:bb:00:0f

! [srp01201-vmhba2]

member pwwn 20:00:00:25:b5:bb:00:1f

! [srp01202-vmhba2]

zone name TAN vsan 102

zoneset name TAN vsan 102

member Tape-Area-Network

zoneset activate name TAN vsan 102

Many tnx

M.

marco.mosangini · ‎04-05-2013

From FI (mgp01200-A is 6248A and mgp01200-B is 6248B):

mgp01200-A(nxos)# sh ru int eth1/27-28

!Command: show running-config interface Ethernet1/27-28

!Time: Fri Apr 5 15:10:07 2013

version 5.0(3)N2(2.11d)

interface Ethernet1/27

description C: FcoeUplink

pinning border

switchport mode trunk

switchport trunk native vlan 4049

switchport trunk allowed vlan 101-102,4048-4049

channel-group 21 mode active

no shutdown

interface Ethernet1/28

description C: FcoeUplink

pinning border

switchport mode trunk

switchport trunk native vlan 4049

switchport trunk allowed vlan 101-102,4048-4049

channel-group 21 mode active

no shutdown

mgp01200-A(nxos)# sh int eth1/27-28

Ethernet1/27 is up

Hardware: 1000/10000 Ethernet, address: 547f.eeaa.d002 (bia 547f.eeaa.d002)

Description: C: FcoeUplink

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 02:45:10

Last clearing of "show interface" counters never

30 seconds input rate 1072 bits/sec, 134 bytes/sec, 0 packets/sec

30 seconds output rate 120 bits/sec, 15 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 400 bps, 0 pps; output rate 152 bps, 0 pps

RX

620 unicast packets 2089 multicast packets 0 broadcast packets

2709 input packets 1664551 bytes

620 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun 0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 838 multicast packets 0 broadcast packets

838 output packets 192005 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

1 interface resets

Ethernet1/28 is up

Hardware: 1000/10000 Ethernet, address: 547f.eeaa.d003 (bia 547f.eeaa.d003)

Description: C: FcoeUplink

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 02:45:11

Last clearing of "show interface" counters never

30 seconds input rate 128 bits/sec, 16 bytes/sec, 0 packets/sec

30 seconds output rate 56 bits/sec, 7 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 160 bps, 0 pps; output rate 216 bps, 0 pps

RX

1 unicast packets 863 multicast packets 0 broadcast packets

864 input packets 217352 bytes

1 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun 0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 2083 multicast packets 0 broadcast packets

2083 output packets 272154 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

1 interface resets

mgp01200-B(nxos)# sh ru int eth1/27-28

!Command: show running-config interface Ethernet1/27-28

!Time: Fri Apr 5 15:10:11 2013

version 5.0(3)N2(2.11d)

interface Ethernet1/27

description C: FcoeUplink

pinning border

switchport mode trunk

switchport trunk native vlan 4049

switchport trunk allowed vlan 101-102,4048-4049

channel-group 22 mode active

no shutdown

interface Ethernet1/28

description C: FcoeUplink

pinning border

switchport mode trunk

switchport trunk native vlan 4049

switchport trunk allowed vlan 101-102,4048-4049

channel-group 22 mode active

no shutdown

mgp01200-B(nxos)# sh int eth1/27-28

Ethernet1/27 is up

Hardware: 1000/10000 Ethernet, address: 547f.eeaa.d222 (bia 547f.eeaa.d222)

Description: C: FcoeUplink

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 02:44:44

Last clearing of "show interface" counters never

30 seconds input rate 72 bits/sec, 9 bytes/sec, 0 packets/sec

30 seconds output rate 160 bits/sec, 20 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 168 bps, 0 pps; output rate 248 bps, 0 pps

RX

0 unicast packets 859 multicast packets 0 broadcast packets

859 input packets 225562 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun 0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

1246 unicast packets 1455 multicast packets 0 broadcast packets

2701 output packets 312217 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

1 interface resets

Ethernet1/28 is up

Hardware: 1000/10000 Ethernet, address: 547f.eeaa.d223 (bia 547f.eeaa.d223)

Description: C: FcoeUplink

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 02:44:44

Last clearing of "show interface" counters never

30 seconds input rate 128 bits/sec, 16 bytes/sec, 0 packets/sec

30 seconds output rate 40 bits/sec, 5 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 264 bps, 0 pps; output rate 152 bps, 0 pps

RX

32 unicast packets 2084 multicast packets 0 broadcast packets

2116 input packets 339814 bytes

2 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun 0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

11 unicast packets 841 multicast packets 0 broadcast packets

852 output packets 195944 bytes

1 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

1 interface resets

mgp01200-B(nxos)#