05-05-2013 11:47 AM - edited 03-01-2019 11:01 AM
Hello exports,
I have fabric interconnect UCS6248 OS ver 5.0(3)N2(2.11e) in FC switching mode and Nexus 5548UP OS ver 5.0(3)N2(1). These two devices are directly connected with twinax cable, on both devices Im using port 1/17.
I want to use fcoe multihop from server HBA to EMC VNX through FI and Nexus. On the FI I configured the VSAN 850 using VLAN 850 and set the port 1/17 as FCoE uplunk.
On the Nexus I have the following configuration:
feature fcoe
vlan 850
name VSAN_A
fcoe vsan 850
vsan database
vsan 850
interface vfc850
bind interface Ethernet1/17
switchport mode E
switchport trunk allowed vsan 850
no shutdown
vsan database
vsan 850 interface vfc850
interface Ethernet1/17
switchport mode trunk
switchport trunk allowed vlan 850
VSAN 850 between the FI and Nexus dont want to come up. Related output from FI:
A348-UCS6248-A-A(nxos)# sh vsan
vsan 1 information
name:VSAN0001 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:down
vsan 850 information
name:VSAN0850 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:down
vsan 4079:evfp_isolated_vsan
vsan 4094:isolated_vsan
A348-UCS6248-A-A(nxos)# sh int vfc 712
vfc712 is trunking (Not all VSANs UP on the trunk)
Bound interface is Ethernet1/17
Hardware is Virtual Fibre Channel
Port WWN is 22:c7:00:2a:6a:0b:aa:3f
Admin port mode is E, trunk mode is on
snmp link state traps are enabled
Port mode is TE
Port vsan is 850
Trunk vsans (admin allowed and active) (1,850)
Trunk vsans (up) ()
Trunk vsans (isolated) (850)
Trunk vsans (initializing) (1)
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
98 frames input, 8232 bytes
0 discards, 0 errors
307 frames output, 28688 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Sun May 5 14:06:43 2013
Related output from Nexus:
A348-N5548UP-A# sh int vfc 850
vfc850 is trunking (Not all VSANs UP on the trunk)
Bound interface is Ethernet1/17
Hardware is Virtual Fibre Channel
Port WWN is 23:51:00:2a:6a:09:7c:7f
Admin port mode is E, trunk mode is on
snmp link state traps are enabled
Port mode is TE
Port vsan is 850
Trunk vsans (admin allowed and active) (850)
Trunk vsans (up) ()
Trunk vsans (isolated) (850)
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
918 frames input, 71340 bytes
0 discards, 0 errors
300 frames output, 30300 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Sun May 5 14:05:43 2013
A348-N5548UP-A# sh int e 1/17
Ethernet1/17 is up
Hardware: 1000/10000 Ethernet, address: 002a.6a09.7c38 (bia 002a.6a09.7c38)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped 04:10:33
Last clearing of "show interface" counters never
30 seconds input rate 288 bits/sec, 36 bytes/sec, 0 packets/sec
30 seconds output rate 200 bits/sec, 25 bytes/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 312 bps, 0 pps; output rate 192 bps, 0 pps
RX
931 unicast packets 37209 multicast packets 0 broadcast packets
38140 input packets 4184855 bytes
5 jumbo packets 0 storm suppression bytes
0 giants 0 input error 0 short frame 0 overrun 0 underrun
0 watchdog 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
316 unicast packets 18196 multicast packets 0 broadcast packets
18512 output packets 2642762 bytes
7 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble
0 Tx pause
11 interface resets
A348-N5548UP-A# sh fc
fc2 fcdroplatency fcoe fctimer
fc2d fcflow fcoe-npv
fcalias fcid-allocation fcroute
fcdomain fcns fcs
A348-N5548UP-A# sh fcs database
FCS Local Database in VSAN: 1
------------------------------
Switch WWN : 20:01:00:2a:6a:09:7c:41
Switch Domain Id : 0x79(121)
Switch Mgmt-Addresses :
Fabric-Name : 20:01:00:2a:6a:09:7c:41
Switch Logical-Name : A348-N5548UP-A
Switch Information List : [Cisco Systems, Inc.*N5K-C5548UP*5.0(3)N2(1)*20:00:00
:2a:6a:09:7c:40]
Switch Ports:
------------------------------------------------------------------------
Interface fWWN Type Attached-pWWNs
(Device-alias)
------------------------------------------------------------------------
FCS Local Database in VSAN: 850
------------------------------
Switch WWN : 23:52:00:2a:6a:09:7c:41
Switch Domain Id : 0x3b(59)
Switch Mgmt-Addresses :
Fabric-Name : 23:52:00:2a:6a:09:7c:41
Switch Logical-Name : A348-N5548UP-A
Switch Information List : [Cisco Systems, Inc.*N5K-C5548UP*5.0(3)N2(1)*20:00:00
:2a:6a:09:7c:40]
Switch Ports:
------------------------------------------------------------------------
Interface fWWN Type Attached-pWWNs
(Device-alias)
------------------------------------------------------------------------
vfc850 23:51:00:2a:6a:09:7c:7f Unknown None
Please help, Thanks and Regards Jiri
05-05-2013 12:53 PM
There was qos configuration missing. After configuring this:
system qos
service-policy type qos input system_qos_policy
service-policy type queuing input system_q_in_policy
service-policy type queuing output system_q_out_policy
service-policy type network-qos system_nq_policy
The FCoE ports are up !!!
Regards Jiri
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide