Nexus 5548UP/2232PP/FCoE

gapriyad10 · ‎12-28-2012

Hi,

In my enviroment I have a datacenter with 2 Nexus 5548UP with FCoE Licence. As I am new to storage networking I need some information about the configuration of FCoE.

The enviroment is :

2 x 5548UP Switch

2 x 2232PP FEX

1 x Host with Emulex OneConnect OCe10102-F interface

1 x storage with FCoE interface.

How many virtual SANs we can create with a single stoarge device.

I have to configure this 2 5548UP Vs the 2 FEX 2232PP with FCoE.

1) I have to map each vsan with a Layer 2 FCoE Vlan?

2) How I can distribute the VSans (and the FcoE Vlans) and the Ethernet Vlans from the 2 FEX 2232PP Vs the 2 5548UP? How many Links? Is better to do a Port-Channel or different Port-Channels? Best Practices?

3) In which way we need to configure the Teaming? Active Standby or Active Active?

4) I studied that, it is possibile to do an ISL Trunk between the two Nexus 5548UP switches...right? Can I Create a port-channel and allow all the vsans?

Kindly guide me with proper connection diagram and configuration steps.

Thanks in advance!

Gaurav

krun_shah · ‎01-03-2013

You should be able to find all your answers in FCoE configuration guide.

http://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/fcoe/521n11/b_5k_FCoE_Config_521N11.html

gapriyad10 · ‎01-09-2013

Thanks Krun for the reply.

It was of great help.

But I still have some issues in configuring the setup.

My setup requirement is like this.

Here, the two FEXs are Cisco Nexus 2232PP and the two Cisco Switches are Cisco Nexus 5548UP.

Kindly tell me how many VLANs as well as VSANs we can create in this setup. Also how many VFCs we can have here. Can we have VPC here?

Please tell me the detailed confiuration steps.

Thanks,

Gaurav

krun_shah · ‎01-22-2013

Assuming FEXes are already connected and operational. Nexus 5548 cannot run in NPV mode. You have to configure zoning in addition to following configuration.

@Nexus 5548 switch1

feature fcoe

vlan 100

name DATA_VLAN

vlan 101

name Fabric_A_SAN101

fcoe vsan 101

vlan 102

name Fabric_B_SAN102

fcoe vsan 102

vsan database

vsan 101

vsan 101 interface vfc 101

vsan 101 interface vfc 13

vsan 102

vsan 102 interface vfc 102

vsan 102 interface vfc 23

int eth 102/1/1

description server CNA port 1

switchport mode trunk

spanning-tree port type edge trunk

int vfc 101

bind interface eth 102/1/1

switchport mode F

int eth1/3

description Interswitchlink

switch mode trunk

switchport trunk allowed vlan exclude 101

int vfc 102

bind interface eth1/3

switchport mode E

int eth1/2

descrition Storage port 1

switchport mode trunk

spanning-tree port type edge trunk

interface vfc 13

bind interface eth1/2

switchport mode F

int eth1/6

descrition storage port2

switchport mode trunk

spanning-tree port type edge trunk

interface vfc 23

bind interface eth1/6

switchport mode F

system qos

service-policy type qos input fcoe-default-in-policy

service-policy type queuing input fcoe-default-in-policy

service-policy type queuing output fcoe-default-out-policy

service-policy type network-qosfcoe-default-nq-policy

@Nexus 5548 switch2

feature fcoe

vlan 102

name Fabric_B_SAN102

fcoe vsan 102

vsan database

vsan 102

vsan 102 interface vfc 102

vsan 102 interface vfc 12

int eth1/3

description interswitch link

switch mode trunk

switchport trunk allowed vlan 102

int vfc 102

bind interface eth1/3

switchport mode E

int eth101/1/1

switchport mode trunk

spanning-tree port type edge trunk

interface vfc 12

bind interface eth101/1/1

switchport mode F

system qos

service-policy type qos input fcoe-default-in-policy

service-policy type queuing input fcoe-default-in-policy

service-policy type queuing output fcoe-default-out-policy

service-policy type network-qosfcoe-default-nq-policy

gapriyad10 · ‎01-23-2013

Thanks a lot Krun for the reply.

It was of great help and I was able to configure the switches.

But I still have the following issues:

I am able to see the PWWN of the storage ports in Switch-1 using "show flogi database" command , but I am not able to see the same in Switch-2.
I am not able to see the PWWN of the Host ports on the switches through the "show flogi database" command.
The FEXs port connected to the corresponding switch port shows "Link not connected" status, whereas the ethernet cable from the switch is connected to the ports of the "Expansion Module" of the corresponding FEX.
Does the connection of the switch port to the "Expansion Module" of the corresponding FEX ports have some effect on this? But whenever I connect the switch port to the "Fixed ports" of the corresponding FEX, then I am not able to configure the FEX from the switch and I am not able to see the FEX from the corresponding switch.

I have hereby attached the complete configuration details of both the switches for your reference. The setup diagram remains the same as above as shown in the previous reply.

Kindly help me out in solving this issue.

Thanks,

Gaurav