Solved: How to deploy UCS Nexus 5000 & SAN storage - Page 2

sjahirud · ‎06-20-2015

Hi ,

I dont have good knowledge on nexus 5000 , but after going through lot of doc I am trying to setup UCS with nexus 5000 and san storage.

My objective is to boot server from san storage.

My setup :

--------

UCS------>Nexus5000---------SAN storage

As per the document when I am configuring UCS for FCOE Uplink , there is no option to set the VSAN id.

I have created the VSAN 500 and then making one of the port in FI for FCOE uplink.Screenshot attached.

Plz let me know FI should be in endhost mode or switching mode..?I am running ucs 2.2(3d) version.

What kind of SFP should I use to connect from UCS & Nexus.

THanx & Regards

Shaikh

Walter Dey · ‎06-22-2015

Did you create FC ports on the FI ? I assume you are using a 6248 or 96 ?

In the UCS Manager, go to the SAN tab, and there you can create VSAN's

sjahirud · ‎06-22-2015

Hi Walter ,

I configured from cli and its working.But facing issue with zoneset.Do you have any info to point.

And I want to deploy Nexus 5 k in load balancing mode.How can I do it...?

Regards

Shaikh

sjahirud · ‎06-22-2015

I mean two nexus 5k in load balancing mode.

sjahirud · ‎06-23-2015

Hi walter,

I have connected and configure the N5k.

I can see the floggi database and zone set

citywifi-n5k-1# sh flogi database
--------------------------------------------------------------------------------
INTERFACE        VSAN    FCID           PORT NAME               NODE NAME
--------------------------------------------------------------------------------
fc1/45           10    0x890020 50:0a:09:82:80:71:3f:67 50:0a:09:80:80:71:3f:67
fc1/46           10    0x890040 50:0a:09:81:90:71:3f:67 50:0a:09:80:80:71:3f:67
vfc142           10    0x890002 24:31:00:2a:6a:cd:49:bf 20:0a:00:2a:6a:cd:49:81
vfc142           10    0x890009 20:00:00:25:b5:00:00:37 20:00:00:25:b5:00:00:57
vfc142           10    0x89000a 20:00:00:25:b5:00:00:07 20:00:00:25:b5:00:00:27

Total number of flogi = 5.

citywifi-n5k-1# sh zoneset active vsan 10
zoneset name zoneset-citywifi-n5k-1 vsan 10
zone name SCA-UCS-hba1-citywifi-n5k-1 vsan 10
* fcid 0x890020 [pwwn 50:0a:09:82:80:71:3f:67]
* fcid 0x890040 [pwwn 50:0a:09:81:90:71:3f:67]
* fcid 0x890002 [pwwn 24:31:00:2a:6a:cd:49:bf]

But when trying to boot the ucs the message I am getting is

Emulex FCoE BIOS is not installed.

Please help me on this.

Walter Dey · ‎06-23-2015

Q. What type of I/O adaptor are you using

Q. how many vha's and veth's does your service profile have

Q. what are the pwwn of your hba's

Q. which OS are you using

Q. could you install the OS ?

Q. what is your boot policy ? configured / actual ?

sjahirud · ‎06-23-2015

Hi Walter ,

Please find my topology :

Q. What type of I/O adaptor are you using

Q. how many vha's and veth's does your service profile have

Q. what are the pwwn of your hba's

Switch-1

citywifi-n5k-1(config)# sh flogi database
--------------------------------------------------------------------------------
INTERFACE        VSAN    FCID           PORT NAME               NODE NAME
--------------------------------------------------------------------------------
fc1/45           10    0x890020 50:0a:09:82:80:71:3f:67 50:0a:09:80:80:71:3f:67
fc1/46           10    0x890040 50:0a:09:81:90:71:3f:67 50:0a:09:80:80:71:3f:67
vfc142           10    0x890002 24:31:00:2a:6a:cd:49:bf 20:0a:00:2a:6a:cd:49:81
vfc142           10    0x890009 20:00:00:25:b5:00:00:37 20:00:00:25:b5:00:00:57
vfc142           10    0x89000a 20:00:00:25:b5:00:00:07 20:00:00:25:b5:00:00:27

Total number of flogi = 5.

citywifi-n5k-1(config)# show zon
zone zone-attribute-group zoneset
citywifi-n5k-1(config)# show zoneset active vsan 10
zoneset name zoneset-citywifi-n5k-1 vsan 10
zone name SCA-UCS-hba1-citywifi-n5k-1 vsan 10
* fcid 0x890020 [pwwn 50:0a:09:82:80:71:3f:67]
* fcid 0x890040 [pwwn 50:0a:09:81:90:71:3f:67]
* fcid 0x890002 [pwwn 24:31:00:2a:6a:cd:49:bf]
citywifi-n5k-1(config)#

Switch-2

citywifi-n5k-2# sh flogi database
--------------------------------------------------------------------------------
INTERFACE        VSAN    FCID           PORT NAME               NODE NAME
--------------------------------------------------------------------------------
fc1/45           11    0x270020 50:0a:09:82:90:71:3f:67 50:0a:09:80:80:71:3f:67
fc1/46           11    0x270040 50:0a:09:81:80:71:3f:67 50:0a:09:80:80:71:3f:67
vfc141           11    0x270002 24:30:00:2a:6a:ba:8e:bf 20:0b:00:2a:6a:ba:8e:81
vfc141           11    0x27000b 20:00:00:25:b5:00:00:47 20:00:00:25:b5:00:00:57
vfc141           11    0x27000c 20:00:00:25:b5:00:00:17 20:00:00:25:b5:00:00:27

Total number of flogi = 5.

citywifi-n5k-2# sh ac
access-lists accounting
citywifi-n5k-2# sh zoneset active vsan 11
zoneset name zoneset-citywifi-n5k-2 vsan 11
zone name SCA-UCS-hba1-citywifi-n5k-2 vsan 11
* fcid 0x270020 [pwwn 50:0a:09:82:90:71:3f:67]
* fcid 0x270040 [pwwn 50:0a:09:81:80:71:3f:67]
* fcid 0x270002 [pwwn 24:30:00:2a:6a:ba:8e:bf]
citywifi-n5k-2#

Q. which OS are you using : ESXI

Q. could you install the OS ?Its already installed on san storage, trying to boot it

Q. what is your boot policy ? configured / actual ? -

sjahirud · ‎06-23-2015

Walter Dey · ‎06-24-2015

Something is not ok here:

vfc142 10 0x89000a 20:00:00:25:b5:00:00:07 20:00:00:25:b5:00:00:27

This corresponds to fc0

It doesn't show up in the zoneset for vsan 10

----------------------

vfc141 11 0x27000c 20:00:00:25:b5:00:00:17 20:00:00:25:b5:00:00:27

This corresponds to fc1

It doesn't show up in the zoneset for vsan 11

-----------------------

Please correct your zoning and check, if you see your boot lun, and can install ESXi ?

Did you really have FCoE between FI and N5k; I would recommend to do FC, as your storage array is connected by means of FC !

sjahirud · ‎06-24-2015

Hi walter,

When I am booting the server I can see in nexus

vfc142 10 0x89000a 20:00:00:25:b5:00:00:07 20:00:00:25:b5:00:00:27

Initial phase it was not there.when server boot with the service profile it automatically created.due to license issue in netapp we r using FCoE between FI & Nexus and FC between Nexus & Netapp.

sjahirud · ‎06-25-2015

Thanx walter ,

The problem with zoning , now I am able to boot the server from SAN.

Thanx a lot.

But I want to deploy Nexus 5000 in cluste mode.Plz help me how can I proceed...?

Walter Dey · ‎06-22-2015

Hi Shaikh

Best practise:

From each UCS FI you have a link to each N5k, and create a LACP port-channel (and a vpc on the N5k). Therefore you have peerlinks between N5k; but this is Ethernet only.

For FC, the 2 N5k are totally isolated, no FC link in between. No dual homing of the FI's to the 2 N5k.

Regarding zoning, here a few useful commands

vsan database
vsan 100 name "abc"
vsan 101 name "xyz"

device-alias mode enhanced
device-alias database
device-alias name 123456789 pwwn 00:00:00:00:00:00:00:07

system default zone distribute full
system default zone mode enhanced
zone mode enhanced vsan 100
zone mode enhanced vsan 101

!Full Zone Database Section for vsan 100
zone name BAL1-FA-WAN-A2-0W-BAL16-FA-WAN-A2-0W vsan 100
member device-alias BAL1-FA-WAN-A2-0W
member device-alias BAL16-FA-WAN-A2-0W

zone name BAL1-FA-WAN-A2-0W-BAL16-FA-WAN-B2-0W vsan 100
member device-alias BAL1-FA-WAN-A2-0W
member device-alias BAL16-FA-WAN-B2-0W

zone name BAL1-FA-WAN-B2-0W-BAL16-FA-WAN-A2-0W vsan 100
member device-alias BAL1-FA-WAN-B2-0W
member device-alias BAL16-FA-WAN-A2-0W

zone name BAL1-FA-WAN-B2-0W-BAL16-FA-WAN-B2-0W vsan 100
member device-alias BAL1-FA-WAN-B2-0W
member device-alias BAL16-FA-WAN-B2-0W

zoneset name BAL1-BAL16-FE-VPLEX-FA vsan 100
    member BAL1-FA-WAN-A2-0W-BAL16-FA-WAN-A2-0W
    member BAL1-FA-WAN-A2-0W-BAL16-FA-WAN-B2-0W
    member BAL1-FA-WAN-B2-0W-BAL16-FA-WAN-A2-0W
    member BAL1-FA-WAN-B2-0W-BAL16-FA-WAN-B2-0W

zone commit vsan 100
!Full Zone Database Section for vsan 101

sjahirud · ‎06-21-2015

Hi Walter ,

But n5k side I have not done any config , as per the guide first I need to configure from FI side , then I can proceed to n5k.

And can plz tel me how can I disable NPIV on FI in end host mode.NPV is end host mode and also NPIV also enabled.So I want to disable the NPIV in FI.

Regards

Shaikh

Walter Dey · ‎06-21-2015

Have a look at

https://supportforums.cisco.com/discussion/11912046/configure-nexus-5548-native-fc

sjahirud · ‎06-21-2015

And one more thing is if I am using FC between FI & N5k , Then FI should be in switching mode.

I need to configure the port as FC storage port..?

Regards

Shaikh

Walter Dey · ‎06-21-2015

No, FC will be in End Host Mode ! Yes, you need to create FC ports on FI and N5k !