ANNOUNCEMENT - The community will be down for maintenace this Thursday August 13 from 12:00 AM PT to 02:00 AM PT. As a precaution save your work.
cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
12801
Views
35
Helpful
32
Replies
Highlighted
Advocate

Re: Nexus 93180YC-FX Fiber channel support

Hi Alexander

I said it already, without success !

The 9k platform will most likely never get full FC functionality (Cisco PM, please confirm or correct if I am wrong). 

I know this is not the question, but ACI doesn't support lossless Ethernet end to end, therefore not even FCoE is supported end to end, but only at the edge; same applies to classical FC.

Plus, be aware, that even the FC functionality of N5k is not exactly identical to a MDS !

Highlighted
Contributor

Re: Nexus 93180YC-FX Fiber channel support

I agree with Walter the N9K will only ever support FCoE and NPV not the full fibre channel protocol suite. For that you’ll need to place a MDS SAN switch for Fibre Channel and use the N9K for Ethernet only.

Highlighted
Beginner

Re: Nexus 93180YC-FX Fiber channel support

Why not do the zoning on the UCS FI and use the Nexus 9300 as an FC edge switch?

Highlighted
Advocate

Re: Nexus 93180YC-FX Fiber channel support

Hi David

Doing zoning on UCS FI requires "FC switching mode" on FI; zoning is done by means of UCS service profile specifications; you cannot take full control over all the FC paramenter settings. 

As I mentioned many times: FC implementation on UCS FI is not 100% compliant with MDS SAN-OS.

Q. who in your oranganisation does FC zoning ? the storage team or the server team. If you have a storage team, they will not like the automatic FC zoning done by UCS service profiles.

Highlighted
Beginner

Re: Nexus 93180YC-FX Fiber channel support

"As I mentioned many times: FC implementation on UCS FI is not 100% compliant with MDS SAN-OS."

 

Does any (partner) documentation exists on the differences between FI and MDS FC code?

I've would really like to hear some hard technical arguments for why not to use FI in FC switching mode when running smaller installations or using a POD design.

 

Highlighted
Advocate

Re: Nexus 93180YC-FX Fiber channel support

Don't think there is a document; I remember Features like

- static Domain id's

- smart zoning

...

are not supported. And zoning is automated by the SP creation; I think there is no way to impose your own zone / zoneset naming conventions.

Of course, in a PoC, small lab Environment, this might be ok, but I would never recommend it for a Enterprise class Environment.

My own statistics says, that > 95% of all UCS Environments run FC End host mode (ask Cisco, what their guess is).

btw. I had customers who run FC switch mode, and then later migrated to End host mode, which is disruptive and ugly. 

Highlighted
Beginner

Re: Nexus 93180YC-FX Fiber channel support

Hi Walter

 

Thanks for the answers.

 

I can't really see any features or configuration limits that would disqualify running FI's in switch mode when using either a direct attaching storage system or separate front end ports on larger storage systems (VMAX / UCP). But I would love to hear otherwise  :-)

 

Sure the numbers of VSANs, zones, FLOGI's, buffer credits are not impressive compared to the smallest MDS models but when having maximum 160 server it wouldn't be a problem. Having the shortest and most predictable path to storage and simple setup is a big plus in my eyes. 

 

Have seen a lot of cases, especially now with all-flash, where customers has a mix of other/older servers attached to FC switches where different port speeds cause loss of buffer credits - creating back pressure. And the lack of standard for FC port-channels cause link congestions between FI's and Brocade switches and being hard to troubleshoot because of microburst congestion not being caught by monitoring tools. 

 

Zoning have never been the most loved task for storage(/server) people so having UCSM take care os this makes day2day operations a lot easier to perform and troubleshoot.

 

If connectivity to other equipment or site is needed then separate VSANs pinned to other uplinks can be used, again to separate traffic and make performance predictable.

 

The dual FI reboot when changing from end host mode to switch mode and the other way around was fixed in 3.1(2b), check CSCuy20188.

 

It is now also possible to create and exchange based load-balanced port-channel between UCS FI and Brocade. Does require a Brocade Director switch with the new FCoE linecard though.  

 

Highlighted

Re: Nexus 93180YC-FX Fiber channel support

We are also facing the problem. FC links (to servers and targets) won't come up on 93180YC-FX, and they show Status: npmExtLinkDown (they are in F mode).

Is there any way to connect servers and targets together, via a single Nexus 93180YC-FX, using FC interfaces (we have 8GB SPFs for servers and 16GB for Targets) and make it switch FC traffic?

Highlighted
Cisco Employee

Re: Nexus 93180YC-FX Fiber channel support

NPV devices require upstream NPIV devices to provide FCIDs, flogi, etc

This switch acts as a NPV device, not as a NPIV device.

You will still need an upstream MDS, N5K, etc,  in tandem.

 

Thanks,

Kirk..

Highlighted
Cisco Employee

Re: Nexus 93180YC-FX Fiber channel support

We have finally made it!

The NX-OS 9.3(3) contains the full FC/FCoE switching capability:

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus9000/sw/93x/release/notes/cisco-nexus-9000-nxos-release-notes-933.html

 

Enjoy but please be aware of the 16/32Gb speeds only for native FC (no 8Gb or less)!

Highlighted
Beginner

Re: Nexus 93180YC-FX Fiber channel support

I tried, but could not find the section indicating full Fiber Channel Switching support.

 

Could you please point it out? 

Highlighted

Re: Nexus 93180YC-FX Fiber channel support

Hi, there were no full FC support, until recently. We even managed to convince our supplier to provide us a pair of MDS switches for free to achive what the 93180YC-FX calimed supported. What was supported - an NPV only mode.

Recently I've heard they at last implemented it, so try to update to the newest version.

Highlighted
Cisco Employee

Re: Nexus 93180YC-FX Fiber channel support

Highlighted

Re: Nexus 93180YC-FX Fiber channel support

Does it mean the 93180YC-FX will provide Fabric zoning and NPIV, without to be necessary to use the uplink ports ?

Highlighted
Cisco Employee

Re: Nexus 93180YC-FX Fiber channel support

Hello Aggelos,

 

that is exactly what it means. Nexus 93180YC-FX is able to perform all the FC SAN switch functions on its own.

Please be aware of the licensing requirements as noted in the configuration guide:

https://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus9000/sw/93x/san_switching/configuration/guide/b-cisco-nexus-9000-nx-os-san-switching-configuration-guide-933/m-n9000-san-s-enabling-feature-fcoe.html

 

Regards,

Josef

This widget could not be displayed.