11-10-2015 05:19 AM - edited 03-01-2019 12:27 PM
Cisco NEXUS with Fabric Extenders connected to UCS, what is the best design?
We recently implemented a new network backbone, the NEXUS 6004, with Fabric Extenders. Our UCS fabrics are connected to the FEX (not direct to the 6004) I have been unable to find any documentation that takes into account the NEXUS FEX’s.
Attached are 5 different designs, what would the recommended one be? And reasons why?
We have a mix (we have multiple UCS fabrics) of designs on different fabrics trying to find out what is the most ideal. We have been getting some network anomalies here and there and have been unable to point pint why,
Any help is appreciated
Thanks
11-10-2015 12:07 PM
Best practise: connect UCS FI uplinks with 10G non oversubscribed to a North bound switch (n5k, N6k); no FEX !
FEX might be used to connect many (max 160) rack mount servers (C-series) to a UCS FI. There you might tolerate some more oversubscription per server.
11-16-2015 08:20 AM
11-18-2015 04:51 AM
I agree with the design of direct attached of the FIs to the 6Ks using port-channels (vPC from the 6Ks). The potential traffic from the FIs is quite large and you want to avoid risking over-subscription and bottleneck issues.
BTW - the last design " straight_thrugh.jpg" is the least recommended since traffic between servers that are pinned to different FIs will cross the vpc peer-link and as a best practice you would like to avoid that and keep the peer-link "free of traffic" as much as possible. it also might cause packet drops in some cases when traffic from the wan directed to the blades.
11-18-2015 05:41 AM
Thank you for the responses, just to clarify in my diagram the FEX 2000 are the ones designed for the NEXUS 6000, not for UCS! (http://www.cisco.com/c/en/us/products/switches/nexus-2000-series-fabric-extenders/index.html specifically this model http://www.cisco.com/c/en/us/products/switches/nexus-2348upq-10ge-fabric-extender/index.html ) we are not using any UCS FEX’s
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide