11-22-2012 12:31 AM - edited 03-01-2019 10:44 AM
I have 2 chassis ucs. each chassis is populated with 2, 2208XP fab exenders. So they have total of 8 ports.
Then I have 2, inteconnect switches. I think we are licensed for 12 ports on each interconnects.
So how should I be splitting these 12 ports up for ucs?
I also need to connect my brocade switch to the interconnects as well
thanks
11-22-2012 07:14 AM
There's two questions here.
How many licenses you have depend on which FI you have:
6120 = 8 licenses included
6140 = 16 licenses included
61xx Expansion module = All ports expansion ports come licensed
6248 = 12
6296 = 24
62xx Expansion module = 6 additional port licenses , which can be used by base module or expansion ports.
The second piece of your question - how many uplinks to use depends on a number of factors:
-How many blades will you be using?
-What I/O load will the blades require?
-Any plans to attach storage devices direclty connect to the FI's? (bypassing your brocade switches)
-Any C-Series you plan on integrading?
-Do you want to connect a traffic sniffing device to the FIs?
If you have a relatively low usage and basic setup, you can probably get away with 2 uplinks between the 2208 IOM and FI. If you have higher load running then you can increase that accordingly, but be advised you'll be eating up more ports this way. I rarely see customer environments where they're consistently pushing traffic capacity beyond 2 IOM uplinks. Next you have to factor in your Ethernet uplinks. Again, since you have a single Chassis I would recommend 2 uplinks from each FI to your upstream LAN. This gives you decent bandwidth and redundancy. Next, add in your Fiber Channel uplinks. You'll probably want at least one, possible two per FI depending on storage load again.
So assuming port wise you'll looking at
FI-A
2 server links (going to the IOMs)
2 uplinks (going to your upstream LAN)
2 FC Interfaces (going to your brocade)
This would eat up 6 licenses on each FI and leave you room for expansion (additional chassis) or increasing the max bandwidth of one of your other hops (IOM <-> FI or FI <-> LAN).
When desiging your infrstructure connectivity, keep a couple things in mind. More is not always better. Just because you pipe in 8 Chassis uplinks to your FI doesn't mean you're going to be pushing more traffic. You'll always be limited by the slowest link within the path and UCS will rarely be that bottleneck. There's little point pushing 80GB of bandwidth between your FI and Chassis if your upstream LAN can only support single 10GB uplinks etc. The second this to consider is FCoE is far more efficent an transport than classical ethernet. There are no re-transmissions or dropped frames as there are with classical ethernet. Congestion rather is controlled by Priority flow control. All you need to know is the increase efficiency of FCoE will greatly improve your throughput at least up to your LAN uplinks.
Hope this helps,
Regards,
Robert
11-22-2012 09:59 AM
Hi
Thank you for our response. I believe we have the 6248 interconnect. I have to double check.
I know we are licensed for 12 ports total on each interconnect.
I have 2 nexus 7k, 2 brocade switches.
I dont think we will be using fcoe since we already have the fiber.
how many ports (sfp) do I need to go from each FI to each 7k?
how many ports to go from each FI to each brocade switch?
These are VMware esxi servers. I doubt I need all 8 ports on the extender to go to the FI. so maybe 4ports (40GB) per chassis to start with?
I think we will be doing vpc fom each interconnect to the 7k too
thanks
soory I forgot to add we have nexus 2ks beteen the FI and the 7ks. so the FI will go to the nexus 2ks
11-22-2012 10:39 AM
FCoE will be the transport for all communication between the Chassis and FI's. Once you get to the FI it splits into native ethernet (going to your N7Ks) and native Fiber Channel (going to your brocades). The same advise applies I stated earlier.
From EACH Fabric IInterconnect:
2 server links (going to the 2208 IOMs)
2 uplinks (going to your upstream N7K LAN)
2 FC Interfaces (going to your brocade)
If you want to increase the server links to 4 each, that's fine also..
Robert
07-03-2014 09:47 PM
hi
Is there a way in ucsm to see how much traffic I am utilizing on the 2208xp uplinks? or any uplinks?
07-10-2014 02:14 AM
07-10-2014 11:53 AM
I use Cacti to monitor all my ports on the interconnect switches.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide