VIC 1400 topology

[fr_srv]

Hi, guys!

I'm trying to find the description of VIC 1400 connection topology inside 5108 chassis, but for some reasons, it's not described - neither in the datasheet (like the 1300 is described - here), nor in cisco live presentations.

My questions is: how is it connected to fabrics, in case if we use 2304 IOM? I mean, if it's single-port "The Cisco UCS VIC 1440 (Figure 2) is a single-port 40-Gbps or 4x10-Gbps Ethernet/FCoE capable modular LAN On Motherboard", so it's not redundant? And if yes, how it's connected to fabrics - only to A or only to B? And in case if we use 2208XP IOM, is it redundant, or it's still connected only to single fabric? There's also no information, how the port expander is connected to this VIC.

[Steven Tardy]

VIC 1440 topology mimics VIC 1340 topology with 2304 IOM:

• VIC 1440 (no port expander) -=> 2x10Gb port-channel to each IOM
• VIC 1440 + port expander -=> 4x10Gb 40G *native* to each IOM

IMO, the port expander is the best (and least expensive) option you can add to a UCS blade server for network performance.

See:

  https://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-b-series-blade-servers/b200m5-specsheet.pdf

Section sections:

  Table 10 Aggregate Bandwidth with mLOM Only configuration

  Table 13 Aggregate Bandwidth with Rear Mezzanine Cards Installed

[fr_srv]

Steven, thanks for your answer! Could you please clarify, what will be the topology, in case if we use 1440 and 2304? In the table 10 is mentioned, that the aggregated bandwidth is 40Gb with two 2304 with two 2x10Gbps port channels, but in the VIC1440 description is mentioned, that it's single-port 40Gbps card (here: https://www.cisco.com/c/en/us/products/collateral/interfaces-modules/unified-computing-system-adapters/datasheet-c78-741130.html). So, my question is - how can this be in one time: a) single-port 40Gbps card and b) two port channels to two IOM-s, 40Gbps total? I just don't understand.

[Steven Tardy]

Keep reading that same doc:

https://www.cisco.com/c/en/us/products/collateral/interfaces-modules/unified-computing-system-adapters/datasheet-c78-741130.html

Cisco VIC 1440

The Cisco UCS VIC 1440 (Figure 2) is a single-port 40-Gbps or 4x10-Gbps Ethernet/FCoE capable modular
 LAN On Motherboard (mLOM) designed exclusively for the M5 generation of Cisco UCS B-Series Blade
 Servers. When used in combination with an optional port expander, the Cisco UCS VIC 1440
 capabilities are enabled for two ports of 40-Gbps Ethernet.

[fr_srv]

Ok, lets be less complicated and divide the configuration on two options:

1. VIC 1440 only
2. VIC 1440 with port expander

Do i understand correctly, that with option 1 and a pair of 2304 installed in chassis i'll get only one 40Gb port? If yes, on which fabric it'll be connected?

[Steven Tardy · Accepted solution]

No.

Option 1 will provide two 2x10 Gbps port-channels (one to each I/O Module).

The VIC 1440 one 40Gbps port is broken down into four individual 10Gbps lanes. Remember most native 40Gbps is 4x10Gbps bound together at a lower level than a 4x10Gbps port-channel.

To directly answer the question you are really asking:

ALL UCS Fabric Interconnect connected UCS servers connect ALL Cisco VICs to BOTH Fabric Interconnects. No exceptions that I can think of.

The VIC <> IOM speed combinations are two numerous for anyone to remember so reference the b200 m5 spec sheet:

https://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-b-series-blade-servers/b200m5-specsheet.pdf

Table 10 Aggregate Bandwidth with mLOM Only configuration

Find the VIC and the I/O Module combination in the table and note the superscript (1). . . .Below the table shows

Notes:1. These configurations implement two 2x10 Gbps port-channels

[fr_srv]

Ok, Steven, thanks for your reply. It was little difficult for me to accept that a single port can be connected to two separate devices :). Once again, thanks for your help!