Nexus 9300 QSFP 40G interface to FEX 2300 40G fabric interface - not supported?

[Mate Grbavac]

Hi,

we are considering connecting FEX 2300 to Nexus 9300 using 40G link, but on true 40G QSFP+, not 4x 10G SPF+ on Nexus 9300.

Is this configuration supported?

I have some unchecked informations that this is setup is not supported. Is there any document in which are described possible connectivity options for Nx 9300 and FEX (including FEX 2300)?

Br, Mate

[Ganesh Hariharan]

Hi,


we are considering connecting FEX 2300 to Nexus 9300 using 40G link, but on true 40G QSFP+, not 4x 10G SPF+ on Nexus 9300.


Is this configuration supported?


I have some unchecked informations that this is setup is not supported. Is there any document in which are described possible connectivity options for Nx 9300 and FEX (including FEX 2300)?


Br, Mate

Hi Mate,

Check out the below link on QSFP port details for N9k and Fex 2300

http://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-729405.html 

http://www.cisco.com/c/en/us/products/collateral/switches/nexus-2000-series-fabric-extenders/datasheet-c78-731663.html

Fex 2300 document states " The 40-Gbps Quad Enhanced Small Form-Factor Pluggable (QSFP+) fabric interfaces offer cost-effective, simplified connectivity to Cisco Nexus parent switches and support for QSFP 40-Gbps bidirectional (BiDi) short-reach transceivers "

Hope It Helps..

-GI

Rate if it Helps..

[Mate Grbavac]

Hi Ganesh,

It's not problem on fabric extender. Problem is on Nexus 9300. We got info that 40G uplink modules for Nexus 9300 not supporting FEX. 

For example, if we have Nexus 9396PX with N9K-M12PQ (12x 40G QSFP+ uplink module), can we connect FEX to those 40G ports (on N9K-M12PQ module)?

[Steve Fuller]

Hi Mate,

You’re correct. As per the Supported FEX Modules  section of the release notes:

“Note: Please note the following:

• Cisco Nexus 9300 Series switches do not support FEX on uplink modules (ALE).”

On the Nexus 9396 the 40GE QSFP+ ports on the Generic Expansion Module (GEM) use the Cisco ALE (ACI Leaf Engine) ASIC (see below).

I've not tried this, but there may be an option to use the supported QSFP+ to SFP+ breakout cables. The problem with that approach is that you'll use your 10GE ports very quickly and your original posted makes it seem you didn't want to do that.

Regards

[Ganesh Hariharan]

Hi Ganesh,

It's not problem on fabric extender. Problem is on Nexus 9300. We got info that 40G uplink modules for Nexus 9300 not supporting FEX. 


For example, if we have Nexus 9396PX with N9K-M12PQ (12x 40G QSFP+ uplink module), can we connect FEX to those 40G ports (on N9K-M12PQ module)?

Hi Mate,

I checked the Data sheet for Fex 2300 and i can't find N9k under parent switch support.

I can only see N5k,N6k and N7k.

Check out the below link for your information and reference.

http://www.cisco.com/c/en/us/products/collateral/switches/nexus-2000-series-fabric-extenders/datasheet-c78-731663.html

Hope it Helps.

-GI

Rate if it Helps..

[Steve Fuller · Accepted solution]

Hi Ganesh,

The Nexus 2300 series FEX are supported on the Nexus 9300 series switches. Check the link to the release notes I pasted in my response from yesterday – Supported FEX Modules. From the release notes:

"Supported FEX Modules

Cisco NX-OS Release 7.0(3)I2(1) supports the following FEXes on Cisco Nexus 9332PQ (support for 2300 only), 9372PX, 9372PX-E, 9396PX and 9500 Series Switches:

Cisco Nexus 2224TP

Cisco Nexus 2232PP

Cisco Nexus 2232TM and 2232TM-E

Cisco Nexus 2248PQ

Cisco Nexus 2248TP and 2248TP-E

Cisco Nexus 2348UPQ

Cisco Nexus B22Dell

Cisco Nexus B22HP

Cisco Nexus NB22FTS

Cisco Nexus NB22IBM

Cisco Nexus 2348TQ"

What isn't supported, as also stated in the release note, is to connect the Network Interface (uplink) of a FEX to the Ethernet ports that are connected to the Cisco ALE ASIC. On the Nexus 9372 for example that’s interface Ethernet 1/49-54.

Regards

[Mate Grbavac]

"Compare models" page is also telling that FEX 2300 is supported on Nexus 9k.

[jgomez]

The simple answer is no, you cannot use the 40G ALE ports (N9K-M12PQ) on the 9396PX as FEX uplink ports, unless you use a breakout cable.  This configuration is not support and your FEX will not come online.  

The 10G ports on the 9396PX are supported as FEX up links, but defeats the purpose.