QSFP to SPF+ NX9000 to CAT3K not working

[enewburn1]

Hi,

We recently purchased some NX93120s and CAT 3850s for one of our data centers. We also purchased Cisco QSFP to SFP+ adapters to interface the NX9Ks 40GB interfaces to the 3850s 10GB. The connection seems to sort of come up, but nothing is getting through (CDP, LACP, Frames in general, etc)

When I try the "speed-group 10000" command the NEXUS just tells me the configuration does not match the port capability

What should I be doing here?

Thank you

[Reza Sharifi]

Hi,

On the nexus side try converting the port from 40 to 10.

In global config mode try:

interface breakout slot x port x

HTH

[enewburn1]

Hey Reza - thank you for the reply

Unfortunately, I'm not given that option in global mode

All I have is:

MCSO_NX9K_1(config)# interface ?
ethernet Ethernet IEEE 802.3z
loopback Loopback interface
mgmt Management interface
port-channel Port Channel interface
vlan Vlan interface

Also, I should have mentioned - I'm not turning the 40GB into 4 x 10G. It's just a straight 40GB to 10GB adapter with a twinax cable

[Reza Sharifi]

Hi,

So, does the switch come with 40Gig ports? If yes, this should be the output:

xxx(config)# interface ?
breakout Configuring the breakout for an interface
ethernet Ethernet IEEE 802.3z
loopback Loopback interface
mgmt Management interface
port-channel Port Channel interface
vlan Vlan interface

Also, can you provide the part number for the twinax cable you are using?

HTH

[enewburn1]

Yes the switch comes with 40GB uplink ports (NX93120TX)

Twin Ax Part Number is SFP-H10GB-CU1M

Here is one of the show interfaces in question:

MCSO_NX9K_1(config)# SH INT E1/102
Ethernet1/102 is down (check speed-group config)
admin state is up, Dedicated Interface
Belongs to Po100
Hardware: 10000/40000 Ethernet, address: 0027.e359.7253 (bia 0027.e359.7253)
Description: CORE1_LINK
MTU 1500 bytes, BW 40000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, medium is broadcast
Port mode is trunk
auto-duplex, auto-speed, media type is 10G
Beacon is turned off
Auto-Negotiation is turned on, FEC mode is Auto
Input flow-control is off, output flow-control is off
Auto-mdix is turned off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
EEE (efficient-ethernet) : n/a
Last link flapped never
Last clearing of "show interface" counters 00:54:39
0 interface resets
30 seconds input rate 0 bits/sec, 0 packets/sec
30 seconds output rate 0 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 0 bps, 0 pps

[Reza Sharifi]

Twin Ax Part Number is SFP-H10GB-CU1M

Ok, but this is only 10Gig to 10Gig twinx. The 10Gig interface is LC type connector but the 40Gig is not. So, how are you connecting the 40gig side?

http://www.fs.com/products/30903.html?currency=USD&paid=google_shopping&gclid=EAIaIQobChMIk6yCqJ7f1QIV0YSzCh0BbQT3EAkYASABEgJWAPD_BwE

HTH

[enewburn1]

We are using CVR-QSFP-SFP10G for the NEXUS end

[Reza Sharifi]

ok, I got it now but I am still wondering if you have to convert the 40gig to 10 but again the command is not there for you to try it.

Can you look under the interface e1/102 for the breakout command?

[enewburn1]

I got nothing under the interface for configuring a breakout, or forcing a particular speed, or specifying a transceiver. I'll open up a case with TAC and whatever the resolution ends up being I will post here. If anything comes to mind - I'm all ears

Thanks 

[Austin Sabio]

Please see bug#CSCuz43095.  

https://quickview.cloudapps.cisco.com/quickview/bug/CSCuz43095

I hope this helps. Good Luck!

[enewburn1]

All,

    Thank you for your responses. I did eventully get the issue resolved. On the NX9K 93120TX chassis the "speed-group 10000" command must be applied on the FIRST available QSFP interface - Ethernet 1/97. Attempting to apply the config change to the other interfaces fails (I was using e1/101 - 102). The command, applied on the first interface, changes the speed of ALL QSFP to 10GB - which is kind of a bummer in terms of flexibilty, but whateves. Funnily enough after fixing the speed problem on the NX9K I ran smack into the bug Austin mentioned on my 3850s. Guess it just wasn't my day. 

[Reza Sharifi]

There goes Cisco with yet another switch model and another command to use (speed-group 10000). I have no idea what Cisco developers are thinking, but to make one command change all the interfaces on the box is the dumest design I have ever seen.  Sorry to hear about your trouble.