Nexus 9000 jumbo Frames blocked

[MichF47603]

Hi together,

i've got the N9K-C93108TC-FX in use and activate Jumbo MTU 9216 on each port.

The Problem is, that the Switch blocked all Frames >1514Bytes (pass only <=1514Bytes)

On the PC (JumboPackages=ON) i get only a Bandwith ~40Kb/s, but i should receive ~6Mb/s.

OS is: nxos.7.0.3.I7.2.bin

Input:

Port: 1/31

Speed: 1G

PackageSize: <1600Bytes

Config: mtu 9216

Output:

Port: 1/30

Speed: 10G

Config: mtu 9216

Config Switch:

interface Ethernet1/30
switchport mode trunk
switchport trunk allowed vlan 13
mtu 9216
speed 10000

interface Ethernet1/31
switchport access vlan 13
mtu 9216
speed 1000

Switch# show int eth1/30-31

Ethernet1/30 is up
admin state is up, Dedicated Interface
Hardware: 100/1000/10000 Ethernet, address: 10b3.d69e.b9f5 (bia 10b3.d69e.b9f5
)
MTU 9216 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, medium is broadcast
Port mode is trunk
full-duplex, 10 Gb/s
Beacon is turned off
Auto-Negotiation is turned on FEC mode is Auto
Input flow-control is off, output flow-control is off
Auto-mdix is turned off
Switchport monitor is off
EtherType is 0x8100
EEE (efficient-ethernet) : n/a
Last link flapped 00:29:13
Last clearing of "show interface" counters never
1 interface resets
30 seconds input rate 3176 bits/sec, 0 packets/sec
30 seconds output rate 42808 bits/sec, 41 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 2.85 Kbps, 0 pps; output rate 42.31 Kbps, 23 pps
RX
1544 unicast packets 147 multicast packets 1913 broadcast packets
3604 input packets 399854 bytes
84 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
73105 unicast packets 909 multicast packets 0 broadcast packets
74014 output packets 9253730 bytes
37 jumbo packets
0 output error 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause

Ethernet1/31 is up
admin state is up, Dedicated Interface
Hardware: 100/1000/10000 Ethernet, address: 10b3.d69e.b9f6 (bia 10b3.d69e.b9f6
)
MTU 9216 bytes, BW 1000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, medium is broadcast
Port mode is access
full-duplex, 1000 Mb/s
Beacon is turned off
Auto-Negotiation is turned on FEC mode is Auto
Input flow-control is off, output flow-control is off
Auto-mdix is turned off
Switchport monitor is off
EtherType is 0x8100
EEE (efficient-ethernet) : n/a
Last link flapped 00:29:08
Last clearing of "show interface" counters never
1 interface resets
30 seconds input rate 6142472 bits/sec, 3564 packets/sec
30 seconds output rate 9728 bits/sec, 9 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 6.12 Mbps, 3.53 Kpps; output rate 9.24 Kbps, 9 pps
RX
6250922 unicast packets 1750 multicast packets 0 broadcast packets
6252672 input packets 1340142379 bytes
192998 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
1544 unicast packets 15490 multicast packets 1827 broadcast packets
18861 output packets 1757565 bytes
47 jumbo packets
0 output error 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause

Thx and best Regards for help,

Michael

[marce1000]

           >The Problem is, that the Switch blocked all Frames >1514Bytes (pass only <=1514Bytes)

 How do you conclude this ,are there any correlating-log-messages ?

 M.

[MichF47603]

Hi,

i tap the Input Datastream (Device-to-9KSwitch) and get all Frames and a Bandwith ~6Mb/s that received on Port1/31.

On the Logging PC after Switch (on Port1/30) i measured only a Bandwith ~40Kb/s and only Frames <=1514Bytes.

At Cisco Console "show interface..." i see at:

Input-Port1/31:

input rate 6.12 Mbps, 3.53 Kpps; output rate 9.24 Kbps, 9 pps
RX
6250922 unicast packets 1750 multicast packets 0 broadcast packets
6252672 input packets 1340142379 bytes
192998 jumbo packets

 Output-Port1/30:

output rate 42.31 Kbps
TX
1544 unicast packets 15490 multicast packets 1827 broadcast packets
18861 output packets 1757565 bytes
47 jumbo packets

How could i create a meaningful log?

Thx and BR,

Michael

[MichF47603 · Accepted solution]

Hi,

now we found the issue.

Some Input Datastreams include an VLAN-Tag in the Frame. That was the rerason why the InputPort1/31 refusal some Frames. Only Frames without VLAN-Tag were forwarded.

We extract the incoming VLAN-Tag and now it works.

Best Regards,

Michael