Jumbo Frames not Working cisco 9300 or 3650 - Page 2

nishantagrawal0322 · ‎04-19-2023

Hello Friends. We have a situation.

Current Setup:- VMware-->Cisco 3750-->>NetApp iscsi. Jumbo frames enabled mtu 9000 bytes. VMWare Storage Resides on NetApp Via ISCSI using switch 3750.

We would like to replace the cisco 3750 with Catalyst 3650. Exact same configuration. The issue we are running into is when we move our connections from (existing 3750) to new 3650, vmware gets stuck on refreshing the storage. The weird thing is we can ping everything from all devices, it's just the storage cannot be scanned and updated. That is the only reason I'm thinkin the Global MTU on new 3650 should be 9000 (same as existing 3750) or should it be set to max which is 9198 bytes. Any help/assistance would be appreciated.

MHM Cisco World · ‎04-24-2023

TenGigabitEthernet2/1/1 0x4f 1 0 1 28 0 0 3 29 125 NIF N

Server-Switch3#show platform software fed switch active ifm if-id 0x4f | inc MTU

nishantagrawal0322 · ‎04-24-2023

rm software fed switch active ifm if-id 0x4f | inc MTU
Jumbo MTU ............ [0]

nishantagrawal0322 · ‎04-24-2023

sh controlelrs

nishantagrawal0322 · ‎04-24-2023

Here are some more commands I ran following your. Since we have a stack of 2 switches, it shows 0 on active switch and 9000 & 9198 on standby switches....how do I fix that?

Server-Switch3#sh platform software fed switch active ifm if-id 0x9 | inc MTU
Jumbo MTU ............ [0]
Server-Switch3#sh platform software fed switch st ifm if-id 0x9 | inc MTU
Server-Switch3#sh platform software fed switch standby ifm if-id 0x9 | inc MTU
Jumbo MTU ............ [9198]
Server-Switch3#$ software fed switch standby ifm if-id 0xf | inc MTU
Jumbo MTU ............ [9000]
Server-Switch3#$ software fed switch active ifm if-id 0xf | inc MTU
Jumbo MTU ............ [0]

MHM Cisco World · ‎04-24-2023

you use active and standby correct but are the if-id of active and standby is same ?

nishantagrawal0322 · ‎04-24-2023

meaning? or How do I check it?

MHM Cisco World · ‎04-24-2023

you use if-id in same switch active and switch standby, are both show same if-id ?

nishantagrawal0322 · ‎04-24-2023

do I use this same command?

sh platform software fed switch active ifm if-id 0x9 | inc MTU

MHM Cisco World · ‎04-24-2023

Server-Switch3#show platform software fed switch standby ifm mappings
then use
sh platform software fed switch stnadby ifm if-id ???? | inc MTU

nishantagrawal0322 · ‎04-24-2023

Server-Switch3#show platform software fed switch standby ifm mappings
Interface IF_ID Inst Asic Core Port SubPort Mac Cntx LPN GP N Type Active
GigabitEthernet1/0/1 0x9 1 0 1 0 0 26 6 1 1 NIF Y
GigabitEthernet1/0/2 0xa 1 0 1 1 0 6 7 2 2 NIF Y
GigabitEthernet1/0/3 0xb 1 0 1 2 0 28 8 3 3 NIF Y
GigabitEthernet1/0/4 0xc 1 0 1 3 0 27 9 4 4 NIF Y
GigabitEthernet1/0/5 0xd 1 0 1 4 0 30 10 5 5 NIF Y
GigabitEthernet1/0/6 0xe 1 0 1 5 0 29 11 6 6 NIF Y
GigabitEthernet1/0/7 0xf 1 0 1 6 0 32 12 7 7 NIF Y
GigabitEthernet1/0/8 0x10 1 0 1 7 0 31 13 8 8 NIF Y
GigabitEthernet1/0/9 0x11 1 0 1 8 0 19 14 9 9 NIF Y
GigabitEthernet1/0/10 0x12 1 0 1 9 0 5 15 10 1 0 NIF Y
GigabitEthernet1/0/11 0x13 1 0 1 10 0 21 16 11 1 1 NIF Y
GigabitEthernet1/0/12 0x14 1 0 1 11 0 20 17 12 1 2 NIF Y
GigabitEthernet1/0/13 0x15 1 0 1 12 0 23 18 13 1 3 NIF Y
GigabitEthernet1/0/14 0x16 1 0 1 13 0 22 19 14 1 4 NIF Y
GigabitEthernet1/0/15 0x17 1 0 1 14 0 25 20 15 1 5 NIF Y
GigabitEthernet1/0/16 0x18 1 0 1 15 0 24 21 16 1 6 NIF Y
GigabitEthernet1/0/17 0x19 0 0 0 16 0 26 6 17 1 7 NIF Y
GigabitEthernet1/0/18 0x1a 0 0 0 17 0 6 7 18 1 8 NIF Y
GigabitEthernet1/0/19 0x1b 0 0 0 18 0 28 8 19 1 9 NIF Y
GigabitEthernet1/0/20 0x1c 0 0 0 19 0 27 9 20 2 0 NIF Y
GigabitEthernet1/0/21 0x1d 0 0 0 20 0 30 10 21 2 1 NIF Y
GigabitEthernet1/0/22 0x1e 0 0 0 21 0 29 11 22 2 2 NIF Y
GigabitEthernet1/0/23 0x1f 0 0 0 22 0 32 12 23 2 3 NIF Y
GigabitEthernet1/0/24 0x20 0 0 0 23 0 31 13 24 2 4 NIF Y
GigabitEthernet1/1/1 0x21 1 0 1 24 0 3 4 25 2 5 NIF Y
GigabitEthernet1/1/2 0x22 1 0 1 25 0 2 5 26 2 6 NIF Y
GigabitEthernet1/1/3 0x23 0 0 0 26 0 3 4 27 2 7 NIF Y
GigabitEthernet1/1/4 0x24 0 0 0 27 0 2 5 28 2 8 NIF Y
TenGigabitEthernet1/1/1 0x25 1 0 1 28 0 0 3 29 2 9 NIF N
TenGigabitEthernet1/1/2 0x26 1 0 1 29 0 0 2 30 3 0 NIF N
TenGigabitEthernet1/1/3 0x27 1 0 1 30 0 0 1 31 3 1 NIF N
TenGigabitEthernet1/1/4 0x28 1 0 1 31 0 0 0 32 3 2 NIF N
TenGigabitEthernet1/1/5 0x29 0 0 0 32 0 0 3 33 3 3 NIF N
TenGigabitEthernet1/1/6 0x2a 0 0 0 33 0 0 2 34 3 4 NIF N
TenGigabitEthernet1/1/7 0x2b 0 0 0 34 0 0 1 35 3 5 NIF N
TenGigabitEthernet1/1/8 0x2c 0 0 0 35 0 0 0 36 3 6 NIF N
FortyGigabitEthernet1/1/1 0x2d 1 0 1 36 0 0 0 37 3 7 NIF N
FortyGigabitEthernet1/1/2 0x2e 0 0 0 37 0 0 0 38 3 8 NIF N
TwentyFiveGigE1/1/1 0x2f 1 0 1 38 0 0 0 39 3 9 NIF N
TwentyFiveGigE1/1/2 0x30 0 0 0 39 0 0 0 40 4 0 NIF N
AppGigabitEthernet1/0/1 0x31 1 0 1 40 0 11 22 41 4 1 NIF Y

nishantagrawal0322 · ‎04-24-2023

Server-Switch3#show platform software fed switch Active ifm mappings
Interface IF_ID Inst Asic Core Port SubPort Mac Cntx LPN GPN Type Active
GigabitEthernet2/0/1 0x33 1 0 1 0 0 26 6 1 97 NIF Y
GigabitEthernet2/0/2 0x34 1 0 1 1 0 6 7 2 98 NIF Y
GigabitEthernet2/0/3 0x35 1 0 1 2 0 28 8 3 99 NIF Y
GigabitEthernet2/0/4 0x36 1 0 1 3 0 27 9 4 100 NIF Y
GigabitEthernet2/0/5 0x37 1 0 1 4 0 30 10 5 101 NIF Y
GigabitEthernet2/0/6 0x38 1 0 1 5 0 29 11 6 102 NIF Y
GigabitEthernet2/0/7 0x39 1 0 1 6 0 32 12 7 103 NIF Y
GigabitEthernet2/0/8 0x3a 1 0 1 7 0 31 13 8 104 NIF Y
GigabitEthernet2/0/9 0x3b 1 0 1 8 0 19 14 9 105 NIF Y
GigabitEthernet2/0/10 0x3c 1 0 1 9 0 5 15 10 106 NIF Y
GigabitEthernet2/0/11 0x3d 1 0 1 10 0 21 16 11 107 NIF Y
GigabitEthernet2/0/12 0x3e 1 0 1 11 0 20 17 12 108 NIF Y
GigabitEthernet2/0/13 0x3f 1 0 1 12 0 23 18 13 109 NIF Y
GigabitEthernet2/0/14 0x40 1 0 1 13 0 22 19 14 110 NIF Y
GigabitEthernet2/0/15 0x41 1 0 1 14 0 25 20 15 111 NIF Y
GigabitEthernet2/0/16 0x42 1 0 1 15 0 24 21 16 112 NIF Y
GigabitEthernet2/0/17 0x43 0 0 0 16 0 26 6 17 113 NIF Y
GigabitEthernet2/0/18 0x44 0 0 0 17 0 6 7 18 114 NIF Y
GigabitEthernet2/0/19 0x45 0 0 0 18 0 28 8 19 115 NIF Y
GigabitEthernet2/0/20 0x46 0 0 0 19 0 27 9 20 116 NIF Y
GigabitEthernet2/0/21 0x47 0 0 0 20 0 30 10 21 117 NIF Y
GigabitEthernet2/0/22 0x48 0 0 0 21 0 29 11 22 118 NIF Y
GigabitEthernet2/0/23 0x49 0 0 0 22 0 32 12 23 119 NIF Y
GigabitEthernet2/0/24 0x4a 0 0 0 23 0 31 13 24 120 NIF Y
GigabitEthernet2/1/1 0x4b 1 0 1 24 0 3 4 25 121 NIF Y
GigabitEthernet2/1/2 0x4c 1 0 1 25 0 2 5 26 122 NIF Y
GigabitEthernet2/1/3 0x4d 0 0 0 26 0 3 4 27 123 NIF Y
GigabitEthernet2/1/4 0x4e 0 0 0 27 0 2 5 28 124 NIF Y
TenGigabitEthernet2/1/1 0x4f 1 0 1 28 0 0 3 29 125 NIF N
TenGigabitEthernet2/1/2 0x50 1 0 1 29 0 0 2 30 126 NIF N
TenGigabitEthernet2/1/3 0x51 1 0 1 30 0 0 1 31 127 NIF N
TenGigabitEthernet2/1/4 0x52 1 0 1 31 0 0 0 32 128 NIF N
TenGigabitEthernet2/1/5 0x53 0 0 0 32 0 0 3 33 129 NIF N
TenGigabitEthernet2/1/6 0x54 0 0 0 33 0 0 2 34 130 NIF N
TenGigabitEthernet2/1/7 0x55 0 0 0 34 0 0 1 35 131 NIF N
TenGigabitEthernet2/1/8 0x56 0 0 0 35 0 0 0 36 132 NIF N
FortyGigabitEthernet2/1/1 0x57 1 0 1 36 0 0 0 37 133 NIF N
FortyGigabitEthernet2/1/2 0x58 0 0 0 37 0 0 0 38 134 NIF N
TwentyFiveGigE2/1/1 0x59 1 0 1 38 0 0 0 39 135 NIF N
TwentyFiveGigE2/1/2 0x5a 0 0 0 39 0 0 0 40 136 NIF N
AppGigabitEthernet2/0/1 0x5b 1 0 1 40 0 11 22 41 137 NIF Y

MHM Cisco World · ‎04-24-2023

sh platform software fed switch standby ifm if-id (select any interface with jumboframe ) | inc MTU

nishantagrawal0322 · ‎04-24-2023

Here you go:- all 6 ports which are in question. 1 quick note, gi1/1/1 and gi2/1/1 are in port-channel 5

Server-Switch3#$ software fed switch standby ifm if-id 0x18 | inc MTU
Jumbo MTU ............ [9198]
Server-Switch3#$ software fed switch standby ifm if-id 0x1b | inc MTU
Jumbo MTU ............ [9198]
Server-Switch3#$ software fed switch standby ifm if-id 0x25 | inc MTU
Jumbo MTU ............ [0]
Server-Switch3#
Server-Switch3#
Server-Switch3#$ software fed switch active ifm if-id 0x42 | inc MTU
Jumbo MTU ............ [9198]
Server-Switch3#
Server-Switch3#
Server-Switch3#$ software fed switch active ifm if-id 0x45 | inc MTU
Jumbo MTU ............ [9198]
Server-Switch3#
Server-Switch3#
Server-Switch3#$ software fed switch active ifm if-id 0x21 | inc MTU
Jumbo MTU ............ [0]
Server-Switch3#

nishantagrawal0322 · ‎04-24-2023

And Port-Channel 5 has an MTU of 9198..

Server-Switch3#sh int port-channel 5
Port-channel5 is down, line protocol is down (notconnect)
Hardware is EtherChannel, address is 0000.0000.0000 (bia 0000.0000.0000)
MTU 9198 bytes, BW 100000 Kbit/sec, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Auto-duplex, Auto-speed, link type is auto, media type is N/A
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 4d00h, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
3035956 packets input, 2848692776 bytes, 0 no buffer
Received 2052 broadcasts (1874 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 1874 multicast, 0 pause input
0 input packets with dribble condition detected
1971545 packets output, 739662502 bytes, 0 underruns
Output 105613 broadcasts (72827 multicasts)
0 output errors, 0 collisions, 1 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

nishantagrawal0322 · ‎04-24-2023

On another note, here is my int config from working 3750X switch. The packet output is so huge.... you can check..

Server-Switch#sh int gi1/1/1
GigabitEthernet1/1/1 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is bc16.65d9.5d19 (bia bc16.65d9.5d19)
Description: TO STORAGE CONTROLLER1
MTU 9000 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 3/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 1000Mb/s, link type is auto, media type is 10/100/1000BaseTX SFP
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:30, output 00:00:26, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 975862
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 12981000 bits/sec, 1175 packets/sec
5 minute output rate 462000 bits/sec, 358 packets/sec
259698981634 packets input, 355149298998817 bytes, 0 no buffer
Received 11778967 broadcasts (11006676 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 11006676 multicast, 0 pause input
0 input packets with dribble condition detected
73394748230 packets output, 15848695611869 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out