Problem Cisco Catalyst 3850 input errors

[killroy]

Ive installed two stacked Catalyst 3850s. Connected to these two switches I have a SAN 6210 Equallogic Dell ESX .

The interfaces on the switches  is bundels with Port-channel. MTU size 9198. On swich one its no problem but on switch two I see input errors on these interface.

If I move the cables from switch two to one then its ok...

I have two 10G going to the SAN. And 4 ESX server with 2 ISCSI each.

?????

interface Port-channel21
 description ESX1 ISCSI SAN
 switchport access vlan 21
 switchport mode access
 flowcontrol receive desired
 spanning-tree portfast
 spanning-tree bpduguard enable
 

Port-channel21 is up, line protocol is up (connected)
  Hardware is EtherChannel, address is 
  Description: ESX1 ISCSI SAN
  MTU 9198 bytes, BW 2000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 17/255, rxload 16/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 1000Mb/s, link type is auto, media type is
  input flow-control is off, output flow-control is unsupported
  Members in this channel: Gi1/0/25 Gi1/0/34
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:07:12, output never, output hang never
  Last clearing of "show interface" counters 1d21h
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 128760000 bits/sec, 8233 packets/sec
  5 minute output rate 137021000 bits/sec, 7343 packets/sec
     520088013 packets input, 1454135312 bytes, 0 no buffer
     Received 1088 broadcasts (0 multicasts)
     0 runts, 0 giants, 0 throttles
     1534 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 input packets with dribble condition detected
     564793180 packets output, 978716517 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out
 

[Madhukrishnan Gopinathan Nair]

Hi,

it could be a bad port on the switch ? When you move port to switch one, is there any patch-panel ports being moved ? If so you may check on that too.

Else try a differnt port on switch 2 to see if it also take errors.

Hope this helps,

Thanks,

Madhu

[killroy]

Hi
Dont think its a port since Ive got the problem on all ports connected to the SAN and ESX. 4 1G and 1 10G on switch two connected to the ESXs and SAN.

[Leo Laohoo · Accepted solution]

 Full-duplex, 1000Mb/s, link type is auto, media type is

What is the configuration of each of the physical ports?  Is speed/duplex settings hard-coded?  If so, then this is the cause of your CRC errors.  For further information about what are the counters which triggered the CRC errors, post the output to the command "sh controll e Gi<PHYSICAL PORTS>".  

[killroy]

Hi
Port setting is auto. No CRC errors  just input errors.
But sh controll  e g1/0/25  and g2/0/25 shows a differens on InvalidOverSize frames.

Could it be I startded switch one first and set the MTU to 9000 and later installed switch two? Since it seems that bigger mtu size than 1500 dosnt fit in.....?

g2/0/25         Problem                                              g1/0/25   OK

319527 1519 to 2047 byte frames           98544 1519 to 2047 byte frames
          0 2048 to 4095 byte frames       5290078 2048 to 4095 byte frames
          0 4096 to 8191 byte frames       4163444 4096 to 8191 byte frames
          0 8192 to 16383 byte frames   57868896 8192 to 16383 byte frames
          0 16384 to 32767 byte frame               0 16384 to 32767 byte frame
          0 > 32768 byte frames                         0 > 32768 byte frames
          0 SymbolErr frames                             0 SymbolErr frames
          0 Collision fragments                           0 Collision fragments
          0 ValidUnderSize frames                     0 ValidUnderSize frames
319524 InvalidOverSize frames                     0 InvalidOverSize frames
          3 ValidOverSize frames                       0 ValidOverSize frames
          0 FcsErr frames                                   0 FcsErr frames

[Leo Laohoo]

g2/0/25         Problem                                              g1/0/25   OK

319527 1519 to 2047 byte frames           98544 1519 to 2047 byte frames
          0 2048 to 4095 byte frames       5290078 2048 to 4095 byte frames
          0 4096 to 8191 byte frames       4163444 4096 to 8191 byte frames
          0 8192 to 16383 byte frames   57868896 8192 to 16383 byte frames
          0 16384 to 32767 byte frame               0 16384 to 32767 byte frame
          0 > 32768 byte frames                         0 > 32768 byte frames
          0 SymbolErr frames                             0 SymbolErr frames
          0 Collision fragments                           0 Collision fragments
          0 ValidUnderSize frames                     0 ValidUnderSize frames
319524 InvalidOverSize frames                     0 InvalidOverSize frames
          3 ValidOverSize frames                       0 ValidOverSize frames
          0 FcsErr frames                                   0 FcsErr frames

Something is wrong with this output.  If you need us to provide you with assistance I want to see the COMPLETE output.  :P

[killroy]

Hi and Sorry Just copied and past the part that I thought  was the problem. It seems that MTU size on switch two in the stack still has MTU 1500......

So here is the lot....

This interface is OK

sh controllers ethernet-controller g1/0/25
Transmit                  GigabitEthernet1/0/25                 Receive
2373084674113 Total bytes               2700589618458 Total bytes
   1259517537 Unicast frames               1355829627 Unicast frames
2373055994149 Unicast bytes             2700589410330 Unicast bytes
       314726 Multicast frames                      0 Multicast frames
     25604588 Multicast bytes                       0 Multicast bytes
        44657 Broadcast frames                   3252 Broadcast frames
      3075376 Broadcast bytes                  208128 Broadcast bytes
            0 System FCS error frames               0 IpgViolation frames
            0 MacUnderrun frames                    0 MacOverrun frames
            0 Pause frames                          0 Pause frames
            0 Cos 0 Pause frames                    0 Cos 0 Pause frames
            0 Cos 1 Pause frames                    0 Cos 1 Pause frames
            0 Cos 2 Pause frames                    0 Cos 2 Pause frames
            0 Cos 3 Pause frames                    0 Cos 3 Pause frames
            0 Cos 4 Pause frames                    0 Cos 4 Pause frames
            0 Cos 5 Pause frames                    0 Cos 5 Pause frames
            0 Cos 6 Pause frames                    0 Cos 6 Pause frames
            0 Cos 7 Pause frames                    0 Cos 7 Pause frames
            0 Oam frames                            0 OamProcessed frames
            0 Oam frames                            0 OamDropped frames
       423237 Minimum size frames               78563 Minimum size frames
    593742624 65 to 127 byte frames         338414660 65 to 127 byte frames
      1416083 128 to 255 byte frames          4836098 128 to 255 byte frames
       558097 256 to 511 byte frames          1505992 256 to 511 byte frames
      5464138 512 to 1023 byte frames         6457219 512 to 1023 byte frames
    472854085 1024 to 1518 byte frames      834470341 1024 to 1518 byte frames
        80781 1519 to 2047 byte frames         257961 1519 to 2047 byte frames
      2891352 2048 to 4095 byte frames       13701476 2048 to 4095 byte frames
     14353508 4096 to 8191 byte frames        8698824 4096 to 8191 byte frames
    168093015 8192 to 16383 byte frames     147411745 8192 to 16383 byte frames
            0 16384 to 32767 byte frame             0 16384 to 32767 byte frame
            0 > 32768 byte frames                   0 > 32768 byte frames
            0 Late collision frames                 0 SymbolErr frames
            0 Excess Defer frames                   0 Collision fragments
            0 Good (1 coll) frames                  0 ValidUnderSize frames
            0 Good (>1 coll) frames                 0 InvalidOverSize frames
            0 Deferred frames                       0 ValidOverSize frames
            0 Gold frames dropped                   0 FcsErr frames
            0 Gold frames truncated
            0 Gold frames successful
            0 1 collision frames
            0 2 collision frames
            0 3 collision frames
            0 4 collision frames
            0 5 collision frames
            0 6 collision frames
            0 7 collision frames
            0 8 collision frames
            0 9 collision frames
            0 10 collision frames
            0 11 collision frames
            0 12 collision frames
            0 13 collision frames
            0 14 collision frames
            0 15 collision frames
            0 Excess collision frames

LAST UPDATE 4870 msecs AGO

This interface have problem. It is in portchannel with g1/0/25. Ive got more interfaces and port-channels showing the same behavior for switch two in my cluster.

sh controllers ethernet-controller g2/0/25
Transmit                  GigabitEthernet2/0/25                 Receive
 925460044357 Total bytes                201085804055 Total bytes
    702370104 Unicast frames                184041790 Unicast frames
 925449913241 Unicast bytes              201085599895 Unicast bytes
       118823 Multicast frames                      0 Multicast frames
      9171804 Multicast bytes                       0 Multicast bytes
        14251 Broadcast frames                   3190 Broadcast frames
       959312 Broadcast bytes                  204160 Broadcast bytes
            0 System FCS error frames               0 IpgViolation frames
            0 MacUnderrun frames                    0 MacOverrun frames
            0 Pause frames                          0 Pause frames
            0 Cos 0 Pause frames                    0 Cos 0 Pause frames
            0 Cos 1 Pause frames                    0 Cos 1 Pause frames
            0 Cos 2 Pause frames                    0 Cos 2 Pause frames
            0 Cos 3 Pause frames                    0 Cos 3 Pause frames
            0 Cos 4 Pause frames                    0 Cos 4 Pause frames
            0 Cos 5 Pause frames                    0 Cos 5 Pause frames
            0 Cos 6 Pause frames                    0 Cos 6 Pause frames
            0 Cos 7 Pause frames                    0 Cos 7 Pause frames
            0 Oam frames                            0 OamProcessed frames
            0 Oam frames                            0 OamDropped frames
       155980 Minimum size frames                3226 Minimum size frames
     92357460 65 to 127 byte frames          52503630 65 to 127 byte frames
       542363 128 to 255 byte frames           660137 128 to 255 byte frames
      1843346 256 to 511 byte frames           500600 256 to 511 byte frames
      6158096 512 to 1023 byte frames         1116353 512 to 1023 byte frames
    601445933 1024 to 1518 byte frames      129261034 1024 to 1518 byte frames
            0 1519 to 2047 byte frames         319527 1519 to 2047 byte frames
            0 2048 to 4095 byte frames              0 2048 to 4095 byte frames
            0 4096 to 8191 byte frames              0 4096 to 8191 byte frames
            0 8192 to 16383 byte frames             0 8192 to 16383 byte frames
            0 16384 to 32767 byte frame             0 16384 to 32767 byte frame
            0 > 32768 byte frames                   0 > 32768 byte frames
            0 Late collision frames                 0 SymbolErr frames
            0 Excess Defer frames                   0 Collision fragments
            0 Good (1 coll) frames                  0 ValidUnderSize frames
            0 Good (>1 coll) frames            319524 InvalidOverSize frames
            0 Deferred frames                       3 ValidOverSize frames
            0 Gold frames dropped                   0 FcsErr frames
            0 Gold frames truncated
            0 Gold frames successful
            0 1 collision frames
            0 2 collision frames
            0 3 collision frames
            0 4 collision frames
            0 5 collision frames
            0 6 collision frames
            0 7 collision frames
            0 8 collision frames
            0 9 collision frames
            0 10 collision frames
            0 11 collision frames
            0 12 collision frames
            0 13 collision frames
            0 14 collision frames
            0 15 collision frames
            0 Excess collision frames
 

[Leo Laohoo]

1534 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored

The reason why I asked for those output because this output from the "sh interface Po21" DO NOT MATCH the output of the "sh controller e <BLAH>".  
 

This leads me to believe you're most likely looking at an IOS bug.

Another reason why this could be a bug is because "input errors" has something but the rest of the line is "0"?  Nah, it's an IOS bug to me. 

[killroy]

Hi.
Tested to redo the command system mtu 9000.  And now it works........
on the old 3750 you had to restart the switch but not with the 3850...........
Why it didnt work to just add switch 2 to the cluster. Dont know
THX for the help