3750 Interface Total output drops incorrect

Jay Chang · ‎05-16-2011

Hi,

I am seeing Interface output drops that appera to be incorrect. When I do "Show Interface gi1/0/20", I will get interface output drops of "4294961382
". But, when I do the same command again it shows "0" drops. Is this a reporting error? I am ruinning c3750-ipservicesk9-mz.122-58.SE.bin on a 3750 stack with 2 switches in the stack. Thanks. Below is the output from the command line.

FC-InetSR3750E#sh int gi1/0/20
GigabitEthernet1/0/20 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 001e.bd47.2ac1 (bia 001e.bd47.2ac1)
Description: To-FC-PIXGUEST port E1
Internet address is 8.4.226.225/30
MTU 1500 bytes, BW 100000 Kbit/sec, DLY 100 usec,
     reliability 255/255, txload 3/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 100Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:07:42, output 00:00:33, output hang never
Last clearing of "show interface" counters 00:30:01
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 4294961382
Queueing strategy: fifo
Output queue: 0/40 (size/max)
30 second input rate 453000 bits/sec, 228 packets/sec
30 second output rate 1403000 bits/sec, 253 packets/sec
     491221 packets input, 118749636 bytes, 0 no buffer
     Received 1 broadcasts (0 IP multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 input packets with dribble condition detected
     631901 packets output, 526432525 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out
FC-InetSR3750E#sh con
FC-InetSR3750E#sh int gi1/0/20 coun
FC-InetSR3750E#sh int gi1/0/20 counters error

Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize OutDiscards
Gi1/0/20 0 0 0 0 0 0

Port      Single-Col Multi-Col   Late-Col Excess-Col Carri-Sen      Runts     Giants
Gi1/0/20           0          0          0           0          0          0          0
FC-InetSR3750E#sh int gi1/0/20
GigabitEthernet1/0/20 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 001e.bd47.2ac1 (bia 001e.bd47.2ac1)
Description: To-FC-PIXGUEST port E1
Internet address is 8.4.226.225/30
MTU 1500 bytes, BW 100000 Kbit/sec, DLY 100 usec,
     reliability 255/255, txload 5/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 100Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:08:20, output 00:00:12, output hang never
Last clearing of "show interface" counters 00:30:39
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
30 second input rate 507000 bits/sec, 291 packets/sec
30 second output rate 2076000 bits/sec, 341 packets/sec
     501499 packets input, 120921373 bytes, 0 no buffer
     Received 1 broadcasts (0 IP multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 input packets with dribble condition detected
     643994 packets output, 535787896 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out
FC-InetSR3750E#sh int gi1/0/20 counters error

Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize OutDiscards
Gi1/0/20 0 0 0 0 0 0

Port Single-Col Multi-Col Late-Col Excess-Col Carri-Sen Runts Giants
Gi1/0/20 0 0 0 0 0 0 0

andtoth · ‎05-17-2011

Hi Jay,

You are hitting the following known software defect: CSCso81660 - 3750 stack shows incorrect values for output drops

http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?method=fetchBugDetails&bugId=CSCso81660

Symptom:
3750 stack shows incorrect values for output drops on show interfaces

Conditions:

This is seen on 3750 G stacks running 12.2(44)SE or 12.2(44)SE1.

Workaround:
none

Further Problem Description:

The 'show platform port-asic stats drops' shows the correct values.
The issue is causing interoperablity issue with SNMP

This has been fixed in version 12.2(46)SE and 12.2(50)SE.

Best regards,

Andras

Jay Chang · ‎05-17-2011

I am using 12.2.58SE. Does this version have the same bug?

FC-InetSR3750E#sh ver
Cisco IOS Software, C3750 Software (C3750-IPSERVICESK9-M), Version 12.2(58)SE, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2011 by Cisco Systems, Inc.
Compiled Tue 05-Apr-11 08:31 by prod_rel_team

ROM: Bootstrap program is C3750 boot loader
BOOTLDR: C3750 Boot Loader (C3750-HBOOT-M) Version 12.2(44)SE5, RELEASE SOFTWARE (fc1)

FC-InetSR3750E uptime is 3 weeks, 4 days, 20 hours, 43 minutes
System returned to ROM by power-on
System restarted at 20:04:20 summer Thu Apr 21 2011
System image file is "flash:c3750-ipservicesk9-mz.122-58.SE.bin"

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html you require further assistance please contact us by sending email to
export@cisco.com. WS-C3750G-24PS (PowerPC405) processor (revision F0) with 131072K bytes of memory.
Processor board ID FOC1149Y54J
Last reset from power-on
6 Virtual Ethernet interfaces
56 Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

If

cisco

512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address       : 00:1E:BD:47:2A:80
Motherboard assembly number     : 73-10217-07
Power supply part number        : 341-0108-03
Motherboard serial number       : FOC11492F08
Power supply serial number      : AZS11491335
Model revision number           : F0
Motherboard revision number     : B0
Model number                    : WS-C3750G-24PS-E
System serial number            : FOC1149Y54J
Top Assembly Part Number        : 800-27482-01
Top Assembly Revision Number    : C0
Version ID                      : V05
CLEI Code Number                : CNMWT00ARC
Hardware Board Revision Number : 0x09

Switch Ports Model              SW Version            SW Image
------ ----- -----              ----------            ----------
     1 28    WS-C3750G-24PS     12.2(58)SE            C3750-IPSERVICESK9-M
*    2 28    WS-C3750G-24PS     12.2(58)SE            C3750-IPSERVICESK9-M

andtoth · ‎05-17-2011

Hi Jay,

If the output drops value is continously changing between 0 and a high value, it seems to be a software defect. I did not find known issues for 12.2(58)SE. I would recommend you to open a TAC case for this.

Best regards,

Andras

Florin Barhala · ‎05-18-2011

Hi Jay,

Beside the equipment output, do you really EXPERIENCE traffic drops?

Jay Chang · ‎05-18-2011

I don't experience any drops that I know of. All the applications seem to be working fine.

andtoth · ‎05-18-2011

Hi Jay,

This seems to be a cosmetic issue (drops are only reported in 'sh interface' output) as well as in defect CSCso81660 which is indeed fixed already in 12.2(58)SE, so it's likely another issue.

I would recommend contacting TAC to track this and investigate further to find out if a new defect has to be opened.

Best regards,

Andras

paolo bevilacqua · ‎05-27-2011

I have a stack of two -12S and the following apparent high drops.

QoS is not enabled.

Traffic - that is very moderate - flows normally. Running 12.2(50)SE3 and SE5.

Also seeing the same problem on 2960S, 3560 in the same network. all on gigabit interfaces.

Basically, we're unble to tell what are real drops and what are not, altough I suspect the figures on Port-channel interfaces are correct.

What is your opinion or advice ?

FG-SW-CORE#sh int summ

*: interface is up
IHQ: pkts in input hold queue     IQD: pkts dropped from input queue
OHQ: pkts in output hold queue    OQD: pkts dropped from output queue
RXBS: rx rate (bits/sec)          RXPS: rx rate (pkts/sec)
TXBS: tx rate (bits/sec)          TXPS: tx rate (pkts/sec)
TRTL: throttle count

Interface               IHQ   IQD OHQ   OQD RXBS RXPS TXBS TXPS TRTL
-------------------------------------------------------------------------
Vlan1                    0     0    0     0     0    0     0    0    0
* Vlan2                    0     0    0     0 5000    2     0    0    0
* Vlan3                    0     0    0     0     0    0     0    0    0
* Vlan4                    0     0    0     0     0    0     0    0    0
* Vlan5                    0     0    0     0     0    0     0    0    0
* Vlan6                    0     0    0     0     0    0     0    0    0
* Vlan9                    0     0    0     0     0    0     0    0    0
* Vlan14                   0     0    0     0     0    0     0    0    0
* Vlan15                   0     0    0     0     0    0     0    0    0
* Vlan17                   0     0    0     0     0    0     0    0    0
* Vlan19                   0     0    0     0     0    0     0    0    0
* Vlan23                   0     0    0     0     0    0     0    0    0
* Vlan50                   0     0    0     0 3000    3 3000    3    0
* Vlan99                   0     0    0     0 7000    8 2000    2    0
* Vlan100                  0    42    0     0 1000    3 3000    5    0
* Vlan101                  0     0    0     0     0    0     0    0    0
* GigabitEthernet1/0/1     0     0    0     0 287000 504 296000 519    0
* GigabitEthernet1/0/2     0     0    0     0 2000    2 70000   19    0
GigabitEthernet1/0/3     0     0    0     0     0    0     0    0    0
* GigabitEthernet1/0/4     0     0    0 1381 502000 910 12156000 1072    0
* GigabitEthernet1/0/5     0     0    0     0 7299000 1073 954000 283    0
* GigabitEthernet1/0/6     0     0    0 1326792 13000   17 162000   47    0
* GigabitEthernet1/0/7     0     0    0     0 34000   17 127000   56    0
* GigabitEthernet1/0/8     0     0    0     0 2000    2 8000   12    0
* GigabitEthernet1/0/9     0     0    0   789 13967000 1783 14085000 1806    0
GigabitEthernet1/0/10    0     0    0     0     0    0     0    0    0
* GigabitEthernet1/0/11    0     0    0     0 3000    3 11000   10    0
* GigabitEthernet1/0/12    0     0    0 80015248 1018000 133 137000 125    0
* GigabitEthernet2/0/1     0     0    0 5822 6337000 533 8873000 772    0
* GigabitEthernet2/0/2     0     0    0     0     0    0 59000   23    0
GigabitEthernet2/0/3     0     0    0     0     0    0     0    0    0
* GigabitEthernet2/0/4     0     0    0 5418 28047000 2682 9021000 1639    0
* GigabitEthernet2/0/5     0     0    0   447 2481000 350 19637000 2067    0
GigabitEthernet2/0/6     0     0    0     0     0    0     0    0    0
* GigabitEthernet2/0/7     0     0    0     0 76000   59 424000   85    0
* GigabitEthernet2/0/8     0     0    0     0     0    0     0    0    0
* GigabitEthernet2/0/9     0     0    0   491 3565000 444 1571000 290    0
* GigabitEthernet2/0/10    0     0    0 1324067 288000   68 372000   86    0
* GigabitEthernet2/0/11    0     0    0     0     0    0 7000    3    0
* GigabitEthernet2/0/12    0     0    0 1246593 4138000 399 354000 355    0
* Port-channel1            0     0    0 5822     0    0     0    0    0

Interface               IHQ   IQD OHQ   OQD RXBS RXPS TXBS TXPS TRTL
-------------------------------------------------------------------------
* Port-channel2            0     0    0     0     0    0     0    0    0
* Port-channel4            0     0    0 6799     0    0     0    0    0
* Port-channel5            0     0    0   447     0    0     0    0    0
* Port-channel7            0     0    0     0     0    0     0    0    0
* Port-channel8            0     0    0     0     0    0     0    0    0
* Port-channel9            0     0    0 1280     0    0     0    0    0
* Port-channel11           0     0    0     0     0    0     0    0    0
FG-SW-CORE#sh platform port-asic stats nonzero-drop

Port-asic Port Drop Statistics - Summary
========================================

Port 0 TxQueue Drop Stats: 322
Port 1 TxQueue Drop Stats: 88811
Port 2 TxQueue Drop Stats: 126
Port 3 TxQueue Drop Stats: 1415610

Supervisor TxQueue Drop Statistics
    Queue 3: 277850321
    Queue 6: 8852
    Queue 7: 120231
    Queue 8: 327898562
    Queue 10: 4285766
    Queue 11: 15

Port-asic Port Drop Statistics - Details
========================================
RxQueue Drop Statistics

Port 0 TxQueue Drop Statistics
Queue 1
Weight 0 Frames 322

Port 1 TxQueue Drop Statistics
    Queue 1
      Weight 0 Frames 322
    Queue 3
      Weight 2 Frames 88489

Port 2 TxQueue Drop Statistics
Queue 1
Weight 0 Frames 126

Port 3 TxQueue Drop Statistics
    Queue 1
      Weight 0 Frames 1224031
    Queue 1
      Weight 1 Frames 2
    Queue 1
      Weight 2 Frames 15
    Queue 3
      Weight 2 Frames 191562
Supervisor TxQueue Drop Statistics
    Queue 3: 277850321
    Queue 6: 8852
    Queue 7: 120231
    Queue 8: 327898562
    Queue 10: 4285766
    Queue 11: 15

paolo bevilacqua · ‎07-17-2011

Updated image to12.2(50)SE5, problem gone!

keanej · ‎06-25-2012

I am seeing this issue with the output drops -

Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 4292837015

The swtich is in a stack - its the second WS-C3750G-24PS and the software version is

c3750-ipservicesk9-mz.122-58.SE.bin

I thought bug - CSCso81660 was fixed in this version ? Any ideas ?

Regards

James

andtoth · ‎06-25-2012

Hi James,

Output drops might be due to real packet drops. Please check with the 'show platform port-asic stats drop gi ' command to see if drops are seen in hardware.

Please also refer to the following post:

https://supportforums.cisco.com/thread/2079859

Best regards,

Andras