05-12-2021 04:43 AM
Hi all,
i just saw problem with increasing total output drops on interfaces at cat 2960s (WS-C2960S-48LPD-L ver. 12.2(55)SE8)
problem is on every connected interfaces, some with ip phones others with PCs and uplink interface, everywhere total output drops are growing..
have You ever met this problem?
i think this is cause of some dropped calls, am I right?
Can you give me tips to solve this problem, is it something with buffers?
some output from 2960
SW_01_FN#sh cdp neighbors
[...]
SEPXXXXXXXX03B4 Gig 1/0/40 160 H P M IP Phone Port 1
SW_CORE Ten 1/0/1 159 R S I WS-C4900M Ten 1/8
SW_01_FN#sh interfaces Ten 1/0/1 controller
TenGigabitEthernet1/0/1 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet, address is 8890.8d77.9cb3 (bia 8890.8d77.9cb3)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s, link type is auto, media type is SFP-10GBase-LR
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 6396000 bits/sec, 627 packets/sec
5 minute output rate 171000 bits/sec, 146 packets/sec
23432326619 packets input, 29414699465995 bytes, 0 no buffer
Received 528643405 broadcasts (282821393 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 282821393 multicast, 0 pause input
0 input packets with dribble condition detected
1997392176 packets output, 822116387140 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out
Transmit TenGigabitEthernet1/0/1 Receive
822116389017 Bytes 827397147767 Bytes
1989069832 Unicast frames 1428846739 Unicast frames
5007536 Multicast frames 282821405 Multicast frames
3314816 Broadcast frames 245822014 Broadcast frames
0 Too old frames 674820523933 Unicast bytes
0 Deferred frames 44251232199 Multicast bytes
0 MTU exceeded frames 22901356306 Broadcast bytes
0 1 collision frames 0 Alignment errors
0 2 collision frames 0 FCS errors
0 3 collision frames 0 Oversize frames
0 4 collision frames 0 Undersize frames
0 5 collision frames 0 Collision fragments
0 6 collision frames
0 7 collision frames 888216750 Minimum size frames
0 8 collision frames 2822799945 65 to 127 byte frames
0 9 collision frames 377699383 128 to 255 byte frames
0 10 collision frames 164511705 256 to 511 byte frames
0 11 collision frames 185105648 512 to 1023 byte frames
0 12 collision frames 663030773 1024 to 1518 byte frames
0 13 collision frames 0 Overrun frames
0 14 collision frames 0 Pause frames
0 15 collision frames
0 Excessive collisions 0 Symbol error frames
0 Late collisions 0 Invalid frames, too large
0 VLAN discard frames 1151093250 Valid frames, too large
0 Excess defer frames 0 Invalid frames, too small
199377653 64 byte frames 0 Valid frames, too small
1028036295 127 byte frames
215058938 255 byte frames 0 Too old frames
88988489 511 byte frames 0 Valid oversize frames
52752833 1023 byte frames 0 System FCS error frames
246455608 1518 byte frames 0 RxPortFifoFull drop frame
166722368 Too large frames
0 Good (1 coll) frames
0 Good (>1 coll) frames
SW_01_FN# sh interfaces Gig 1/0/40 controller
GigabitEthernet1/0/40 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 8890.8d77.9ca8 (bia 8890.8d77.9ca8)
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:09, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 231416
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 5000 bits/sec, 3 packets/sec
5 minute output rate 12000 bits/sec, 4 packets/sec
248863550 packets input, 37639854880 bytes, 0 no buffer
Received 674016 broadcasts (579901 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 579901 multicast, 0 pause input
0 input packets with dribble condition detected
526136126 packets output, 165314024666 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out
Transmit GigabitEthernet1/0/40 Receive
2105267482 Bytes 3280116512 Bytes
296867166 Unicast frames 248189534 Unicast frames
87118777 Multicast frames 579901 Multicast frames
142150184 Broadcast frames 94115 Broadcast frames
0 Too old frames 3092616996 Unicast bytes
0 Deferred frames 131085424 Multicast bytes
0 MTU exceeded frames 24245840 Broadcast bytes
0 1 collision frames 0 Alignment errors
0 2 collision frames 0 FCS errors
0 3 collision frames 0 Oversize frames
0 4 collision frames 0 Undersize frames
0 5 collision frames 0 Collision fragments
0 6 collision frames
0 7 collision frames 21933060 Minimum size frames
0 8 collision frames 182686025 65 to 127 byte frames
0 9 collision frames 25693459 128 to 255 byte frames
0 10 collision frames 6864426 256 to 511 byte frames
0 11 collision frames 1920425 512 to 1023 byte frames
0 12 collision frames 9766155 1024 to 1518 byte frames
0 13 collision frames 0 Overrun frames
0 14 collision frames 0 Pause frames
0 15 collision frames
0 Excessive collisions 0 Symbol error frames
0 Late collisions 0 Invalid frames, too large
0 VLAN discard frames 0 Valid frames, too large
0 Excess defer frames 0 Invalid frames, too small
257575518 64 byte frames 0 Valid frames, too small
90258302 127 byte frames
58906139 255 byte frames 0 Too old frames
25052544 511 byte frames 0 Valid oversize frames
23721989 1023 byte frames 0 System FCS error frames
70621594 1518 byte frames 0 RxPortFifoFull drop frame
41 Too large frames
0 Good (1 coll) frames
0 Good (>1 coll) frames
and from core switch:
SW_CORE#sh interfaces Ten 1/8 controller
TenGigabitEthernet1/8 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet Port, address is e4d3.f136.4c47 (bia e4d3.f136.4c47)
Description: to SW_01_FN
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-LR
input flow-control is on, output flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:26, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 102000 bits/sec, 77 packets/sec
5 minute output rate 2840000 bits/sec, 299 packets/sec
462665429 packets input, 235060967683 bytes, 0 no buffer
Received 1634562 broadcasts (1063950 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
17800634200 packets output, 25267179478970 bytes, 0 underruns
0 output errors, 0 collisions, 3 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out
SW_CORE#sh interfaces Ten 1/8 controller
TenGigabitEthernet1/8 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet Port, address is e4d3.f136.4c47 (bia e4d3.f136.4c47)
Description: to SW_01_FN
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-LR
input flow-control is on, output flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:02, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 101000 bits/sec, 76 packets/sec
5 minute output rate 2807000 bits/sec, 296 packets/sec
462665617 packets input, 235060998075 bytes, 0 no buffer
Received 1634564 broadcasts (1063952 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
17800635050 packets output, 25267180360566 bytes, 0 underruns
0 output errors, 0 collisions, 3 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out
05-12-2021 04:58 AM
Is QoS enabled on the 2960S?
05-12-2021 05:01 AM
No, i didn't configure any qos, we can say that it's working on default setting.
05-12-2021 05:15 AM
@M.S.88 wrote:
No, i didn't configure any qos, we can say that it's working on default setting.
What is the output to the command "sh mls qos"?
05-12-2021 05:29 AM
just:
SW_01_FN#sh mls qos QoS is disabled QoS ip packet dscp rewrite is enabled
05-12-2021 05:31 AM
Change the port speed to 100 Mbps and see if the Total Output Drops are still incrementing.
05-12-2021 05:44 AM
i already changed on another port - no result
GigabitEthernet1/0/45 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 6899.cd4d.532d (bia 6899.cd4d.532d)
MTU 1500 bytes, BW 100000 Kbit/sec, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 100Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:11, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 84753
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 12000 bits/sec, 10 packets/sec
3472208 packets input, 1424318488 bytes, 0 no buffer
Received 588036 broadcasts (544627 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 544627 multicast, 0 pause input
0 input packets with dribble condition detected
306673165 packets output, 44678729498 bytes, 0 underruns
0 output errors, 0 collisions, 3 interface resets
115185 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
Transmit GigabitEthernet1/0/45 Receive
1729056916 Bytes 1424318488 Bytes
4880312 Unicast frames 2884172 Unicast frames
108685662 Multicast frames 544627 Multicast frames
193107196 Broadcast frames 43409 Broadcast frames
0 Too old frames 1282604659 Unicast bytes
0 Deferred frames 117652594 Multicast bytes
0 MTU exceeded frames 13847156 Broadcast bytes
0 1 collision frames 0 Alignment errors
0 2 collision frames 0 FCS errors
0 3 collision frames 0 Oversize frames
0 4 collision frames 0 Undersize frames
0 5 collision frames 0 Collision fragments
0 6 collision frames
0 7 collision frames 221375 Minimum size frames
0 8 collision frames 32034 65 to 127 byte frames
0 9 collision frames 2201801 128 to 255 byte frames
0 10 collision frames 184639 256 to 511 byte frames
0 11 collision frames 402590 512 to 1023 byte frames
0 12 collision frames 252313 1024 to 1518 byte frames
0 13 collision frames 0 Overrun frames
0 14 collision frames 0 Pause frames
0 15 collision frames
0 Excessive collisions 0 Symbol error frames
0 Late collisions 0 Invalid frames, too large
0 VLAN discard frames 177456 Valid frames, too large
0 Excess defer frames 0 Invalid frames, too small
185757745 64 byte frames 0 Valid frames, too small
56885890 127 byte frames
34430209 255 byte frames 0 Too old frames
6882298 511 byte frames 0 Valid oversize frames
16147420 1023 byte frames 0 System FCS error frames
6522260 1518 byte frames 0 RxPortFifoFull drop frame
47348 Too large frames
0 Good (1 coll) frames
0 Good (>1 coll) frames
05-12-2021 06:03 AM
@M.S.88 wrote:
i already changed on another port - no result
How would you know? You haven't cleared the interface counters after changing the port speed.
05-12-2021 06:35 AM
changed and cleared on interface 40 dedicated for ip-phone
GigabitEthernet1/0/40 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 6899.cd4d.5328 (bia 6899.cd4d.5328)
MTU 1500 bytes, BW 100000 Kbit/sec, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 100Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:56, output 00:00:00, output hang never
Last clearing of "show interface" counters 00:16:44
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 37
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 1000 bits/sec, 1 packets/sec
5 minute output rate 35000 bits/sec, 2 packets/sec
3087 packets input, 450612 bytes, 0 no buffer
Received 60 broadcasts (60 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 60 multicast, 0 pause input
0 input packets with dribble condition detected
6604 packets output, 5594400 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
Transmit GigabitEthernet1/0/40 Receive
1745610430 Bytes 3137566324 Bytes
246044163 Unicast frames 176980884 Unicast frames
93734761 Multicast frames 843080 Multicast frames
154342553 Broadcast frames 179954 Broadcast frames
0 Too old frames 2896150843 Unicast bytes
0 Deferred frames 164257539 Multicast bytes
0 MTU exceeded frames 34922044 Broadcast bytes
0 1 collision frames 0 Alignment errors
0 2 collision frames 0 FCS errors
0 3 collision frames 0 Oversize frames
0 4 collision frames 0 Undersize frames
0 5 collision frames 0 Collision fragments
0 6 collision frames
0 7 collision frames 14451012 Minimum size frames
0 8 collision frames 126714348 65 to 127 byte frames
0 9 collision frames 15150297 128 to 255 byte frames
0 10 collision frames 3331959 256 to 511 byte frames
0 11 collision frames 4582871 512 to 1023 byte frames
0 12 collision frames 13728909 1024 to 1518 byte frames
0 13 collision frames 0 Overrun frames
0 14 collision frames 0 Pause frames
0 15 collision frames
0 Excessive collisions 2 Symbol error frames
0 Late collisions 0 Invalid frames, too large
0 VLAN discard frames 44524 Valid frames, too large
0 Excess defer frames 0 Invalid frames, too small
150013884 64 byte frames 0 Valid frames, too small
73947400 127 byte frames
51313610 255 byte frames 0 Too old frames
24679198 511 byte frames 0 Valid oversize frames
40070447 1023 byte frames 0 System FCS error frames
154008472 1518 byte frames 0 RxPortFifoFull drop frame
88466 Too large frames
0 Good (1 coll) frames
0 Good (>1 coll) frames
05-12-2021 06:47 AM
Can you explain what that downstream client is?
Total Output Drops means the switch is feeding data downstream but the downstream client is sending "pause" frames back to the switch. When the switch receives the pause frames the data, meant for the downstream client, is held in a bucket. Once that bucket gets full, subsequent incoming data is discarded, hence Total Output Drop.
This means the downstream client does not have the capacity to process the incoming data.
05-12-2021 11:45 PM
Downstream client is Cisco ip phone 8865 with 1G port
05-13-2021 01:07 AM
@M.S.88 wrote:
Downstream client is Cisco ip phone 8865 with 1G port
Is there a computer connected to the phone?
05-13-2021 01:49 AM
yes on port GigabitEthernet1/0/40 it is, but on port GigabitEthernet1/0/45 isn't and i have drops on both.
05-13-2021 05:03 AM
Are there any drops on ports connected to printers?
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide