A 2960X from a stack stops responding to snmp, blocks displaying information about a particular SFP port and reloads some hours later
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-22-2018 02:32 AM - edited 03-08-2019 04:52 PM
Hello,
It happened to 2 similar 2960X stacks (not at the same time).
These stacks are queried at regular basis by an MRTG server through SNMP.
Suddenly the stack stops responding to snmp queries. I succeeded in activating snmp debug once, so I saw incoming requests logged by the switch, but no packet has been sent in reply (I wonder if packet treatment is not achieved after retry query arrives). So, some time later appears the following message:
Dec 18 18:53:29 cisco-1-10 -: 2233966: 2233872: Dec 18 17:53:28: %SNMP-3-INPUT_QFULL_ERR: Packet dropped due to input
Dec 18 18:53:29 cisco-1-10 -: 2233967: queue full
The situation escalates to multiple panics for HRPC:
Dec 19 04:26:37 cisco-1-10 -: 2263213: 2248879: Dec 19 03:26:36: %SYS-2-MALLOCFAIL: Memory allocation of 42544 bytes failed from 0x290F6CC, alignment 0
Dec 19 04:26:37 cisco-1-10 -: 2263214: Pool: Processor Free: 135964 Cause: Memory fragmentation
Dec 19 04:26:37 cisco-1-10 -: 2263215: Alternate Pool: None Free: 0 Cause: No Alternate pool
Dec 19 04:26:37 cisco-1-10 -: 2263216: -Process= "HRPC qos request handler", ipl= 0, pid= 172
Dec 19 04:26:37 cisco-1-10 -: 2263217: -Traceback= 54E64Cz 21C4FA4z 21CDC7Cz 2FF2D50z 290F6D0z 2E32A68z 2E2E764z
And finally one of the switches reloads automatically.
I have to mention that once the snmp stops responding (or even before ?) the following command is blocked until the switch reloads automatically:
Dec 19 04:32:21 cisco-1-10 -: 2263574: 2248974: Dec 19 03:32:20: %ENTROPY-0-ENTROPY_ERROR: Unable to collect sufficient entropy
Here is a part of the inventory command:
PID: WS-C2960X-48TD-L , VID: V05 , SN: FOCXXXXXXXX
PID: C2960X-STACK , VID: V01 , SN: FOCXXXXXXXX
PID: , VID: , SN: XXXXXX
---------
Switch Uptime : 3 days, 6 hours, 3 minutes
Base ethernet MAC Address : 04:2A:E2:DC:FF:00
Motherboard assembly number : 73-16688-03
Power supply part number : 341-0537-02
Motherboard serial number : FOCXXXXXXXX
Power supply serial number : DCB194981P8
Model revision number : M0
Motherboard revision number : B0
Model number : WS-C2960X-48TD-L
Daughterboard assembly number : 73-14200-03
Daughterboard serial number : FOCXXXXXXXX
System serial number : FOCXXXXXXXX
Top assembly part number : 68-100466-01
Top assembly revision number : B0
Version ID : V05
CLEI Code Number : CMMNH00ARD
Daughterboard revision number : A0
System returned to ROM by power-on
System restarted at 12:45:43 UTC Fri Jan 6 2017
System image file is "flash:/c2960x-universalk9-mz.152-2.E3/c2960x-universalk9-mz.152-2.E3.bin"
Last reload reason: Reload command
- Labels:
-
LAN Switching
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-22-2018 02:47 AM
- Could be a software bug ; check for more recent releases for your platform(s), if any.
M.
-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-28-2018 05:31 AM
Hi,
OK, I updated to c2960x-universalk9-mz.152-2.E9.bin (because of 2960X and 2960S mix).
Not sure to be able to say if solved the issue or not as it appears less than once per year...
