2960x randomly reloads due to power-on CSCus47446

[tanner.zaitt]

Hello all!
I am in trouble:
My switch is WS-C2960X-48LPD-LB
The IOS is c2960x-universalk9-mz.152-2.E7.bin
I receive error messages:
Dec 28 09:17:52: %ILPOWER-7-DETECT: Interface Gi1/0/13: Power Device detected: Cisco PD
Dec 28 09:17:52: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/13: Power granted
Dec 28 09:17:52: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/13: PD removed
Dec 28 09:18:01: %ILPOWER-7-DETECT: Interface Gi1/0/13: Power Device detected: Cisco PD
Dec 28 09:18:01: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/13: PD removed
Dec 28 09:18:10: %ILPOWER-7-DETECT: Interface Gi1/0/13: Power Device detected: Cisco PD
Dec 28 09:18:10: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/13: PD removed
Behind this port, there is nothing connected!
I only see these error messages. Is it a possible unexpected reboot to be generated by the POE port issue?? I disabled Poe in the port and I disabled the port to see what will happen, I suspect bug CSCus47446
https://bst.cloudapps.cisco.com/bugsearch/bug/CSCus47446/?rfs=iqvred
But I support 11 of them and only one is with unexpected restarts too often, the difference between all other switches is only the part with Poe error in the interface g1/0/13.

[balaji.bandi]

Looks bug still not fixed any alternative solution offered by TAC, contact TAC they may have suggested for you short term fix..

[Georg Pauwen]

Hello,

according to the bug:

--> There is no crashinfo written. Reload reason is "power-on".

Is this what you see ?

Are these stacked or standalone switches ? If just this one switch is affected, and this is a standalone switch, it might be worth trying to upgrade to the latest release, release 15.2.7E3 MD (which is obviously not the recommended release, but it might fix the issue)...

[tanner.zaitt]

Yes, right, absolutely.
I will share more details:

sh logging onboard summary
UPTIME SUMMARY INFORMATION
--------------------------------------------------------------------------------
First customer power on : 10/16/2018 03:07:01
Total uptime : 0 years 5 weeks 4 days 3 hours 55 minutes
Total downtime : 0 years 51 weeks 3 days 7 hours 8 minutes
Number of resets : 7
Number of slot changes : 0
Current reset reason : 0x0
Current reset timestamp : 12/25/2020 01:14:16
Current slot : 1
Current uptime : 0 years 0 weeks 0 days 0 hours 0 minutes

show version
SW1 uptime is 3 days, 15 hours, 3 minutes
System returned to ROM by power-on
System restarted at 01:07:54 UTC Fri Dec 25 2020
System image file is "flash:/c2960x-universalk9-mz.152-2.E7/c2960x-universalk9-mz.152-2.E7.bin"
Last reload reason: power-on

Yes, the switch is standalone.

I am not sure that the upgrade will fix the issue, in CSCus47446 there I didn't see the recommended version.
Now I wait, what will happen after disabling interface G1/0/13 and Poe to the interface.

show run int g1/0/13
interface GigabitEthernet1/0/13
description Test + SIP
switchport trunk native vlan 20
switchport trunk allowed vlan 20,21
switchport mode trunk
switchport nonegotiate
switchport voice vlan 21
duplex full
spanning-tree portfast

SW1#show mac address-table interface gigabitEthernet 1/0/13
Mac Address Table
-------------------------------------------

Vlan Mac Address Type Ports
---- ----------- -------- -----

SW1#test cable tdr interface g1/0/13
TDR test started on interface Gi1/0/13
A TDR test can take a few seconds to run on an interface
Use 'show cable-diagnostics tdr' to read the TDR results.

SW1#show cable-diagnostics tdr interface g1/0/13
TDR test last run on: December 28 16:24:50

Interface Speed Local pair Pair length Remote pair Pair status
--------- ----- ---------- ------------------ ----------- --------------------
Gi1/0/13 auto Pair A 0 +/- 10 meters N/A Open
Pair B 1 +/- 10 meters N/A Open
Pair C 23 +/- 10 meters N/A Open
Pair D 22 +/- 10 meters N/A Open

SW1#show power
System Power Total (AC) 653 Watts
System Power Used (AC) 123 Watts

show power inline
Sometimes is:
Gi1/0/13  auto   on         15.4    Cisco PD            n/a   30.0

Sometimes it is:
Gi1/0/13 off off 0.0 n/a n/a 30.0

SW1#show env power
SW PID Serial# Status Sys Pwr PoE Pwr Watts
-- ------------------ ---------- --------------- ------- ------- -----
1 Built-in Good

Disabling Poe and shut down interface:
SW1#conf t
SW1(config)#interface g1/0/13
SW1(config-if)#power inline never
SW1(config-if)#shutdown

SW1(config-if)#do copy run startup

I couldn't understand this error message, why it appears even when there is nothing connected?
Dec 28 09:17:52: %ILPOWER-7-DETECT: Interface Gi1/0/13: Power Device detected: Cisco PD
Dec 28 09:17:52: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/13: Power granted
Dec 28 09:17:52: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/13: PD removed

System restarted at 00:10:24 UTC Tue Dec 29 2020

System restarted at 01:07:54 UTC Fri Dec 25 2020

System restarted at 11:16:56 UTC Mon Dec 21 2020

System restarted at 03:00:44 UTC Tue Dec 15 2020

System restarted at 18:25:36 UTC Wed Dec 2 2020

System restarted at 15:57:37 UTC Wed Dec 2 2020

[tanner.zaitt]

Today I did see a new error in the different interface, G1/0/10:

Dec 29 03:49:07: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 03:49:07: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed
Dec 29 03:49:10: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:49:11: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 03:49:11: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed
Dec 29 03:49:31: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:49:38: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 03:49:38: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed
Dec 29 03:49:44: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:49:47: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 03:49:47: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed
Dec 29 03:50:05: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:50:16: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 03:50:16: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed
Dec 29 03:50:18: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:50:43: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 03:50:43: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed
Dec 29 03:52:37: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:53:07: %ILPOWER-3-CONTROLLER_PORT_ERR: Controller port error, Interface Gi1/0/10: Power given, but Power Controller does not report Power Good
Dec 29 03:53:19: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 03:53:49: %ILPOWER-3-CONTROLLER_PORT_ERR: Controller port error, Interface Gi1/0/10: Power given, but Power Controller does not report Power Good
Dec 29 04:04:23: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 04:04:53: %ILPOWER-3-CONTROLLER_PORT_ERR: Controller port error, Interface Gi1/0/10: Power given, but Power Controller does not report Power Good
Dec 29 04:05:03: %ILPOWER-7-DETECT: Interface Gi1/0/10: Power Device detected: IEEE PD
Dec 29 04:05:07: %ILPOWER-5-POWER_GRANTED: Interface Gi1/0/10: Power granted
Dec 29 04:05:07: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/10: PD removed

[balaji.bandi]

Do you have smartnet contract with Cisco, as suggested,have you contact cisco TAC and ask for recommendations to fix the issue, if this is really effecting your environment..

[tanner.zaitt]

Of course, I will contact with Cisco TAC Team, but before them, I love to search and check all possibilities.

Directly I can't open an alone case to them, I need collaboration with other teams for that, and that's why I love to check all details before escalation to other teams and Cisco TAC Team.

Thank you guys for your answers.
I think here I am with the Power Supply issue  (Poe issue) I am not sure is it HW related issue but the bug CSCus47446 is on the table.

Only Cisco TAC team could give the solution, I was read more topics, and usually, after their investigation, they replace the device.


Best regards!

[balaji.bandi]

sure we are more of community members we share our experience and if we can offer some solution based on our experience and encountering the same issue we will always give hand to people, so they can fix the issue and remidiate the issue,

Sure once should research and understand the issue - that will help gaining knowledge and help where we stand on.

Thank you for the input, yes if Cisco TAC think this can not be fixed, they offer RMA and quick code fix for you with developer interaction to fix issue for you, this help for you and cisco development team to understand the issue, also help other members who suffering with same issue can be resolved with our help.