Catalyst 4500 L3 Switch Shutdown

[feroz syed]

hello,

we have been restarting the core switch from past four days at morning time, the Output led in RED, below pasted some information from core-switch for your reference, both smps off, so i decide to start one smps to see whats going on in another one in logs.

CORE-SWITCH#sh mod
Chassis Type : WS-C4506-E

Power consumed by backplane : 0 Watts

Mod Ports Card Type Model Serial No.
---+-----+--------------------------------------+------------------+-----------
1 2 Supervisor IV 1000BaseX (GBIC) WS-X4515 JAE1226NEQD
2 18 1000BaseX (GBIC) WS-X4418-GB JAE1235T8WG
3 18 1000BaseX (GBIC) WS-X4418-GB JAE1235T8VJ
4 48 10/100/1000BaseT (RJ45) WS-X4548-GB-RJ45 JAE1234SODJ

M MAC addresses Hw Fw Sw Status
--+--------------------------------+---+------------+----------------+---------
1 0023.047f.46c0 to 0023.047f.46c1 5.5 12.2(31r)SGA 12.2(44)SG Ok
2 0018.19ce.c51c to 0018.19ce.c52d 1.4 Ok
3 0018.19ce.c5f4 to 0018.19ce.c605 1.4 Ok
4 0022.90c8.9670 to 0022.90c8.969f 2.5 Ok

System Failures:
----------------
Power Supply: bad/off (see 'show power')

CORE-SWITCH#




CORE-SWITCH#show power
Power Fan Inline
Supply Model No Type Status Sensor Status
------ ---------------- --------- ----------- ------- -------
PS1 PWR-C45-2800AC AC 2800W bad/off bad/off bad/off
PS2 PWR-C45-2800AC AC 2800W good good good

Power supplies needed by system : 1
Power supplies currently available : 1

Power Summary Maximum
(in Watts) Used Available
---------------------- ---- ---------
System Power (12V) 450 1360
Inline Power (-50V) 0 1400
Backplane Power (3.3V) 0 40
---------------------- ---- ---------
Total 450 2800







CORE-SWITCH#sh env status
Power Fan Inline
Supply Model No Type Status Sensor Status
------ ---------------- --------- ----------- ------- -------
PS1 PWR-C45-2800AC AC 2800W bad/off bad/off bad/off
PS2 PWR-C45-2800AC AC 2800W good good good

Power supplies needed by system : 1
Power supplies currently available : 1

Chassis Type : WS-C4506-E

Power consumed by backplane : 0 Watts

Switch Bandwidth Utilization : 0%

Supervisor Led Color : Orange

Module 1 Status Led Color : Orange
Module 2 Status Led Color : Green
Module 3 Status Led Color : Green
Module 4 Status Led Color : Green

Fantray : Good

Power consumed by Fantray : 120 Watts

CORE-SWITCH#
CORE-SWITCH#sh env temp
CORE-SWITCH#sh env temperature
Chassis Temperature = 27 degrees Celsius
Chassis Over Temperature Threshold = 75 degrees Celsius
Chassis Critical Temperature Threshold = 95 degrees Celsius

CORE-SWITCH#sh log
Syslog logging: enabled (0 messages dropped, 0 messages rate-limited, 0 flushes, 0 overruns, xml disabled, filtering disabled)

No Active Message Discriminator.




No Inactive Message Discriminator.


Console logging: level debugging, 9 messages logged, xml disabled,
filtering disabled
Monitor logging: level debugging, 0 messages logged, xml disabled,
filtering disabled
Buffer logging: level debugging, 9 messages logged, xml disabled,
filtering disabled
Exception Logging: size (8192 bytes)
Count and timestamp logging messages: disabled
Persistent logging: disabled

No active filter modules.

Trap logging: level informational, 13 message lines logged

Log Buffer (4096 bytes):

*Dec 5 21:12:21.595: %C4K_IOSMODPORTMAN-4-POWERSUPPLYBAD: Power supply 1 has failed or been turned off
*Dec 5 21:12:38.695: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Dec 5 21:12:40.359: %C4K_IOSMODPORTMAN-6-MODULEONLINE: Module 1 (WS-X4515 S/N: JAE1226NEQD Hw: 5.5) is online
*Dec 5 21:12:40.359: %C4K_IOSMODPORTMAN-6-MODULEONLINE: Module 2 (WS-X4418-GB S/N: JAE1235T8WG Hw: 1.4) is online
*Dec 5 21:12:40.359: %C4K_IOSMODPORTMAN-6-MODULEONLINE: Module 3 (WS-X4418-GB S/N: JAE1235T8VJ Hw: 1.4) is online
*Dec 5 21:12:40.359: %C4K_IOSMODPORTMAN-6-MODULEONLINE: Module 4 (WS-X4548-GB-RJ45 S/N: JAE1234SODJ Hw: 2.5) is online
*Dec 5 21:12:40.843: %SYS-5-CONFIG_I: Configured from memory by console
*Dec 5 21:12:41.371: %SYS-5-RESTART: System restarted --
Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500-IPBASEK9-M), Version 12.2(44)SG, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Mon 24-Mar-08 21:50 by prod_rel_team
*Dec 5 21:12:41.743: %SSH-5-ENABLED: SSH 1.99 has been enabled
CORE-SWITCH#
CORE-SWITCH#
CORE-SWITCH#sh system
% Incomplete command.

CORE-SWITCH#sh system ?
mtu Show the global Maximum Transmission Unit (MTU)


CORE-SWITCH#sh module all
Chassis Type : WS-C4506-E

Power consumed by backplane : 0 Watts

Mod Ports Card Type Model Serial No.
---+-----+--------------------------------------+------------------+-----------
1 2 Supervisor IV 1000BaseX (GBIC) WS-X4515 JAE1226NEQD
2 18 1000BaseX (GBIC) WS-X4418-GB JAE1235T8WG
3 18 1000BaseX (GBIC) WS-X4418-GB JAE1235T8VJ
4 48 10/100/1000BaseT (RJ45) WS-X4548-GB-RJ45 JAE1234SODJ

M MAC addresses Hw Fw Sw Status
--+--------------------------------+---+------------+----------------+---------
1 0023.047f.46c0 to 0023.047f.46c1 5.5 12.2(31r)SGA 12.2(44)SG Ok
2 0018.19ce.c51c to 0018.19ce.c52d 1.4 Ok
3 0018.19ce.c5f4 to 0018.19ce.c605 1.4 Ok
4 0022.90c8.9670 to 0022.90c8.969f 2.5 Ok

System Failures:
----------------
Power Supply: bad/off (see 'show power')

CORE-SWITCH#
CORE-SWITCH#

[Leo Laohoo]

Power Supply 1 has failed.  Contact Cisco TAC and get the dead PS replaced.

[feroz syed]

After restart the switch function normally, this issue happen at mid night, and we still power off and power on the switch from past 7 days.

CORE-SWITCH#sh env

no alarm




Chassis Temperature                    = 27 degrees Celsius

Chassis Over Temperature Threshold     = 75 degrees Celsius

Chassis Critical Temperature Threshold = 95 degrees Celsius




Power                                             Fan      Inline

Supply  Model No          Type       Status       Sensor   Status

------  ----------------  ---------  -----------  -------  -------

PS1     PWR-C45-2800AC    AC 2800W   good         good     good

PS2     PWR-C45-2800AC    AC 2800W   good         good     good




Power supplies needed by system    : 1

Power supplies currently available : 2




Chassis Type : WS-C4506-E

[paul driver]

Hello

faulty PSU, RMA it and obtain a new one

[Richard Burts · Accepted solution]

The original poster tells us "After restart the switch function normally, this issue happen at mid night, and we still power off and power on the switch from past 7 days." So they restart the switch and it runs normally - until mid night when it fails again. Perhaps there is something in the environment that is triggering this? After 7 days I think there is a pattern to this. I agree with the other suggestions - you need to replace power supply 1.

[feroz syed]

thanks for your reply, the maintenance team installed the stabilizer yesterday maybe the issue in power fluctuations but it happen again in mid-night.

so i will buy one power supply to see the status today, if it happen again to new one, i will buy ups. 

Thanks

[paul driver · Accepted solution]

Hello
Before you do , Have you tried reseating that PSU, cleaning its conection points etc..?
if you haven’t and want to try it just make sure you have a change window in place for such activity beforehand?

[feroz syed]

i didn't remove the PSU from switch, we just clean it from upper side and make blower then clean the terminals with CRC, maintenance team totally changed the power port to new one, separate connection for Core-switch only. 

[feroz syed]

hello,

The power supply hard to find it in my city (ksa), so i order it one from Online. if i install one power supply this would be enough or must be replace with two same time.

[Leo Laohoo]

One PS has enough power for the other unit to be replaced.

[feroz syed]

can you please provide any video or document to know how to remove the power supply from switch and what necessary action should to be take in order to remove ps. 

there is two screw on each power supply, by removing both screw and the power cord is enough to pull it out the ps or is there an anything need to disconnect.

i already took the config vlan backup.

[Leo Laohoo · Accepted solution]

1. Use the power switch to power off the target power supply. 
2. Pull out the power cable.
3. Remove the locking s crew. 
4. Remove the target power supply. 
5. Insert new power supply. 
6. Finger tighten the locking s crew.  
7. Insert the power cable. 
8. Turn the power switch to the "on" position. 

[feroz syed]

The old two PS was working fine from past few days without Output power issue. Today we got two new PS and installed it without any issue. in case if the issue happen again with new PS means, i will re-open the discussion.

Thanks for those who helped me to find out the solution.

[Richard Burts]

Thanks for the update. Glad to know that you now have new power supplies. Hope that does provide a permanent solution. I am glad that our suggestions have been helpful.  Thank you for marking this question as solved. This will help other participants in the community to identify discussions which have helpful information. This community is an excellent place to ask questions and to learn about networking. I hope to see you continue to be active in the community.