RSP-720 unexpected switchover

[ปลาวาฬทราย RMUTT CPE IX]

I found the log:

c1#sho log | beg Jul  2
854423: Jul  2 04:18:54.846 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 30 seconds [5/1]
854424: Jul  2 04:19:24.846 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 60 seconds [5/1]
854425: Jul  2 04:19:54.843 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 90 seconds [5/1]
854426: .Jul  2 04:20:12.703 bkk: %XDR-6-XDRIPCNOTIFY: Message not sent to slot 5/1 (19) because of IPC error timeout. Disabling linecard. (Expected during linecard OIR)
Jul  2 04:20:12.239 bkk: SP-STDBY: icc_send_request_internal: ipc_send_rpc_blocked failed, result 6
Jul  2 04:20:12.239 bkk: SP-STDBY: -Traceback= 84E5E78 84E6040 84E6314 83A23A8 83A280C 82B3620 82A9274
854427: Jul  2 04:20:24.843 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 120 seconds [5/1]
854428: Jul  2 04:20:54.844 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 150 seconds [5/1]
854429: Jul  2 04:21:24.896 bkk: %PFREDUN-SP-6-ACTIVE: Standby processor removed or reloaded, changing to Simplex mode
854430: Jul  2 04:21:24.896 bkk: %OIR-SP-3-PWRCYCLE: Card in module 5, is being power-cycled (Module reset)
854431: Jul  2 04:21:24.844 bkk: %CPU_MONITOR-SP-STDBY-3-TIMED_OUT: CPU_MONITOR messages have failed, resetting system [5/1]
854432: Jul  2 04:23:38.806 bkk: %PFREDUN-SP-6-ACTIVE: Standby initializing for SSO mode
854433: Jul  2 04:23:48.826 bkk: %PFREDUN-SP-4-BOOTSTRING_INVALID: The bootfile sup-bootdisk:c7600rsp72043-advipservicesk9-mz.122-33.SRD1.bin is present on the active supervisor but not on the standby
854434: Jul  2 04:23:48.826 bkk: %PFREDUN-SP-4-BOOTSTRING_INVALID: The bootfile sup-bootdisk:c7600rsp72043-advipservicesk9-mz.122-33.SRB2.bin is present on the active supervisor but not on the standby
854435: Jul  2 04:24:13.119 bkk: %FABRIC-SP-5-CLEAR_BLOCK: Clear block option is off for the fabric in slot 5.
854436: Jul  2 04:24:13.199 bkk: %FABRIC-SP-5-FABRIC_MODULE_BACKUP: The Switch Fabric Module in slot 5 became standby
854437: Jul  2 04:24:14.111 bkk: %DIAG-SP-6-RUN_MINIMUM: Module 5: Running Minimal Diagnostics...
854438: Jul  2 04:24:14.611 bkk: %DIAG-SP-6-DIAG_OK: Module 5: Passed Online Diagnostics
854439: Jul  2 04:24:15.875 bkk: %OIR-SP-6-INSCARD: Card inserted in slot 5, interfaces are now online
854440: *Jul  1 21:23:38.763: %SYS-SP-STDBY-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
854441: *Jul  1 21:24:05.098: %SPANTREE-SP-STDBY-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Jul  1 21:24:05.310: SP-STDBY: SP: Currently running ROMMON from S (Gold) region
854442: *Jul  1 21:24:11.906: %DIAG-SP-STDBY-6-RUN_MINIMUM: Module 5: Running Minimal Diagnostics...
854443: *Jul  1 21:24:12.822: %DIAG-SP-STDBY-6-DIAG_OK: Module 5: Passed Online Diagnostics
854444: *Jul  1 21:25:06.715: %C7600_PLATFORM-SP-STDBY-3-LOW_BATT: Low Voltage detected for NVRAM Battery
854445: *Jul  1 21:25:08.215: %SYS-SP-STDBY-5-RESTART: System restarted --
Cisco IOS Software, c7600rsp72043_sp Software (c7600rsp72043_sp-ADVIPSERVICESK9-M), Version 12.2(33)SRD1, RELEASE SOFTWARE (fc4)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2009 by Cisco Systems, Inc.
Compiled Tue 24-Feb-09 15:02 by prod_rel_team
854446: .Jul  2 04:25:34.320 bkk: %HA_CONFIG_SYNC-6-BULK_CFGSYNC_SUCCEED: Bulk Sync succeeded
854447: Jul  2 04:25:33.115 bkk: %PFREDUN-SP-STDBY-6-STANDBY: Ready for SSO mode
854448: Jul  2 04:25:34.328 bkk: %RF-SP-5-RF_TERMINAL_STATE: Terminal state reached for (SSO)
854449: .Jul  2 10:12:18.565 bkk: %PARSER-3-URLOPENFAIL: cannot open file for redirection 'Permission denied'
c1#

How should I do?

Thank you very much.

[Vinit Jain]

Hello,

the switchover occurred due to heartbeat failure between the standby supervisor and the backplane.

854423: Jul  2 04:18:54.846 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 30 seconds [5/1]
854424: Jul  2 04:19:24.846 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 60 seconds [5/1]
854425: Jul  2 04:19:54.843 bkk: %CPU_MONITOR-SP-STDBY-6-NOT_HEARD: CPU_MONITOR messages have not been heard for 90 seconds [5/1]

if you face similar crash again, physically reseat the standby supervisor card (jack out and jack in)

In case, the problem is still not resolved, replace the supervisor card.

Hope this helps.

Vinit