06-05-2019 05:33 AM
Have an ISR 4321. IOS xe version isr4300-universalk9.16.06.06.SPA.bin
Router reboots Several times a day. Console output at the moment of reboot:
*Jun 5 12:46:20.680: %CPPHA-3-FAILURE: SIP0: cpp_ha_top_level_server: CPP 0 failure Stuck Thread(s) detected *Jun 5 12:46:20.680: %CPPHA-3-FAULT: SIP0: cpp_ha_top_level_server: CPP:0.0 desc:Stuck CPP Thread det:HA class:OTHER sev:FATAL id:0 cppstate:STOPPED res:UNKNOWN flags:0x2 cdmflags:0x0 *Jun 5 12:46:20.680: %CPPHA-3-FAULTCRASH: SIP0: cpp_ha_top_level_server: CPP 0.0 unresolved fault detected, initiating crash dump. *Jun 5 12:46:20.682: %IOSXE-1-PLATFORM: SIP0: kernel: QFP0.0: Fatal Fault: SW reported: Ucode process fault *Jun 5 12:46:20.698: %IOSXE_OIR-6-OFFLINECARD: Card (fp) offline in slot F0 *Jun 5 12:46:20.685: %CPPHA-3-CDMDONE: SIP0: cpp_ha_top_level_server: CPP 0 microcode crashdump creation completed. *Jun 5 12:46:20.690: %IOSXE-6-PLATFORM: SIP0: cpp_ha_top_level_server: Shutting down CPP MDM while client(s) still connected *Jun 5 12:46:20.701: %IOSXE-1-PLATFORM: SIP0: kernel: QFP0.0: Fatal Fault: SW reported: Ucode process faultQFP0.0: Fatal Fault: SW reported: Ucode process fault *Jun 5 12:46:20.762: %IOSXE-3-PLATFORM: SIP0: Jun 5 12:46:20 pman.sh: %PMAN-3-PROCHOLDDOWN: The process cpp_ha_top_level_server has been helddown (rc 69) *Jun 5 12:46:20.785: %CPPDRV-3-LOCKDOWN: SIP0: cpp_cp_svr: QFP0.0 CPP Driver LOCKDOWN encountered due to previous fatal error (SW: Ucode proces
Flash is full of kernel.rp-RP* files.
Jun 5 12:50:14.717 RP0/0: %FLASH_CHECK-3-DISK_QUOTA: Flash disk quota exceeded [free space is 410324 kB] - Please clean up files on bootflash.
isr4321#sh flash: | inc kernel 1110 75317 May 31 2019 06:43:10.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531064310.txt 1111 49088 Jun 03 2019 17:07:54.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603170754.txt 1112 199933952 May 30 2019 09:37:54.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0.core.TEMP_IN_PROGRESS. 1113 74934 May 31 2019 06:58:22.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531065822.txt 1115 95258966 May 31 2019 06:58:49.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531065822.core.flat.gz 1117 60474 May 31 2019 07:30:16.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531073016.txt 1118 53989516 May 31 2019 07:30:36.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531073016.core.flat.gz 1119 77743 May 31 2019 07:26:36.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531072636.txt 1120 68392143 May 31 2019 07:27:00.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531072636.core.flat.gz 1121 74878 May 31 2019 07:50:56.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531075056.txt 1122 98628944 May 31 2019 07:51:24.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531075056.core.flat.gz 1123 49352 May 31 2019 07:54:01.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190531075401.txt 1124 442677 Jun 03 2019 14:19:52.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603141952.txt 1125 75347 Jun 03 2019 13:15:52.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603131552.txt 1127 89188522 Jun 03 2019 13:16:19.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603131552.core.flat.gz 1128 0 Jun 03 2019 14:20:34.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603141952.txt 1130 80255 Jun 03 2019 15:16:10.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603151610.txt 1132 0 Jun 03 2019 15:16:33.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603151610.txt 1133 77114 Jun 03 2019 16:04:07.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603160407.txt 1134 0 Jun 03 2019 16:04:35.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603160407.txt 1135 77727 Jun 03 2019 16:35:08.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603163508.txt 1137 0 Jun 03 2019 16:35:25.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603163508.txt 1138 77921 Jun 03 2019 16:47:31.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603164731.txt 1139 0 Jun 03 2019 16:47:48.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603164731.txt 1140 101465 Jun 03 2019 17:05:11.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603170511.txt 1141 0 Jun 03 2019 17:05:24.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603170511.txt 1142 40988748 Jun 03 2019 17:08:06.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603170754.core.flat.gz 1143 78453 Jun 03 2019 18:01:05.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603180105.txt 1144 0 Jun 03 2019 18:01:15.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603180105.txt 1145 338466 Jun 03 2019 18:36:43.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603183643.txt 1146 0 Jun 03 2019 18:36:57.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603183643.txt 1147 451457 Jun 03 2019 19:03:44.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603190344.txt 1148 0 Jun 03 2019 19:04:00.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603190344.txt 1149 358366 Jun 03 2019 20:06:01.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603200601.txt 1150 0 Jun 03 2019 20:06:16.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603200601.txt 1151 77178 Jun 03 2019 20:35:27.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603203527.txt 1152 0 Jun 03 2019 20:35:36.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603203527.txt 1153 76779 Jun 03 2019 21:00:11.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603210011.txt 1154 0 Jun 03 2019 21:00:20.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603210011.txt 1155 76956 Jun 03 2019 22:09:11.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603220911.txt 1157 0 Jun 03 2019 22:09:20.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603220911.txt 1158 76834 Jun 03 2019 22:20:40.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603222040.txt 1159 0 Jun 03 2019 22:20:49.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_NO_SPACE_20190603222040.txt 1160 81633 Jun 03 2019 23:08:19.0000000000 +00:00 /bootflash/core/kernel.rp_RP-ISR4300_0_20190603230819.txt
Cisco states that autogenerated files on the bootflash: directory should not be deleted, renamed, moved, or altered
The question is what's going on with the box.
06-05-2019 05:53 AM