Every 2 months or so we get a hanged scheduled backup job (the backup job is config data backup every Sunday at 1:00 AM UTC). When the backup job hangs it creates a core file bigger than 30GB so localdisk gets full and the core file never gets compressed.
What I have to do is from CLI is manually run a config backup to remove the hanged backup job, thereafter I have to delete the core files to clear up the disk space and everything is normal for a couple of months.
Is it anyone else who have seen the same issues? I am running ISE 2.6 Patch 6 on SNS-3595.
I am thinking about going to patch 8 and see if that fixes it.
iseXX/admin# sh backup status
%% Configuration backup status
%% ----------------------------
% backup name: Weekly_2.6_Config
% repository: XXX
% start date: Sun Nov 29 01:01:02 UTC 2020
% scheduled: yes
% triggered from: Admin web UI
% host: iseXX.XXX.XX
% status: Backup is in progress...
% progress %: 55
% progress message: Completing ISE Backup Staging
iseXX/admin# show disks
disk repository: 100% used (30090104 of 30106488)
Internal filesystems:
/ : 17% used ( 2516656 of 16499528)
/dev : 0% used ( 0 of 32838384)
/dev/shm : 0% used ( 0 of 32849372)
/run : 1% used ( 2196 of 32849372)
/sys/fs/cgroup : 0% used ( 0 of 32849372)
/storedconfig : 2% used ( 1590 of 95054)
/boot : 12% used ( 105380 of 991512)
/opt : 21% used ( 221242860 of 1123331808)
/boot/efi : 4% used ( 10968 of 276312)
/tmp : 1% used ( 7248 of 1983056)
/run/user/440 : 0% used ( 0 of 6569876)
/opt/docker/runtime/overlay/6e7bd84eec61112d0308b289754dbdf102a03965225001d434319e762103ce87/merged : 21% used ( 221242860 of 1123331808)
/opt/docker/runtime/containers/a8e118df607d0342c084c6426b514a56058072498c4107796365acee401b2a3a/shm : 0% used ( 0 of 65536)
/run/user/301 : 0% used ( 0 of 6569876)
/run/user/308 : 0% used ( 0 of 6569876)
/run/user/321 : 0% used ( 0 of 6569876)
/run/user/0 : 0% used ( 0 of 6569876)
/run/user/322 : 0% used ( 0 of 6569876)
warning - /localdisk is 100% used (30090104 of 30106488)
iseXX/admin# dir disk:/corefiles
Directory of disk:/corefiles
30766940160 Nov 29 2020 01:11:26 core.1098
42 Jul 05 2020 03:09:33 core.ise21.jsvc.17960.gz
42 Sep 27 2020 01:07:09 core.ise21.jsvc.30419.gz
879842 Nov 29 2020 01:08:17 hs_err_pid1098.log
107917 Jul 05 2020 03:05:40 hs_err_pid17960.log.gz
108685 Sep 27 2020 01:03:51 hs_err_pid30419.log.gz
Usage for disk: filesystem
30812266496 bytes total used
0 bytes free
30829043712 bytes available
