05-02-2017 02:46 AM
Hello, I wanted to reach out to the wider community and see if anyone else has seen the issue as TAC seem uncertain.
Waiting for developers to review the case.
In the meantime,
Customer is running 2x ISE-3395-K9 physical appliances in 2-node deployment running ISE 1.4 Patch 10.
Backups fail periodically, they will hang and a cancel will not fix the issue as the status remains in cancelling a reload is required to fix the issue.
The backups have failed recently but now the backups are failing due to the following issue:
Backup Failed: ADE-OS configuration not found.
I can see the ADE-OS configuration when I do a show run, however show startup displays the message:
"startup-configuration is empty".
Have switch PAN and SAN and now the new PAN is reporting same status.
Logs below:
Error Log:
2017-04-06 00:00:00,001 INFO [DefaultQuartzScheduler_Worker-5][] infrastructure.systemconfig.backuprestore.external.BRJob -::::- doOperation : BackupRestoreStub from
UI : BackupRestoreStub [backupName=rochc8ise1, repoName=HYPAPPTS008, operType=Backup, backupDataType=CFG_BACKUP, operAction=Initiate, includeADEOS=true]
2017-04-06 00:00:04,749 INFO [DefaultQuartzScheduler_Worker-5][] infrastructure.systemconfig.backuprestore.utils.BRStatusHelper -::::- Failed to load BR status flags
2017-04-06 00:00:04,750 INFO [DefaultQuartzScheduler_Worker-5][] infrastructure.systemconfig.backuprestore.utils.BRStatusHelper -::::- Failed to load BR status flags
2017-04-06 00:00:08,872 INFO [DefaultQuartzScheduler_Worker-5][] infrastructure.systemconfig.backuprestore.external.BRJob -::::- doOperation : useLocalMethod: false
2017-04-06 00:00:12,142 ERROR [DefaultQuartzScheduler_Worker-5][] cpm.infrastructure.systemconfig.backuprestore.CpmBackup -::::- Exception at carsRestore :
at com.cisco.cars.appsvc.impl.BackupRestoreServiceImpl.backupISEWithParams(BackupRestoreServiceImpl.java:117)
2017-04-06 09:34:04,488 INFO [admin-http-pool467][] infrastructure.systemconfig.backuprestore.utils.BRStatusHelper -::::- Failed to load BR status flags
2017-04-06 09:34:04,488 INFO [admin-http-pool467][] infrastructure.systemconfig.backuprestore.utils.BRStatusHelper -::::- Failed to load BR status flags
2017-04-06 09:34:34,398 INFO [admin-http-pool464][] infrastructure.systemconfig.backuprestore.utils.BRStatusHelper -::::- Failed to load BR status flags
The backup was last successful on Saturday 01/04/2017:
2017-04-01T03:36:14.372959+01:00 ROCH-C8-ISE1 root: Finished backup at 01-APR-17
This issue started randomly on Sunday 02/04/2017 and still continues to fail daily as below:
2017-04-05T00:00:11.680823+01:00 ROCH-C8-ISE1 ADE-SERVICE[1891]: [6147]:[info] backup-restore:backup: br_history.c[515] [system]: ISE backup/restore initiated by web UI
as ise.br.status is 'in-progress' in /tmp/ise-cfg-br-flags
2017-04-05T00:00:11.777102+01:00 ROCH-C8-ISE1 ADEOSJAVAAPI[6147]: ADEAUDIT 2010, type=BACKUP, name=BACKUP STARTED, username=system, cause=A backup has been inititated,
adminipaddress=127.0.0.1, interface=GUI, detail=Initiating backup rochc8ise1 to repository HYPAPPTS008
2017-04-05T00:00:11.777297+01:00 ROCH-C8-ISE1 ADE-SERVICE[1891]: [6147]:[error] backup-restore:backup: br_backup.c[602] [system]: backup requested, but startup configur
ation not found
2017-04-05T00:00:11.867502+01:00 ROCH-C8-ISE1 ADEOSJAVAAPI[6147]: ADEAUDIT 2012, type=BACKUP, name=BACKUP FAILED, username=system, cause=A backup has failed, adminipadd
ress=127.0.0.1, interface=GUI, detail=Backup requested, but startup configuration not found
2017-04-05T00:00:11.956222+01:00 ROCH-C8-ISE1 ADEOSJAVAAPI[6147]: ADEAUDIT 3013, type=BACKUP, name=BACKUP FAILED, username=system, cause=Error during backup, adminipadd
ress=127.0.0.1, interface=CLI, detail=Backup requested, but startup configuration not found
2017-04-05T00:00:11.956455+01:00 ROCH-C8-ISE1 ADE-SERVICE[1891]: [6147]:[info] backup-restore:backup: br_history.c[453] [system]: updating /tmp/ise-cfg-br-flags with st
atus: complete and message: Backup Failed: ADE-OS configuration not found
2017-04-05T03:15:28.398038+01:00 ROCH-C8-ISE1 root: crosschecked backup piece: found to be 'AVAILABLE'
2017-04-05T03:15:28.398042+01:00 ROCH-C8-ISE1 root: backup piece handle=/opt/oracle/base/flash_recovery_area/CPM10/backupset/2017_04_04/o1_mf_annnn_TAG20170404T033617_d
g61o20n_.bkp RECID=394 STAMP=940390577
2017-04-05T03:15:28.398066+01:00 ROCH-C8-ISE1 root: specification does not match any backup in the repository
2017-04-05T03:15:28.398080+01:00 ROCH-C8-ISE1 root: specification does not match any backup in the repository
2017-04-05T03:15:28.398190+01:00 ROCH-C8-ISE1 root: Starting backup at 05-APR-17
2017-04-05T03:15:28.398203+01:00 ROCH-C8-ISE1 root: channel ORA_DISK_1: starting archived log backup set
2017-04-05T03:15:28.398208+01:00 ROCH-C8-ISE1 root: channel ORA_DISK_1: specifying archived log(s) in backup set
2017-04-05T03:15:28.398225+01:00 ROCH-C8-ISE1 root: piece handle=/opt/oracle/base/flash_recovery_area/CPM10/backupset/2017_04_05/o1_mf_annnn_TAG20170405T031517_dg8nsox3
_.bkp tag=TAG20170405T031517 comment=NONE
2017-04-05T03:15:28.398234+01:00 ROCH-C8-ISE1 root: channel ORA_DISK_1: backup set complete, elapsed time: 00:00:07
2017-04-05T03:15:28.398251+01:00 ROCH-C8-ISE1 root: Finished backup at 05-APR-17
2017-04-05T03:15:28.401847+01:00 ROCH-C8-ISE1 root: info:[application:operation:isedailycron.sh] No OS cleanup of archivelog and backupset dirs is required
2017-04-06T00:00:11.871377+01:00 ROCH-C8-ISE1 ADE-SERVICE[1891]: [6147]:[info] backup-restore:backup: br_history.c[515] [system]: ISE backup/restore initiated by web UI
as ise.br.status is 'in-progress' in /tmp/ise-cfg-br-flags
2017-04-06T00:00:11.957601+01:00 ROCH-C8-ISE1 ADEOSJAVAAPI[6147]: ADEAUDIT 2010, type=BACKUP, name=BACKUP STARTED, username=system, cause=A backup has been inititated,
adminipaddress=127.0.0.1, interface=GUI, detail=Initiating backup rochc8ise1 to repository HYPAPPTS008
2017-04-06T00:00:11.957869+01:00 ROCH-C8-ISE1 ADE-SERVICE[1891]: [6147]:[error] backup-restore:backup: br_backup.c[602] [system]: backup requested, but startup configur
ation not found
2017-04-06T00:00:12.046279+01:00 ROCH-C8-ISE1 ADEOSJAVAAPI[6147]: ADEAUDIT 2012, type=BACKUP, name=BACKUP FAILED, username=system, cause=A backup has failed, adminipadd
ress=127.0.0.1, interface=GUI, detail=Backup requested, but startup configuration not found
2017-04-06T00:00:12.136719+01:00 ROCH-C8-ISE1 ADEOSJAVAAPI[6147]: ADEAUDIT 3013, type=BACKUP, name=BACKUP FAILED, username=system, cause=Error during backup, adminipadd
ress=127.0.0.1, interface=CLI, detail=Backup requested, but startup configuration not found
2017-04-06T00:00:12.136893+01:00 ROCH-C8-ISE1 ADE-SERVICE[1891]: [6147]:[info] backup-restore:backup: br_history.c[453] [system]: updating /tmp/ise-cfg-br-flags with st
atus: complete and message: Backup Failed: ADE-OS configuration not found
Solved! Go to Solution.
05-02-2017 04:39 AM
They need to work through tac and development
Community is not for break fix troubleshooting
05-02-2017 04:39 AM
They need to work through tac and development
Community is not for break fix troubleshooting
05-02-2017 04:50 AM
Hi Jason,
I wanted to reach out to the wider community and see if anyone else has seen the issue as TAC seem uncertain.
Will see what the developers say.
Thanks!
05-02-2017 05:02 AM
Thanks want to be clear of your intentions in the future please state that when starting out the conversation
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide