Java exceptions during restorebackup.pl

[yjdabear]

This is from restoring a copy of the LMS 2.2 daily db backup into a fresh install of LMS 2.6.

tail restorebackup.log

[Tue Sep 26 16:43:58 2006] getNextJobId() - next job id returned is 1072

[Tue Sep 26 16:43:58 2006] Registering ChangeAuditDefaultPurge with job id 1072.

..

[Tue Sep 26 16:43:58 2006] Warning - No current logger set

[Tue Sep 26 16:43:58 2006] getNextJobId() - next job id returned is 1073

[Tue Sep 26 16:43:58 2006] Registering SysInvCollection with job id 1073...

[Tue Sep 26 16:43:58 2006] getNextJobId() - next job id returned is 1074

[Tue Sep 26 16:43:58 2006] Registering SysInvPoller with job id 1074...

[Tue Sep 26 16:43:58 2006] JobRegistrationUtil : Completed successfully.

[Tue Sep 26 16:43:58 2006] INFO: Calling JobRegistration Utility........

[Tue Sep 26 16:43:58 2006] INFO: executing /opt/CSCOpx/bin/cwjava -cw /opt/CSCOp

x -cw:jre lib/jre -cp:p MDC/tomcat/webapps/rme/WEB-INF/classes:MDC/tomcat/shared

/lib/MICE.jar:MDC/tomcat/webapps/rme/WEB-INF/lib/log4j.jar:MDC/tomcat/webapps/rm

e/WEB-INF/lib/xdi.jar:MDC/tomcat/shared/lib/NATIVE.jar com.cisco.nm.rmeng.common

.jobregistration.JobRegistrationUtil /opt/CSCOpx/MDC/tomcat/webapps/rme/WEB-INF/

classes/com/cisco/nm/rmeng/common/jobregistration/jobregistration.dat

[Tue Sep 26 16:43:58 2006]

[Tue Sep 26 16:43:58 2006] Migration of the RME Data is in progress...

[Tue Sep 26 16:43:58 2006]

[Tue Sep 26 16:43:58 2006] See the log file /var/adm/CSCOpx/log/migration.log

for progress..

[Tue Sep 26 16:43:58 2006]

Exception in thread "main" java.lang.NullPointerException

at java.io.Writer.write(Writer.java:126)

at org.apache.log4j.helpers.QuietWriter.write(QuietWriter.java:39)

at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:302)

at org.apache.log4j.WriterAppender.append(WriterAppender.java:157)

at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)

at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders

(AppenderAttachableImpl.java:57)

at org.apache.log4j.Category.callAppenders(Category.java:255)

at org.apache.log4j.Category.forcedLog(Category.java:445)

at org.apache.log4j.Category.fatal(Category.java:436)

at com.cisco.nm.rmeng.migration.MigrMain.main(Unknown Source)

tail /var/adm/CSCOpx/log/migration.log

26/Sep/2006 17:02:55:304 1133199 [main] INFO com.cisco.nm.rmeng.migration.MigrMain 673 - Startup and VLAN configurations available in following directory /media/tempBackupData/rme/var/adm/CSCOpx/files/archive/config

26/Sep/2006 17:02:55:315 1133210 [main] ERROR com.cisco.nm.rmeng.migration.MigrMain 187 -

Directory /media/tempBackupData/rme/var/adm/CSCOpx/files/archive/config is not available

at com.cisco.nm.rmeng.migration.DcmaDataMigrator.restoreOtherArchive(DcmaDataMigrator.java:677)

at com.cisco.nm.rmeng.migration.DcmaDataMigrator.doMigration(DcmaDataMigrator.java:183)

at com.cisco.nm.rmeng.migration.MigrMain.callAppDoMigration(Unknown Source)

at com.cisco.nm.rmeng.migration.MigrMain.main(Unknown Source)

26/Sep/2006 17:02:55:317 1133212 [main] FATAL com.cisco.nm.rmeng.migration.MigrMain ? - Operation could not be proceeded..

26/Sep/2006 17:02:55:318 1133213 [main] FATAL com.cisco.nm.rmeng.migration.MigrMain ? - Reason is :null

26/Sep/2006 17:02:55:391 1133286 [main] DEBUG com.cisco.nm.rmeng.migration.MigrMain ? - Successfully enabled DM auto manage

I found only a "Logs" directory in /media/tempBackupData/rme/var/, no "files". Does this mean the restore did not succeed? For instance, there's no NetConfig jobs found.

[yjdabear]

The restore command used:

/opt/CSCOpx/bin/perl /opt/CSCOpx/bin/restorebackup.pl -d /var/temp/477 -t /media

The temp directory directive (-t) seems mandatory, which essentially triples the disk space requirement for a restore from >6GB to >18GB.

Here's the comparison of /var/temp/477/rme (direct copy of LMS 2.2 backup) and /media/tempBackupData/rme/ (temp directory used by restorebackup.pl):

ls -al /var/temp/477/rme

total 9613492

drwxr-xr-x 9 root other 512 Sep 26 14:05 .

drwxr-xr-x 4 root other 512 Sep 26 13:58 ..

drwxr-xr-x 2 root other 512 Sep 26 14:05 cas

drwxr-xr-x 2 root other 512 Sep 26 14:05 cjm

drwxr-xr-x 2 root other 512 Sep 26 14:05 config

drwxr-xr-x 2 root other 512 Sep 26 14:07 database

-rw-r--r-- 1 root other 4919680000 Sep 26 14:05 filebackup.tar

drwxr-xr-x 2 root other 512 Sep 26 14:07 inventory

drwxr-xr-x 2 root other 512 Sep 26 14:07 netconfig

-rw-r--r-- 1 root other 438 Sep 26 14:05 rme.tmpl

drwxr-xr-x 2 root other 512 Sep 26 14:07 swim

ls -al /media/tempBackupData/rme/

total 9613496

drwxr-xr-x 11 root other 512 Sep 26 16:12 .

drwxr-xr-x 4 root other 512 Sep 26 16:13 ..

drwxr-xr-x 2 root other 512 Sep 26 14:05 cas

drwxr-xr-x 2 root other 512 Sep 26 14:05 cjm

drwxr-xr-x 2 root other 512 Sep 26 14:05 config

drwxr-xr-x 2 root other 512 Sep 26 14:07 database

-rw-r--r-- 1 root other 4919680000 Sep 26 14:05 filebackup.tar

drwxr-xr-x 2 root other 512 Sep 26 14:07 inventory

drwxr-xr-x 2 root other 512 Sep 26 14:07 netconfig

drwxr-xr-x 3 casuser casusers 512 Sep 26 15:24 product

-rw-r--r-- 1 root other 438 Sep 26 14:05 rme.tmpl

drwxr-xr-x 2 root other 512 Sep 26 14:07 swim

drwxr-xr-x 3 casuser casusers 512 Sep 26 15:22 var

du -sk /var/temp/477/rme

6262345 /var/temp/477/rme

du -sk /media/tempBackupData/rme

11191889 /media/tempBackupData/rme

Where did restorebackup.pl get /var from? On the LMS 2.2 box, /var/adm is a softlink to /var/Logs/CSCO/adm/CSCOpx. Is this what confused restorebackup.pl?

ls -al /var/adm

total 16180

drwxrwxr-x 9 root sys 512 Sep 27 10:00 .

drwxr-xr-x 39 root sys 1024 May 25 16:13 ..

lrwxrwxrwx 1 root other 25 Jul 12 2004 CSCOpx -> /var/Logs/CSCO/adm/CSCOpx

[Joe Clarke]

Yes, the symlink is most likely the problem here. We do not support a symlink for /var/adm/CSCOpx. We offer other ways of relocating large items like the config archive and the SWIM repository.

To try and fix this, you could fix the filebackup.tar manually, or fix the LMS 2.2 server, then take the backup again.

[yjdabear]

Well, the symlink thing is by design and out of my control. So I used this workaround while restoreback.pl was pausing for answer to one of its questions: mv /media/tempBackupData/rme/var/Logs/CSCO/adm /media/tempBackupData/rme/var/

The restore finished "successfully". But I'm finding /var/adm/CSCOpx/files is a lot smaller on the LMS 2.6 box than the 2.2 server, and has a very different directory structure. Is the size difference because I answered N to "Do you want to collect inventory [Y/N]:[N]"?

lms22-(/var/Logs/CSCO/adm/CSCOpx/files)->du -sk .

2735067 .

lms22-(/var/Logs/CSCO/adm/CSCOpx/files)->ls -al

total 8

drwxr-x--- 8 casuser casusers 1024 Feb 2 2006 .

drwxr-x--- 4 casuser casusers 96 Mar 27 2006 ..

drwxr-x--- 6 casuser casusers 96 Mar 19 2005 archive

drwxr-x--- 2 casuser casusers 1024 Sep 7 13:34 inventory

drwxr-xr-x 4 root other 96 Jul 12 2004 jobs

drwxr-x--- 2 casuser casusers 96 Sep 25 11:33 netconfig

drwx------ 82 casuser casusers 2048 May 25 11:23 schedule

drwxr-xr-x 5 casuser casusers 96 Jul 11 2002 sw_images

[lms26:/var/Logs/CSCO/adm/CSCOpx/files] # du -sk .

271221 .

[lms26:/var/Logs/CSCO/adm/CSCOpx/files] # ls -al

total 10

drwxrwx--- 5 casuser casusers 512 Sep 18 13:22 .

drwxr-x--- 4 casuser casusers 512 Sep 27 14:04 ..

drwxrwx--- 9 casuser casusers 512 Sep 28 10:30 .SQLAnywhere

drwxr-xr-x 15 casuser casusers 512 Sep 28 10:11 rme

drwxr-xr-x 4 casuser casusers 512 Sep 18 13:22 scripts

[yjdabear]

Here's the restore log:

/opt/CSCOpx/bin/perl /opt/CSCOpx/bin/restorebackup.pl -d /var/temp/477 -t /media

******************************************************************************************

Restore started at : 2006/09/27 16:10:53

Please see '/var/adm/CSCOpx/log/restorebackup.log' for status.

OS of the backup archive is..................... : Unix

Generation to be restored is ................... : .

Backup taken from............................... : /var/temp/477

Common Services version in the backup data is... : 2.2

Common Services is installed in................. : /opt/CSCOpx

The temp folder for this restore program........ : /media/tempBackupData

Applications installed on this machine ......... : [Common Services][Campus Manager][Resource Manager Essentials]

Applications in the backup archive ............. : [Common Services][Campus Manager][Resource Manager Essentials]

Applications to be restored are................. : [Common Services] [Campus Manager] [Resource Manager Essentials]

Available disk space in NMSROOT................. : 9157105 Kb

Available disk space in temp folder............. : 12175536 Kb

Required disk space in NMSROOT.................. : 6308433 Kb

Required disk space in temp..................... : 11112808 Kb

Copying the backup files to the temporary location [/media/tempBackupData]

INFO: Not able to unlink(/media/tempBackupData/rme/filebackup.tar)

preRestore of [Common Services] has started.

preRestore of [Common Services] has completed.

preRestore of [Campus Manager] has started.

preRestore of [Campus Manager] has completed.

preRestore of [Resource Manager Essentials] has started.

Not all data from RME 3.4.x and RME 3.5.x will be migrated to RME 4.0.x. For information on the data that is migrated, see the "Data Migration From an Earlier Version" section in the "Installing RME" chapter in the RME 4.0.x Installation Guide for details. Do you want to continue[Y/N]:[Y]

Do you want to migrate syslogs [Y/N]:[Y]

Do you want to collect inventory [Y/N]:[N]

preRestore of [Resource Manager Essentials] has completed.

doRestore of [Common Services] has started.

License check started.

License check completed.

Restoring certificate.

Restored Certificate.

Restoring Common Services database.

Restoring CMIC data.

Restored CMIC data.

Restoring CMC data.

Restored CMC data.

Restoring Security Settings.

Restored Security Settings.

Restoring DCR data.

Restored DCR data.

Restoring Certificate key store.

Restored Certificate key store.

Restoring JAAS configuration.

Restored JAAS configuration.

doRestore of [Common Services] has completed.

doRestore of [Campus Manager] has started.

doRestore of [Campus Manager] has completed.

doRestore of [Resource Manager Essentials] has started.

Migration of the RME Data is in progress...

See the log file /var/adm/CSCOpx/log/migration.log for progress..

doRestore of [Resource Manager Essentials] has completed.

postRestore of [Common Services] has started.

postRestore of [Common Services] has completed.

postRestore of [Campus Manager] has started.

postRestore of [Campus Manager] has completed.

postRestore of [Resource Manager Essentials] has started.

postRestore of [Resource Manager Essentials] has completed.

Restored successfully.

[pmandelli]

Hi yjdabear ,

I have the same problem

restore data from LMS2.2 to LMS 2.6

How did you resolve it?

can you post me at leorob@hotmail.com

Thanks in advance

Leonardo

[Joe Clarke]

The directory layout will be very different under LMS >= 2.5. The reason for the size difference could be that job information is not restored across servers. While you will have ChangeAudit records, your job logs will no longer exist. The main thing to check is your config archive (under files/rme/dcma/devfiles) and the software repo (under rme/repository/swim).

Note: certain ChangeAudit data may not be migrated if the database entries could not be found. This is fine. Those non-migrated records could have been left over from a reinitialized database.

[Leonardo Roberto]

Hi Jclarke,

I have the same problem

restore data from LMS2.2 to LMS 2.6

with same errors

in the directory that you suggest there ins't anything

The configuration files are absent

I have to restore data first in LMS 2.5.1 and then make an upgrade to LMS 2.6?

How did you resolve it?

Thanks in advance

Leonardo