As a system administrator, you want to plan for potential hardware or VNF software failures. After a service chain is deployed, you can create a backup.
In the event of hardware or software failure, you can restore from the the backup copy and recover the site
Hardware and Software versions used
ENCS 54xx hardware
NFVIS 3.11.2FC2 or above
NFVIS 3.11.2FC2 installed on hardware with access to the on-box web GUI.
VNF Service chain deployed and in active state.
Based on the Backup option chosen(choices in step 2), restore can be executed.
Login to designated ENCS using Google chromeCreate a backup of deployed service chain.
Backup can be Config ONLY / NFVIS config+ALL VNF virtual disk / Select VNF disk. You can select either option but one at a time. Select VNF virtual disk
Delete the deployed service chain
Restore from Backup. Picture below show import of a single VNF. Note1 : When restoring ALL VNFs, there is an option of restoring deployed VNFs without impacting the management connectivity, this is important when dealing with remote sites. Note 2 : management connectivity is intact when restoring individual VNFs.
Frequently Asked Questions
1. During restore, is having the same platform a best practice or is it enforced in software? It is software enforced. Different platforms have different architectures. Not all features are supported for all platforms. Ex.: Dual wan and DPDK are only supported for ENCS 5400. A backup from ENCS 5400 should not be restored to UCS.
2. If checked in software, what exactly is checked for, and how strict is it? It is a strict check for PID. (nfvis# show platform-details hardware_info PID)
3. Could you restore a 5406 to a 5408? No, we cannot restore a backup from ENCS 5406 to a ENCS 5408. If we add a new feature specific to ENCS 5408 in future, we do not want it to conflict with ENCS 5408
4. Does restored NFVIS need to have the exact same amount of memory, disks, etc? No. As of now, we do not check for disk space. Also, there is no need for restored NFVIS to have exact same amount of memory, disks. However, if any VM is deployed on external disk, restored NFVIS expects an external disk in the same slot to redeploy that VM
Please elaborate on what is meant by "VM configurations”. From the context of conf-only backup, VM configurations are NFVIS related VM configurations. In deeper technical terms, it means domain-xml for kvm deployments which included number of CPU and memory required, disk-space, I/O controllers, etc. From conf-and-vms backup, as the VM disks are also backed up, all configurations including configurations within VMs are backed up
5. "If a VM is in an invalid state.." – according to what? nfvis# show vm_lifecycle opdata tenants tenant admin deployment <deployment-name> shows current state of the VM. A VM can be in following states: UNDEFINED_STATE, DEPLOYING_STATE, MONITOR_UNSET_STATE (valid state), MONITOR_DISABLED_STATE, STOPPING_STATE, SHUTDOWN_STATE (valid state), STARTING_STATE, REBOOTING_STATE, INERT_STATE (valid state for unmonitored VMs), ALIVE_STATE (valid state), UNDEPLOYING_STATE, ERROR_STATE (valid state)
Explain the format of the backup file - what files are in it and how you can view contents of it? The backup package is a gzippedtarball. It can be inflated using any tar utility. It contains config.xml, manifest file and list of VM export files with their SHA1 checksums
About how long does a backup take? The answer to this question would be a relative answer. There is no time bound for backup. It depends on type of backup, size of VM disks, number of VM disks, and storage used for backup. A simple conf-only backup to intdatastore completes within seconds. A conf-and-vms backup with multiple large VM disks to a USB takes 9-10 hours.
6. How/where do you download the backup file via GUI? CLI? The portal shows a list of backup files available on system on Backup-Restore page (Host à Utilities à Backup - Restore). It can be downloaded from there. For CLI, nfvis# show system file-list shows backup files. These can be SCP’ed out of NFVIS or copied to USB drive if disk space permits it.
7. What logs capture backup progress, where should we start with troubleshooting if a problem is encountered? All logs for backup and restore are logged in nfvis_config.log. As usual, debug logs show a detailed information and proves helpful in troubleshooting
Any way to run scheduled backups? No. As of now, there is no way of doing this.
How "clean" does a system have to be to run a restore? Can you run it on a fully configured system with running VMs, etc? If so, how does config get merged? As long as confd, esc-lite and nfvos-confd daemons are running, a restore can be performed. Yes, it can be performed on fully configured system. In this case, all previous configurations are erased and overwritten by configurations from backup package. (Except connectivity settings when ‘except-connectivity’ option is used)
8. How long does it take to run a restore once the backup is uploaded? This is also relative question. Restore is also not time bound. It depends on the time taken to deploy VMs, number of VMs deployed, storage option used.
Can you restore on to same platform with a different IP/hostname? Yes. ’except-connectivity’ option in restore is provided just for this purpose. A restore can be performed on to same platform (different device) with different IP. Hostname will be overwritten.
Can you restore on to completely different platform (5412->CSP) ? No
Are there any config paramsthat must match? No. For a restore to start, only PID and NFVIS version should match.
9. Because vm restoration requires registered image, how does “hostaction restore“ recreate this registered image, if there is none during the restoration?
Registered image is not restored from any backup files (vm backup or host backup), it is restored from original downloaded image.
10. Before vmExport/hostaction_backup, the deployment disk is thin-provisioned_link-clone disk (e.g., small size but needs backingStore file), does restored VM from backup (vmImport or hostaction_restore) will restore this kind of disk?
[Ans] No. The backup (by vmExport or host backup) will merge *backingStore disk* and this small *link-clone disk* into *thin-provision full-clone disk*. This process is not reversible. The restored VM disk is a full-clone disk ( == backingStore + link-clone disk). The only way to restore a link-clone disk is: backup feature is created by copying this disk into backup files, not merging backingStore with link-clone file.
11. Can we change datastore for restored VM?
[Ans] path is hard-coded inside vm backup file, changing datastore is not possible.
12. What disks included in my calculation for end-to-end host restoration?
We tried the host restoration after deleting the registered image, due to the downloaded image is not deleted, so host restore process was successful. If I deleted both download file and registered image, the host restore process will fail. So to me, that does not make any differences on the calculation above.
13. There are four files we concern about for VM restoration:
a. Downloaded package. This can be deleted after registration.
b. Register image. Required by deployment and restore/import process.
c. Backup files.
d. Deployment disk, either disk created from fresh installation or disk restored from backup.
Put vmImport/vmExport aside, if
Registered image is not existed when doing host restored, disk space need to be bigger than 1+2+3+4 for successful restoration.
Registered image is existed when doing host restored, disk space need 2+3+4 for successful restoration.
I have a 2960x-48fpd-l running 15.2.2E3 connected to a 3702 AP. Port config pasted below. The AP is in local switching mode so all the clients get dropped off at the switch - hence the trunk and multiple vlans because of the various ssid's and radius over...
Hi all, There are two core routers with equal cost paths to them from the distribution switches. One core router needs to be taken down. If this is done gracefully how quickly will the distribution switches change its preferred route to use the ...
Hello everyone,,I can't seem to find decent information regarding this.DNAC can provision the underlay network, but i find no details on how it does so.Suppose i have a 3-level campus network: Access, Distribution, Core and Border nodes.The underlay deplo...