VMware Vsphere and ESX

VMware ESX Server Backup

Amanda Enterprise 3.1 allows you to backup VMware ESX images to various media supported by Amanda. The backups are performed in a file system consistent manner.  These backups can be used for restoration of guest VMs running on the ESX server and can be restored to alternate ESX server. The VMware is backed up using VMware Virtual Disk APIs (Vstorage APIs)

Full and incremental backups of the VM are supported. The incremental backups contain only the changed data blocks in the virtual machine.

Zmanda recommends using Amanda client to backup files from guest VM if file level backup of VMs is needed.

Amanda Enterprise VMware ESX application supports licensed (paid) versions of Vsphere 5 and VMware 4.x (or called Vsphere)  VMware ESX 3.x is not supported because Vstorage APIs are not available for ESX 3.x. If you are using ESX 3.x, please contact Zmanda support for a solution.

Amanda Enterprise VMware ESX application does not backup VMware independent disks or RDM (Raw Device Mapping) disks. According to VMware,  "snapshots of raw disks, RDM physical mode disks, and independent disks are not supported". For more information, refer to the vSphere Basic System Administration guide, Section 17.  They have to be backed up by installing Amanda client from another machine.

Requirements for VMware Server Backup and Restore

libcrypt-ssleay-perl libclass-methodmaker-perl libxml-libxml-perl libwww-perl psmisc 
linux-headers-`uname -r`

Installation

Amanda ESX VMware application is installed as part of Amanda server. Separate software is not required. Please install the latest Amanda VMware patch available in Zmanda network.

The application is licensed. Amanda VMware license must be part of Zmanda License file on the Amanda server.

If the VMware commands (vmware-cmd, vmkfs, vmware-diskmanager, snapshotmanager.pl) are not installed in default locations (/usr/lib/vmware-vcli for VCLI and /usr/bin for vmware-diskmanager), you will have to modify /etc/zmanda/zmc_aee/zmc_user_dumptypes to fix the application properties (VCLI-PATH, VCLI-BIN-PATH and VDDK-BIN_PATH).

Configuring VMware Server Backups

Configuring VMware guest VM backups requires steps in both Zmanda Management Console and some manual steps.

• Zmanda recommends creation of separate backup set for backing up guest VM images.
• It is also important to change TEMP-WORKING-DIR location in the /etc/zmanda/zmc_aee/zmc_user_dumptypes file for zmc_vmware_userapp. This location should have sufficient disk space to hold a single uncompressed copy of the largest ESX VMware image that will be backed up. The default value is /tmp/amanda and should be changed because /tmp file system can become full during backup process.

• Create a backup set for the guest VMs in the Zmanda Management Console. Use ZMC Backup What page to add DLEs for ESX servers as shown below. Click Add/Update to save the configuration.

ESX Host Name is the name of the ESX server whose guest VMs are being backed up or the VMware vCenter that manages the ESX server.  It can be the IP address or the IP name.

Virtual Machine Name is the name of the guest VM that should be backed up. You should not use the IP address of the guest VM.  This is the VM Display name (not the name of the data storage folder on the ESX server) as shown in the left panel in the Vsphere Client. This value is case sensitive. If ESX Host Name is VMware vCenter, the VM can reside on any ESX server managed by the vCenter.

Datastore Name is the name of the VMware datastore used by the guest VM. This field is mandatory.

ESX server user and password is the authentication information for the ESX server or VMware vCenter server. These credentials are used to perform backup and recovery. The password should not contain white space characters. The VMware user privileges that are required are described in Creating ESX Backup User section below. The user name and password must be the same for the ESX server where the VM is running and VMware vCenter server.  The user account must be local to the ESX server (login to ESX server and create the VMware user), not a vCenter-wide/domain account used on the ESX server.

The backup data can be encrypted and/or compressed. The compression and encryption are performed on the Amanda server and can consume significant CPU/memory resources.

It is a good idea to Disable Staging for VMware DLEs because they do not add any performance for VMware application.

• Please resolve any configuration errors found by the ZMC Backup What page.
• Change the Data Not Sent Timeout value in the Backup How page for the backup set.  The value should be increased to at least 7200 seconds. Increasing the value does not impact the backup window (time to complete the backup).

Scheduling backups of VMware Server

You can schedule backups using Zmanda Management Console Backup When page or run immediate backups for the backup set from the Backup Activate page.

The status of the backup are shown in the Monitor page. Backup reports will be available under the Report tab in the Zmanda Management Console.

The backups of the guest VM are performed by taking snapshots of the disks associated with the guest VMs. Snapshots are removed after the backup data is copied over. Under certain circumstances, the snapshots are not removed. It is important to remove the backup snapshots.

Performing VMware Server Restores using ZMC

Zmanda Management Console can restore the VM directly to another or the original ESX server.

The ZMC recovery process starts at Restore What page. Enter the Backup Date - the timestamp of the backup run. The Host Name in case of VMware is always 127.0.0.1. Enter the Alias/Directory/Path (guest VM name) in \\<esx or vCenter server name>\<datastore name>\<guest VM name> format. It should be exactly same as what was entered in ZMC Backup What page.

In the Restore Where page, Select Destination Host as localhost. The Destination Directory can be one of the following:

• Original Location: Backup to the original ESX server with the same guest VM name. Please make sure the guest VM no longer exists on the original ESX server. Guest VM backed up using VMware vCenter cannot be restored to original ESX server.
  
• Destination Directory: A directory on the Amanda server which sufficient space to store restored images. Only level 0 backups (full backups) can be restored to the Amanda server directory. Level 1 backups contain only changed data blocks and cannot be applied without VMware. Example: /vmware-restore
• VMware: The VM to be restored to should be specified in format //<esx server name>/<datastore name to restore to>/<guest vm name> if the VM has to be restored to the ESX server and started on the ESX server. The guest VM name and ESX server can be different from the original VM name and the ESX server. You cannot restore to the original VM name unless it is removed from the inventory. The guest VM name can only have a-zA-Z_- characters. You cannot use VMware vCenter name and a specific ESX server must be provided.

If you are restoring to an alternate ESX server (not the original ESX server from where backup was performed), the /etc/amanda/<backupset name>/esxpass file should contain ESX user name and password for the ESX server being restored to.

An example esxpass file is shown below:

//esx4.company.com  root%root_password

esx4.company.com is the IP address or the name of the ESX server. root is the user on the ESX server used for the backup and restore operations and password for the user is root_password. The password must not be encrypted.

After reviewing the entries, Click Restore button on the Restore Restore page to start the restore process as shown below:

When errors occur, the temporary space used for restoration (Destination Directory) is not cleaned up after restoration. This should be done manually.

The CDROM device file name on the restored VM may not be correct. It should be verified on the restored VM.

Please log in to ESX server to see the restored folder and to troubleshoot restore issues. You may not be able to see the restored datastores from the vCenter server.

Creating ESX User for Amanda backups

For VMware backup and restore operations, the ESX user that is specified in the ZMC Backup What page should have certain roles. These are minimum set of privileges required for the user.  The privileges required for backup are:

[Datastore]
  Allocate space
  Browse datastore
  Low level file operations
[Virtual machine]
  [Configuration]
    Disk change tracking
    Disk lease
  [Provisioning]
    Allow read-only disk access
    Allow virtual machine download
  [State]
    Create snapshot
    Remove snapshot
    Rename snapshot

The privileges required for restoration are:

[Datastore]
  Allocate space
  Browse datastore
  Low level file operations
  Update virtual machine files
[Network]
  Assign Network
[Resource]
  Assign virtual machine to resource pool
[Virtual Machine]
[Configuration]
   Add new disk
   Add or remove device
   Advanced
   Change resource
   Disk change tracking
   Disk lease
   Host USB Device
   Modify device settings
   Settings
[Inventory]
   Create New
   Register
[Provisioning]
   Allow disk access
   Allow virtual machine files upload

Please note that the ESX user should have administrator role on the whole ESX server not just the specific Virtual Machines being backed up.

1. Select View > Administration > Roles
2. Select Add Role.  Select an unique name for the role. For example: backup-role
3. Select the list of privileges for this role as shown below and click OK to save the role configuration.

After creating the role, assign the role to specific user that can be used for VMware backups.

1. Using VMware Vsphere Client, Log in to the ESX server.
2. Select the host in the inventory and click on the Permissions tab.
3. Select the user name and use the right-click menu to select Properties.
4. Assign the backup role to this user.