Add Modern Backup Storage to DPM

Modern Backup Storage (MBS) was introduced in System Center Data Protection Manager (DPM) 2016 to deliver 50% storage savings, 3X faster backups, and more efficient workload-aware storage. DPM 2019 introduces further performance improvements with MBS, resulting in 50-70% faster backup with Windows Server 2019.

Note

We recommend you to deploy DPM 2019 (using tiered volumes) on Windows Server 2019 to achieve enhanced backup performances.

• MBS is enabled automatically when you're running at least DPM 2016 on Windows Server 2016. If DPM is running on a version of Windows Server earlier than Windows Server 2016, it doesn't use MBS.
• MBS provides intelligent storage for short-term backup to disk. MBS provides faster disk backup, consuming less disk space. Without MBS, each data source needs two volumes, one for the initial backup and the other for delta changes.
• MBS backups are stored on an ReFS disk. It uses ReFS block cloning and VHDX technology. Learn more.
• With DPM 2019 and later, you can use tiered volumes for DPM native storage, which delivers 50-70% faster backups.

Note

DPM does not support deduplication on ReFS disk used for MBS backups.

DPM 2019 accepts volumes/disks for storage. Once you add a volume, DPM formats the volume to ReFS to use the new features of Modern Backup Storage. Volumes can't reside on a dynamic disk; use only a basic disk.

Note

If the physical disk is or will be larger than 2TB, the disk must be converted to GPT before creating the volume(s) for DPM.

You can directly give a volume to DPM; however, you may have issues in extending the volume if a need arises later. You can create additional volumes using storage pools, which could be exposed to DPM and extended as needed. The following sections provide the details on how to create a tiered volume, add a volume to DPM, and expand it later.

Set up MBS with Tiered Storage

DPM 2016 introduced Modern Backup Storage (MBS), improving storage utilization and performance. MBS uses ReFS as the underlying filesystem. MBS is designed to make use of hybrid storage, such as tiered storage. To achieve the scale and performance claimed by MBS, we recommend using a small percentage (4% of the overall storage) of flash storage (SSD) with DPM 2019 as a tiered volume in combination with HDD for DPM native storage.

Once you configure tiered storage, the ReFS file system has the intelligence to store File System Metadata on the SSD tier. This improves the overall backup job time significantly. There's no further configuration required while configuring the protection groups, etc.

Note

• Tiering is recommended for faster backups. However, this isn't a mandatory requirement to configure DPM storage.
• You can't attach locally created VHD (VHDX) files and use them as storage on a physical DPM server. Ensure that you are running DPM 2019 or later deployed on a VM running on Windows Server 2016 or later.
• When deploying DPM in a virtual machine, DPM 2019 can be deployed in a VM running on Windows Server 2016 or Windows Server 2019. For best performance, we strongly recommend DPM 2019 installed on Windows 2019 with the latest Windows update installed.

Prerequisites

The tiered storage is configured using Windows Storage Spaces. Following are the prerequisites for Windows Storage Spaces.

Area	Requirement	Notes
Disk bus types	- Serial Attached SCSI (SAS) - Serial Advanced Technology Attachment (SATA) - iSCSI and Fibre Channel Controllers.	When you configure Storage Spaces utilizing iSCSI and Fibre Channel (FC) disk controllers, only non-resilient virtual disks (simple with any number of columns) are supported.
HBA considerations	- Simple host bus adapters (HBAs) that don't support RAID functionality are recommended - If RAID-capable, HBAs must be in non-RAID mode with all RAID functionality disabled - Adapters must not abstract the physical disks, cache data, or obscure any attached devices. This includes enclosure services that are provided by attached just-a-bunch-of-disks (JBOD) devices.	Storage Spaces is compatible only with HBAs where you can completely disable all RAID functionality.

Note

To configure tiered storage, Windows Storage Spaces requires a minimum SSD size of 32 GB.

For more information on prerequisites for using Storage Spaces on a standalone server, see Prerequisites to use Storage Spaces on a stand-alone server.

Supported topology

To configure tiered storage, the storage can be directly attached to the DPM server or it can be from the external storage like SAN. A combination of directly attached storage and external storage can also be used.

Here are the possible storage combinations that are supported in both physical DPM server or virtual DPM Server scenario.

• SSD and HDD directly attached to DPM Server
• SSD and HDD from external storage
• SSD directly attached to DPM Server and HDD from external storage

Note

• For DPM running on virtual machines, configuring tiered storage using Windows Storage Spaces is supported.
• Hyper-V host presents both the virtual SSD and HHD to the Virtual machine.
• Virtual SSD should be carved out of physical SSD, which could be directly attached to the Hyper-V host or from connected external storage.

Resiliency

DPM supports all of the three resiliency types supported by Windows Storage spaces. To configure Mirror or Parity mode resiliency for tiered volume, multiple SSDs are required along with HDDs. When you configure simple resiliency type using a single SSD option, there might be data loss if the SSD becomes unavailable.

The chart below highlights some pros and cons of the three types of resiliency supported by Windows Storage Spaces.

TYPE	PRO	CON	Min Disks
Simple	- Max disk capacity (100%). - Increased throughput. - Stripes data across physical disks if applicable.	- No resiliency. - Data loss guaranteed if there's a physical disk failure.	1
Mirror	- Increased reliability. - Greater data throughput and lower access latency than parity. - Stripes the data across multiple physical drives. Can be configured for two or three copies of data.	- Reduced capacity (50%). - Not supported on Iscsi or FC connected SAN.	2 or 5
Parity	- Stripes data and parity information across physical disks. - Increased reliability. - Increases resiliency through journaling.	- Reduced capacity, but not as much as mirroring. - Not supported on Iscsi or FC connected SAN. - Slightly reduced performance.	3

For more information to help plan for the number of physical disks and the desired resiliency type for a standalone server deployment, use the guidelines documented here.

Configure DPM storage

Windows Storage Spaces allows you to pool multiple physical disks into one logical drive. It provides an easy way to create software-defined storage using a server's local storage resources.

Follow the steps in the procedures below to set up MBS with tiered storage. Follow the procedures in the sequence listed below:

Note

If you wish to modify your existing storage to tiered storage, migrate your current backups to a temporary volume using volume migration.

1. Prepare physical disks and create Windows Storage Pool
2. Create tiered storage with required resiliency
3. Add volume to DPM storage
4. Disable Write Auto Tiering at file system level

Note

If you've migrated your earlier backups prior to step 1, migrate your data back to the newly created volumes using volume migration.

Prepare physical disks and create Windows storage pool

Use the following procedures to prepare physical disks and create Windows storage pool.

Initialize disks

Based on the resiliency option that you've selected, calculate the number of HDDs and SSDs required. Initialize the new disks that are attached to the server first, prior to adding the disks to the storage pool.

Note

The disks that are more than 2 TB in size will be converted to GPT disks.

To Initialize the disks, follow these steps:

1. Open Server Manager.

2. Select File and Storage Services.

3. Select Volumes and then select Disks Pools.

4. Right-click the disks and select Initialize.

5. Select Yes to initialize the disk. The disk gets converted to GPT disk in case the disk size is more than 2 TB.

6. Repeat the steps for the remaining disks to initialize.

   

Check Primordial pool

By default, the available disks are included in a pool that is named as Primordial pool. If no Primordial pool is listed under the Storage Pools, it indicates that the storage doesn't meet the requirements for storage spaces. Ensure that the disks meet the requirements that are outlined in the prerequisites section.

Run the following cmdlet to view the physical disks available in the Primordial pool:

Get-StoragePool -IsPrimordial $true | Get-PhysicalDisk | Where-Object CanPool -eq $True

Example:

Create a storage pool

Create a new storage pool with a logical sector size of 4K. Create the storage volume with single disk initially.

Run the following cmdlet to create the storage pool:

New-StoragePool –FriendlyName DPMPool –StorageSubsystemFriendlyName (Get-StorageSubSystem).FriendlyName –PhysicalDisks (Get-PhysicalDisk –CanPool $True) -LogicalSectorSizeDefault 4096 -FaultDomainAwarenessDefault PhysicalDisk

Example:

Set MediaType to SSD or HDD

By default, Windows automatically detects the type of disk that is attached and lists it as either an SSD or HDD. In case the MediaType is set as Unspecified, use the following cmdlet to set the appropriate MediaType manually.

Note

It is important that you identify the disk correctly (SSD/HDD) and set the MediaType accordingly. You can use the size of the disk as one of the identifiers.

1. Run the following cmdlet to check MediaType:

   Get-PhysicalDisk|FT DeviceID,BusType,MediaType,Size,UniqueId
   

   Example:

   

2. In the above example, assign the MediaType as SSD to the disk with DeviceID as 1 and assign HDD to the disks with DeviceID as 2, 3, and 4.

   To set the MediaType, run the following cmdlets:

   Set-PhysicalDisk -UniqueId "600224802D66666E313C92E116E2ADA1" -MediaType SSD
   Set-PhysicalDisk -UniqueId "60022480965A3579C3EB929E0BA39776" -MediaType HDD
   Set-PhysicalDisk -UniqueId "60022480183A590476AA8940A84C8E9D" -MediaType HDD
   Set-PhysicalDisk -UniqueId "60022480DB4A64573FEC4C9C82BB48EB" -MediaType HDD
   

   Example:

   

3. Run the following cmdlet to ensure that the MediaType has been set correctly:

   Get-PhysicalDisk | FT DeviceID, BusType, MediaType, Size, UniqueId
   

   Example:

   

Disable Write-back cache

Disable Write-back cache to disable auto-caching at storage pool level (applicable for tiered storage). To disable write-back cache, run the following PowerShell cmdlet:

Set-StoragePool -FriendlyName DPMPool -WriteCacheSizeDefault 0

Example:

Create tiered storage volume

You can configure tiered storage volume using the following methods:

• Simple volume – Recommended when you are using storage from the SAN device or using a virtual machine. The resiliency should be provided by the underlying storage.
• Resilient volume – Supported when you are using only locally attached storage (JBOD). Ensure that resiliency isn't configured at the storage level.

Before creating tiered storage, you need to plan the column size.

• The column size determines how the data is written across the physical disks in the storage pool and also decides the number of physical disks that need to be added to the storage pool before a virtual disk can be expanded.

• The higher the column size (up to 8), the better the overall performance. If you need to add physical disks later, it needs to be in multiples of the column size.

• By default, when you create the virtual disk or volume, the column size is automatically determined based on the number of disks available in the storage pool.

• The default setting is used while creating new virtual disk or volume using Server Manager or when you don't specify the column size while using New-StorageTier cmdlet.

• To change the default setting, run the following cmdlets.

  • Run the following cmdlet to find the current column size settings.

  Get-ResiliencySetting
  

  Example:

  

  • To change the column size setting, run the following cmdlets.

    For Mirror:

    Get-StoragePool DPMPool | Set-ResiliencySetting -Name Mirror -NumberOfColumnsDefault 1
    

    For Parity:

    Get-StoragePool DPMPool | Set-ResiliencySetting -Name Parity -NumberOfColumnsDefault 3
    

Select the required tab for steps to create a tiered storage:

Create Simple tiered volume (No Resiliency)

To create a simple tiered volume (no resiliency), follow the steps below:

1. Create an SSD tier by running the following cmdlet:

   New-StorageTier -StoragePoolFriendlyName DPMPool -FriendlyName SSDTier -MediaType SSD -ResiliencySettingName Simple -NumberOfColumns 1 -PhysicalDiskRedundancy 0 -FaultDomainAwareness PhysicalDisk
   

   Example

   

2. Create an HDD tier by running the following cmdlet:

   New-StorageTier -StoragePoolFriendlyName DPMPool -FriendlyName HDDTier -MediaType HDD -ResiliencySettingName Simple -NumberOfColumns 1 -PhysicalDiskRedundancy 0 -FaultDomainAwareness PhysicalDisk
   

   Example

   

3. Create a new volume using the SSD tier and HDD tier

   Note

   Use the storage tier size slightly lower than the actual size as it may exceed the physical capacity of the pool. You can resize (extend) the tier later by reviewing the details in extend tiered volume.

   Run the following cmdlet to create a new volume using SSD tier and HDD tier:

   New-Volume -StoragePoolFriendlyName DPMPool -FriendlyName DPMVol -FileSystem ReFS -StorageTierFriendlyNames SSDTier,HDDTier -StorageTierSizes 745GB,14TB
   

   Example:

   

4. Run the following cmdlet to verify the performance tier and capacity tier used for the newly created volume:

   Get-StorageTier
   

   Example

   The following image displays the end result as seen in Server Manager. You can view the volume in Windows disk management; this is ready to get added to the DPM storage pool.

   

Create Resilient tiered volume

In the following example, the SSD tier is configured with Mirror resiliency and HDD tier is configured with Parity resiliency. In this configuration, a single SSD and/or a single HDD can fail without experiencing data loss.

Ensure that the minimum disk requirement is met for the required resiliency type and the respective tier.

Note

The configuration of resilient volume is only supported when you are using locally attached disks (JBOD). Review the Pre-requisites section for more details.

To create a resilient tiered volume, use the following steps:

1. Create an SSD tier with resiliency type as Mirror by running the following cmdlet:

   New-StorageTier -StoragePoolFriendlyName DPMPool -FriendlyName SSDMirrorTier -MediaType SSD -ResiliencySettingName Mirror -NumberOfColumns 1 -PhysicalDiskRedundancy 1 -FaultDomainAwareness PhysicalDisk
   

   Example:

2. Create an HDD tier with resiliency type as Parity by running the following cmdlet:

     New-StorageTier -StoragePoolFriendlyName DPMPool -FriendlyName HDDParityTier -MediaType HDD -ResiliencySettingName Parity -NumberOfColumns 3 -PhysicalDiskRedundancy 1 -FaultDomainAwareness PhysicalDisk
   

   Example:

3. Create a new volume using the resilient SSD tier and HDD tier.

   Note

   Use the storage tier size slightly lower than the actual size as it might exceed the physical capacity of the pool. You can resize (extend) the tier later by reviewing the details in extend tiered volume.

   Run the following cmdlet to create a new volume:

       New-Volume -StoragePoolFriendlyName DPMPool -FriendlyName DPMVOL -FileSystem ReFS -StorageTierFriendlyNames SSDMirrorTier, HDDParityTier -StorageTierSizes 745GB, 8TB
   

   Example:

4. Run the following cmdlet to verify the performance tier and capacity tier used for the newly created volume:

    Get-StorageTier
   

   Example:

   

   The following image displays the end result as seen in Server Manager. The volume is ready to get added to the DPM storage pool. You can view the volume in Windows disk management as well.

   

Add volumes to DPM storage

Follow these steps to add volumes to DPM storage:

1. In the DPM Management console > Disk Storage , select Rescan.

2. In Add Disk Storage , select Add. After the volumes are added, you can give them a friendly name.

3. Select OK to format the volumes to ReFS, so that DPM can use them as MBS.

   

Disable Write Auto Tiering at file system level

We recommend you to disable Write Auto Tiering file system level so that the entire performance tier is available for DPM to store ReFS metadata.

Note

You can skip this step if more than 10% of SSD is used in the performance tier. This can be disabled later if there's a performance degradation in terms of backup speeds.

Follow the steps below to disable write auto-caching:

1. Open PowerShell.

2. Run the following cmdlet to view current setting:

   fsutil behavior query disableWriteAutoTiering <driveLetter:>
   
   0 - Enable write auto tiering on the given volume (default)
   1 - Disable write auto tiering on the given volume
   

3. Run the following cmdlet to disable write-caching:

   fsutil behavior set disableWriteAutoTiering <driveLetter:> 1
   

   Example:

   

Migrate data to newly created volumes

In case you had upgraded your existing storage to a tiered storage, you can migrate your data by using volume migration. You can use PowerShell or the user interface to migrate data sources. Learn more.

Migration of data source should have all recovery points on Modern Storage.

Note

• Migration of data sources with backups on disks and volumes (for example, DPM server upgrades when the disk backups haven't expired) isn't supported.
• Migration is similar to modification of a protection group. While migration is in progress, you can't trigger an ad hoc job. Scheduled jobs continue as configured. When the migration completes, current jobs in the protection group are preempted.

Configure workload-aware storage

Using workload-aware storage, the volumes can be selected to preferentially store specific workloads. For example, expensive volumes that support high IOPS can be configured to store workloads that need frequent, high-volume backups such as SQL Server with transaction logs. Workloads that are backed up less frequently, such as VMs, can be backed up to low-cost volumes.

You can configure workload-aware storage using Windows PowerShell cmdlets.

Update the volume properties

1. Run the Update-DPMDiskStorage to update the properties of a volume in the storage pool on a DPM server. The syntax is Parameter Set: Volume.

2. Run the cmdlet with these parameters.

   Update-DPMDiskStorage [-Volume] <Volume> [[-FriendlyName] <String> ] [[-DatasourceType] <VolumeTag[]> ] [-Confirm] [-WhatIf] [ <CommonParameters>]
   

   

   Changes made using the PowerShell cmdlet are reflected in the DPM Management console.

   

Volume exclusion

DPM servers may be managed by a team of administrators. While there are guidelines on storage that should be used for backups, an incorrect volume given to DPM as backup storage may lead to loss of critical data. Hence, with DPM 2016 UR4 and later, you can prevent such scenarios by configuring those volumes to not be shown as available for storage using PowerShell.

For Example, to exclude F:\ and C:\MountPoint1, use these steps:

1. Run the Set0DPMGlobalPropery cmdlet:

   Set-DPMGlobalProperty -DPMStorageVolumeExclusion "F:,C:\MountPoint1"   
   

2. Rescan the storage through UI or use Start-DPMDiskRescan cmdlet.

   The configured volumes and mountpoints are excluded.

3. To remove the volume exclusion, run the following cmdlet:

   Set-DPMGlobalProperty -DPMStorageVolumeExclusion   
   

After removing volume exclusion, rescan the storage. All volumes and mount points, except System Volumes, are available for DPM storage.

Custom size allocation

DPM 2019 consumes storage thinly, as needed. Once DPM is configured for protection, it calculates the size of the data being backed up. If many files and folders are being backed up together (as in the case of a file server), size calculation can take a long time.

With DPM 2016 and later, you can configure DPM to accept the volume size as default instead of calculating the size of each file. The corresponding registry key is HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft Data Protection Manager\Configuration\DiskStorage with the Key, EnableCustomAllocationOnReFSStorage as a string, set to 1 to enable custom size allocation, set to 0 for default size allocation with DPM.