Upgrade Azure SQL Data Warehouse to latest generation of Azure hardware and storage architecture.
You can now seamlessly upgrade to the SQL Data Warehouse Compute Optimized Gen2 tier in the Azure portal for supported regions. If your region does not support self-upgrade, you can upgrade to a supported region or wait for self-upgrade to be available in your region. Upgrade now to take advantage of the latest generation of Azure hardware and enhanced storage architecture including faster performance, higher scalability, and unlimited columnar storage.
This upgrade applies to Compute Optimized Gen1 tier data warehouses in supported regions.
Check if your region is supported for GEN1 to GEN2 migration. Note the automatic migration dates. To avoid conflicts with the automated process, plan your manual migration prior to the automated process start date.
If you are in a region that is not yet supported, continue to check for your region to be added or upgrade using restore to a supported region.
Suggested performance levels are not a direct conversion. For example, we recommend going from DW600 to DW500c.
Migration from Gen1 to Gen2 through the Azure portal is permanent. There is not a process for returning to Gen1.
If the Compute Optimized Gen1 tier data warehouse to be upgraded is paused, resume the data warehouse.
Azure SQL Data Warehouse must be running to migrate to Gen2.
Be prepared for a few minutes of downtime.
Set-AzSqlDatabase -ResourceGroupName "myResourceGroup" -DatabaseName "mySampleDataWarehouse" -ServerName "mynewserver-20171113" -RequestedServiceObjectiveName "DW300"
Set-AzSqlDatabase -ResourceGroupName "myResourceGroup" -DatabaseName "mySampleDataWarehouse" -ServerName "mynewserver-20171113" -RequestedServiceObjectiveName "DW300c"
-RequestedServiceObjectiveName "DW300" is changed to - RequestedServiceObjectiveName "DW300c"
Go to your Compute Optimized Gen1 tier data warehouse in the Azure portal. If the Compute Optimized Gen1 tier data warehouse to be upgraded is paused, resume the data warehouse.
If you do not see the Upgrade to Gen2 card under the Tasks tab, your subscription type is limited in the current region. Submit a support ticket to get your subscription whitelisted.
The first step of the upgrade process goes through the scale operation ("Upgrading - Offline") where all sessions will be killed, and connections will be dropped.
The second step of the upgrade process is data migration ("Upgrading - Online"). Data migration is an online trickle background process. This process slowly moves columnar data from the old storage architecture to the new storage architecture using a local SSD cache. During this time, your data warehouse will be online for querying and loading. Your data will be available to query regardless of whether it has been migrated or not. The data migration happens at varying rates depending on your data size, your performance level, and the number of your columnstore segments.
Optional Recommendation: Once the scaling operation is complete, you can speed up the data migration background process. You can force data movement by running Alter Index rebuild on all primary columnstore tables you'd be querying at a larger SLO and resource class. This operation is offline compared to the trickle background process, which can take hours to complete depending on the number and sizes of your tables. However, once complete, data migration will be much quicker due to the new enhanced storage architecture with high-quality rowgroups.
Alter Index rebuild is an offline operation and the tables will not be available until the rebuild completes.
Navigate to the SQL data warehouse that you want to create a restore point for.
At the top of the Overview section, select +New Restore Point.
Specify a name for your restore point.
Navigate to the SQL data warehouse that you want to restore from.
At the top of the Overview section, select Restore.
Select either Automatic Restore Points or User-Defined Restore Points.
For User-Defined Restore Points, select a Restore point or Create a new user-defined restore point. Choose a server in a Gen2 supported geographic region.
To recover a database, use the Restore-AzSqlDatabase cmdlet.
You can perform a geo-restore to Gen2! To do so, specify an Gen2 ServiceObjectiveName (e.g. DW1000c) as an optional parameter.
Connect to your Azure account and list all the subscriptions associated with your account.
Select the subscription that contains the database to be restored.
Get the database you want to recover.
Create the recovery request for the database, specifying a Gen2 ServiceObjectiveName.
Verify the status of the geo-restored database.
$GeoBackup = Get-AzSqlDatabaseGeoBackup -ResourceGroupName "<YourResourceGroupName>" -ServerName "<YourServerName>" -DatabaseName "<YourDatabaseName>"
$GeoRestoredDatabase = Restore-AzSqlDatabase –FromGeoBackup -ResourceGroupName "<YourResourceGroupName>" -ServerName "<YourTargetServer>" -TargetDatabaseName "<NewDatabaseName>" –ResourceId $GeoBackup.ResourceID -ServiceObjectiveName "<YourTargetServiceLevel>" -RequestedServiceObjectiveName "DW300c"
To configure your database after the restore has completed, see Configure your database after recovery.
The recovered database will be TDE-enabled if the source database is TDE-enabled.
If you experience any issues with your data warehouse, create a support request and reference “Gen2 upgrade” as the possible cause.
Your upgraded data warehouse is online. To take advantage of the enhanced architecture, see Resource classes for Workload Management.