Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,431 questions
Azure Data Factory copy compute scale automation
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 17%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJF%3C/text%3E%3C/svg%3E)
Joao Ferreira
0
Reputation points
Hello,
I am using the managed integration runtime on Data Factory. As we can find in this documentation https://learn.microsoft.com/en-us/azure/data-factory/managed-virtual-network-private-endpoint in order to have a good performance for the copy tasks we should enable the copy compute scale when setting up a managed virtual network.
My problem now is, how I can automate these changes regarding the copy compute scale because publishing the changes to have the ARM template to then promote to the other does not get the changes. I mean, the ARM template can't help to apply these changes between the environments and I can't find any cli either.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth 15,235 Reputation points Microsoft External Staff2023-10-04T10:57:41.49+00:00 Thanks for approaching Microsoft Q& A
use Azure PowerShell to automate the changes. You can use the Set-AzDataFactoryV2IntegrationRuntime cmdlet to update the integration runtime with the new copy compute scale value. You can also use the Get-AzDataFactoryV2IntegrationRuntime cmdlet to retrieve the current copy compute scale value.Here are the steps to automate the changes using Azure PowerShell:
- Open Azure PowerShell and connect to your Azure account.
- Retrieve the current copy compute scale value using the Get-AzDataFactoryV2IntegrationRuntime cmdlet.
- Use the Set-AzDataFactoryV2IntegrationRuntime cmdlet to update the copy compute scale value.
- Save the PowerShell script and run it to apply the changes.
Here is an example PowerShell script to update the copy compute scale value:
# Connect to your Azure account Connect-AzAccount # Set the subscription context Set-AzContext -SubscriptionId <SubscriptionId> # Retrieve the current copy compute scale value $integrationRuntime = Get-AzDataFactoryV2IntegrationRuntime -ResourceGroupName <ResourceGroupName> -DataFactoryName <DataFactoryName> -Name <IntegrationRuntimeName> $currentCopyComputeScale = $integrationRuntime.ComputeProperties.CopyComputeScale # Update the copy compute scale value $newCopyComputeScale = <NewCopyComputeScale> $integrationRuntime.ComputeProperties.CopyComputeScale = $newCopyComputeScale Set-AzDataFactoryV2IntegrationRuntime -ResourceGroupName <ResourceGroupName> -DataFactoryName <DataFactoryName> -Name <IntegrationRuntimeName> -IntegrationRuntime $integrationRuntime # Disconnect from your Azure account Disconnect-AzAccountReplace the placeholders with your own values and run the script to update the copy compute scale value.
References:
- https://docs.microsoft.com/en-us/azure/data-factory/managed-virtual-network-private-endpoint#copy-compute-scale
- https://docs.microsoft.com/en-us/powershell/module/az.datafactory/set-azdatafactoryv2integrationruntime?view=azps-6.4.0
- https://docs.microsoft.com/en-us/powershell/module/az.datafactory/get-azdatafactoryv2integrationruntime?view=azps-6.4.0
if This does not work, please do let us know.
-
phemanth 15,235 Reputation points Microsoft External Staff
2023-10-05T10:34:14.8033333+00:00 We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
-
phemanth 15,235 Reputation points Microsoft External Staff
2023-10-06T06:39:41.4666667+00:00 @Joao Ferreira just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Sign in to comment
Sign in to answer