ADF manual migration from dev instance to prod instance is getting failed with ARM template

Question

ADF manual migration from dev instance to prod instance is getting failed with ARM template

kks8589 106

Hi All,
I am having issue when migrating ADF from one subscription to other subscription while migrating getting the below error

Regards
Keerthi

Vaibhav Chaudhari 38,961 Reputation points Volunteer Moderator

2021-03-10T06:35:20.453+00:00

Error message details? and how it is getting deployed?
PRADEEPCHEEKATLA 91,321 Reputation points Moderator

2021-03-11T12:35:16.267+00:00

Hello @kks8589 ,

Just checking in if you have had a chance to see the previous response provided by anonymous userChaudhari. We need the following information to understand/investigate this issue further.
kks8589 106 Reputation points

2021-03-12T06:48:40.48+00:00
Hi Vaibhav,
The steps we followed are as below

Exported ARM Template from Dev instance and we got arm_template.zip file

Created a prod ADF instance in Prod subscription and a VM with Self hosted IR ,Azure SQL with private endpoint installed in a resource group

We clicked on ARM Template in source control of prod ADF instance and selected import on Azure Portal option

It navigated to the custom deployment page. Clicked on Build your own template in the editor ,clicked on load file and selected arm_template.json which is extracted from the arm_template.zip folder

we got few things under parameters,variables and resources

Custom deployment screen appears to mention the connection string for 3 linked services 2 onpremise and 1 Azure SQl and private end point fqdn
kks8589 106 Reputation points

2021-03-12T06:49:51.033+00:00
after providing the values we got an error for properties_fqdns value ["sql-name.database.windows.net"]
"The template has specified this parameter as type "array" but default value is specified as type 'string'
after we changed the type to string in template then the deployment started

the deployment got failed for 3 resources as bad request
one is for private endpoint and the other 2 are onpremise linked services.
the operation details of error are as below
{"code": "BadRequest",
"message": "Failed to encrypt sub-resource payload {\r\n \"Id\": \"/subscriptions//resourceGroups//providers/Microsoft.DataFactory/factories/adf-xxx-prod/linkedservices/onprem_ls\" and error is: Failed to encrypted linked service credentials on self-hosted IR 'SelfHostedIR', reason is: NotFound, error message is: No online instance.."
}
}

1 answer

Your answer

Vaibhav Chaudhari 38,961 Reputation points Volunteer Moderator

2021-03-10T06:35:20.453+00:00

Error message details? and how it is getting deployed?
PRADEEPCHEEKATLA 91,321 Reputation points Moderator

2021-03-11T12:35:16.267+00:00

Hello @kks8589 ,

Just checking in if you have had a chance to see the previous response provided by anonymous userChaudhari. We need the following information to understand/investigate this issue further.
kks8589 106 Reputation points

2021-03-12T06:48:40.48+00:00

Hi Vaibhav,
The steps we followed are as below

Exported ARM Template from Dev instance and we got arm_template.zip file

Created a prod ADF instance in Prod subscription and a VM with Self hosted IR ,Azure SQL with private endpoint installed in a resource group

We clicked on ARM Template in source control of prod ADF instance and selected import on Azure Portal option

It navigated to the custom deployment page. Clicked on Build your own template in the editor ,clicked on load file and selected arm_template.json which is extracted from the arm_template.zip folder

we got few things under parameters,variables and resources

Custom deployment screen appears to mention the connection string for 3 linked services 2 onpremise and 1 Azure SQl and private end point fqdn
kks8589 106 Reputation points

2021-03-12T06:49:51.033+00:00

after providing the values we got an error for properties_fqdns value ["sql-name.database.windows.net"]
"The template has specified this parameter as type "array" but default value is specified as type 'string'
after we changed the type to string in template then the deployment started

the deployment got failed for 3 resources as bad request
one is for private endpoint and the other 2 are onpremise linked services.
the operation details of error are as below
{"code": "BadRequest",
"message": "Failed to encrypt sub-resource payload {\r\n \"Id\": \"/subscriptions//resourceGroups//providers/Microsoft.DataFactory/factories/adf-xxx-prod/linkedservices/onprem_ls\" and error is: Failed to encrypted linked service credentials on self-hosted IR 'SelfHostedIR', reason is: NotFound, error message is: No online instance.."
}
}

Answer 1

Hello @kks8589 ,

From the error message "Failed to encrypted linked service credentials on self-hosted IR 'SelfHostedIR', reason is: NotFound, error message is: No online instance"

Make sure self-hosted IR is online, when you are deploying. Otherwise you may get this error message because self-hosted IR will be used to encrypt your payload.

To encrypt the sensitive data from the JSON payload on an on-premises self-hosted integration runtime, run New-AzDataFactoryV2LinkedServiceEncryptedCredential, and pass on the JSON payload. This cmdlet ensures the credentials are encrypted using DPAPI and stored on the self-hosted integration runtime node locally. The output payload containing the encrypted reference to the credential can be redirected to another JSON file (in this case 'encryptedLinkedService.json').

New-AzDataFactoryV2LinkedServiceEncryptedCredential -DataFactoryName $dataFactoryName -ResourceGroupName $ResourceGroupName -Name "SqlServerLinkedService" -DefinitionFile ".\SQLServerLinkedService.json" > encryptedSQLServerLinkedService.json

For more details, refer "Encrypt credentials for on-premise data stores in ADF".

Hope this helps. Do let us know if you any further queries.

------------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

PRADEEPCHEEKATLA 91,321 Reputation points Moderator

2021-03-16T10:47:22.87+00:00

Hello @kks8589 ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.
PRADEEPCHEEKATLA 91,321 Reputation points Moderator

2021-03-18T10:32:09.643+00:00

Hello @kks8589 ,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.
Take care & stay safe!

Share via

ADF manual migration from dev instance to prod instance is getting failed with ARM template

1 answer

Your answer