Unable to Override the ManagedEndpoint resource ID in the Data Factoty CI / CD pipeline

Question

After adding a ManagedPrivateEndpoint the CI/CD pipeline fails when I try and override the endpoint linked resource id to reflect the resource name in production environment.

Trying to override the value in the DevOps in the override template parameters part of Azure resource group deployment Task in a classic release pipeline. Get this error :

InvalidResourceRequest: Invalid resource request. Resource type: 'ManagedPrivateEndpoint', Resource name: 'AzureDataLakeStorage1' 'Error: Invalid payload'.
Check out the troubleshooting guide to see if your issue is addressed: https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/deploy/azure-resource-group-deployment?view=azure-devops#troubleshooting
Task failed while creating or updating the template deployment.

Answer 1

Thanks Martin, for you help. I managed to get this working. It is possible to override the resourceId in the release pipeline so the resource is different in each environment. But you only get 1 shot at that.

If you need to change it thereafter you need to delete the private endpoint and start the process over.

I can kinda see why .... but its not idempotent! :)

Answer 2

I heard back, @Ian Henry .

To override the resource id of the target stored .. its in the property: privateLinkResourceId and put the appropriate groupId

Answer 3

@MartinJaffer-MSFT

I tried setting groupId='blob' and also I tried deleting MPEs before deployment but still Im getting same error.

Answer 4

@MartinJaffer-MSFT I have a situation

I have 2 data factories, one for dev and other for testing.

I have created a managed private endpoint in dev data factory that points to azure sql (pointing to dev sql server and db) eg: az_mpe_dev

I have created a managed private endpoint in test data factory that points to azure sql (pointing to testsql server and db) eg: az_mpe_test

Now when I use azure pipeline to deploy dev adf to test, I get the following error:
ManagedPrivateEndpointInvalidPayload: Managed private endpoint 'az_mpe_dev' is invalid.

In the templateparameter.json
its:

            "az_mpe_dev_properties_privateLinkResourceId": {  
		"value": "/subscriptions/abc/resourceGroups/rg-dev/providers/Microsoft.Sql/servers/sqlserver-dev  
	},  
	"az_mpe_dev_properties_groupId": {  
		"value": "sqlServer"  
	},  
	"az_mpe_dev_properties_ipAddress": {  
		"value": null  
	},  
	az_mpe_dev_properties_resourceId": {  
		"value": "/subscriptions/abc/resourceGroups/vnet-b4549a5weqwee-UKSouth-243-rg/providers/Microsoft.Network/privateEndpoints/az-df-dev.az_mpe_de"  
	}  

Now when I override the template parameters with test values I get the above error.

How should I resolve this ?