It feels like something has changed in data factory linked service parameters recently. I have setup my data factory as follows:
- I have created a linked service pointing to on-prem SQL boxes
- I have added parameters to this linked service, using the "+ New" parameter box for Server/DB/User
- I have then referenced these linked service parameters in the linked service Server/DB name/SQL Auth boxes:
This all works fine. This forms part of a release pipeline. I deployed this to UAT and noticed UAT no longer has most of these parameters specified, however it does have the Key Vault parameter:
The parameter definitions come through to UAT, but not the link to these parameters in the linked services:
I can also confirm this, when I Export the templates from the user interface in Data Factory, I check the ArmTemplate_0.json file (in the Linked Templates folder of the exported file) and the arm_template.json file from the root, to find where the Linked Service parameters should be specified. All I see is this in both files:
I would also expect to see additional "typeProperties" for the other parameters specified.
This seems to confirm that when specifying Linked Service parameters, not all values are being saved in the arm templates files. Only Azure Key Vault parameters are being saved? I just tried doing the same thing with a different data factory and get the same result. I thought there was something wrong with my CI/CD process, however it looks like the problem exists even without going through Azure DevOps release processes.
@Brent Leslie I am able to reproduce this in my environment (without CI/CD) and checking internally with the products team on this. I will update you here as soon as I hear back from them.
Cool thanks @SaurabhSharma0303 - it's broken a few of our ETL processes at the moment. So currently we have a few failing processes which previously used to work. I think I can work around them by manually publishing the parameters, but I will have to do this every evening due to us continually updating our data factories with nightly builds.
@Saurabh Sharma - any updates on this?
@Brent Leslie sorry for the delay on this. I am still waiting for products team response this. I will update you as soon as I get a response.
Sign in to comment