Issue pushing/updating ADF linked service for ADB pool cluster configuration via CICD

Question

Hello All,

We are facing issue while pushing/updating the ADF Linked service for databrick pool cluster configuration via Github action to the live environment.

Even after setting the "clusterOption": "Autoscaling", the cluster option switched to default, "Fixed" when it is getting pushed to the live ADF. We are trying to push the parameter via JSON. This is happening in all the environment. Below is the code for the same (Masking sensitive information).

1st image the live code where the "clusterOption": "Autoscaling" is missing in line 13.

2nd image is the GitHub code with the cluster option present.

Can you please advise us on what may have been wrong or is this MS Azure bug.

Answer 1

Hello @

Thanks for reaching out on this forum.

If you have multiple Linked Service configurations for the same Databricks workspace, the last configuration that is applied might overwrite the previous configurations. Make sure that you're applying the correct configuration and that it's not being overwritten by another configuration.Please let us know if you need further help in this matter and we can connect offline on this!