Share via

Azure ADF Global parameters Keeps disappering

Harish Sunderaraj 176 Reputation points
2020-08-17T11:26:35.127+00:00

Hi

I added global parameters to ADF but after sometime it disappers automatically, any idea is it a ADF bug or i am doing something wrong?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,949 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. MartinJaffer-MSFT 26,046 Reputation points
    2020-08-17T22:39:37.75+00:00

    Hello @Harish Sunderaraj and thank you for your question. Could you please elaborate on the circumstances under which your parameter disappears? I do have one possibility to share with you:

    If you have Git enabled, the global parameters are applied to the branch in which they are created. This means when you switch branches, the global parameter may not be available in the new branch.

    18037-globparam.gif

  2. MartinJaffer-MSFT 26,046 Reputation points
    2020-08-18T21:17:44.32+00:00

    Thank you for the clarification.

    So you made global parameters in Factory 1, published, then exported ARM and deployed to Factory 2.
    Global parameters did not initially appear in Factory 2 after deployment. Then after manually creating and publishing global parameters in Factory 2, they disappeared a few hours later.

    Hmm. I am not aware of any feature of Data Factory which would cause the disappearance by itself. However, if we can show every step is correct, and there are no other influences, then all that is left as the cause is Data Factory.
    So there are 2 items to investigate:

    1. Why the global parameters did not appear after deployment
    2. Why manually created and published parameters disappeared.

    For point 1, first check whether the global parameters were included in the portion of ARM template you deployed. The global parameters are not part of the main template, they are under the 'factory' folder. See images below. Link to using global parameters in CI/CD.

    18541-findglobparam.gif

    If the global parameters were part of the deployment and you didn't see them in the UI, you may have needed to refresh the UI. UI browser windows opened before the deployment would show old data until refreshed. The deployment process does not push updates to open browsers.

    For point 2, can you tell me whether there are any other developers working on that factory?
    If 2 people are working on it at the same time, they will not be aware of each other's changes until they do a refresh. This also includes if you have 2 browsers open to the same Data Factory. One publish can overwrite the changes made by the other's publish.

    This allows for the case where you had a browser open to Factory 2 before the ARM deployment, and did not refresh. This browser would not have the deployment's changes, and a subsequent publish could erase the global parameters.