can we set global parameters with diffrent values, for the same pipeline across diffrent enviroments Such as (Dev , Qa, Prod)

Raviyaramati-1837 1 Reputation point
2020-12-03T11:12:04.55+00:00

Hi Team ,

1)we have adf pipeline and we have dataset pointing to different locations(location path passed as parameter) in different environment, for same pipeline, can we over ride this location parameters using global paraments, so that it will not reflect in higher environments after deployment ..?

example: for pipeline A-etl we have source location as a1 in dev , for that same pipeline A-etl we have source location as b1 in qa, can we over ride this location using global paraments in dev , so that it will not reflect in qa and other higher environments after deployment.,

2)The pipeline has different database as input across all environment ..

dev -database1
qa - database2
prod- database3

but when we have deployment, all changes are merged from dev to prod .so after deployment pipeline pointing to same database as in dev ,across all environments, after deployment , but we don't want that , how can we achieve this ?

Thanks in Advance

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,529 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. HarithaMaddi-MSFT 10,126 Reputation points
    2020-12-07T12:36:18.927+00:00

    Hi @Raviyaramati-1837 ,

    Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    If you are using CI/CD for deploying the data factory across environments, overwriting global parameters in ARM templates during deployment is preferred approach. If using manual deployment, PowerShell script is the preferred approach. Both these approaches are present in this document.

    Please suggest if this helps and let us know for further queries.

    ----

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.