Environment based parameters

Question

Environment based parameters

Subashri Vasudevan 11,306 Volunteer Moderator

I have a pipeline with certain parameters pointing to different paths in DEV SFTP server. During design time, we can hardcode and debug\run pipeline. What i want to know is, if i promote my pipeline to QA\ Test environment, i need to know how do we make my pipeline refer to something like a config\template file to get paths corresponding to that environment

For instance, if i promote to QA, my paths will be like \qa-sftpserver\qa\folder1

if i promote to PROD, it will be like \prod-sftpserver\prod\folder1

Is there any reference to implement it? Basically looking to know more something like dtsConfig file in SSIS that supplies values to packages in run time.

Thanks.

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2023-08-21T06:11:18.95+00:00

Hi Subashri Vasudevan, Just checking if below answer helps. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Please let me know if any further queries. Thank you.

1 answer

Your answer

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2023-08-21T06:11:18.95+00:00

Hi Subashri Vasudevan, Just checking if below answer helps. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Please let me know if any further queries. Thank you.

Answer 1

ShaikMaheer-MSFT 38,631 Microsoft Employee Moderator

Hi Subashri Vasudevan,

Thank you for posting query in Microsoft Q&A Platform.

If we compare package in SSIS as pipeline in ADF then, the way to send some inputs to Pipeline are only via triggers. Now triggers will not contain a mechanism of reading data from files or tables. Hence, I feel sending environment details via trigger to pipeline and then in the pipeline based on environment value, trying to query config file or tables using lookup activity may helpful here.

Please let me know how it goes. Thank you.

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2023-08-16T11:00:48.0033333+00:00

Hi Subashri Vasudevan, Just checking if above helps? Please let me know if any further queries. Thank you.
Subashri Vasudevan 11,306 Reputation points Volunteer Moderator

2023-08-16T13:54:37.4966667+00:00

Hi Maheer, i am looking for some guidance on templates that we use in different environments. I need to update my pipeline parameters with environment based paths. For example, if i run my pipeline in dev, it needs to point to a template file with all dev paths. If i promote pipeline to QA, I need to make the pipeline pick paths that are for QA. kind of json key value pairs with paths ..
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2023-08-18T07:15:50.8833333+00:00

Hi Subashri Vasudevan, Since triggers will not have capability of loading files or reading files. How about, having a global parameter value to indicate environment and then inside pipeline based on global parameter value using lookup activity pointing to your own environment specific config file and reading details from there?
Please let me know if that works.

Please consider hitting Accept Answer button. Accepted answers help community as well.
Subashri Vasudevan 11,306 Reputation points Volunteer Moderator

2023-08-21T15:33:02.3866667+00:00

Hi Maheer, i am looking for a file with set of parameters which will point to different paths..having global variables and looking up is going to be hectic. To make it clear , something on devops that says publish_config.json.. which has configuration for the pipelines.. in dev the json file will point to dev paths and in prod it will have paths to prod paths. I'm looking for the steps to create such config file and use it in the pipelines

Share via

Environment based parameters

1 answer

Your answer