Data Factory Dataflows - Integration runtime parameterization

Question

Data Factory Dataflows - Integration runtime parameterization

AzRobo 16

Hi,

Is it possible to assign/modify the Integration runtime of multiple dataflows in one go?.

we have 50 pipelines with multiple dataflows in each pipeline using different IRs(azure), how can we assign specific IRs to group of dataflows dynamically.

This is required mainly to change the IR based on cluster size & data volume.

is there a command to execute the pipeline by passing the IR for each specific dataflow within the pipeline?

Thanks

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-09-13T09:56:06.857+00:00

Hi @AzRobo ,

Following up to see if below provided answer helps you? If yes, Please consider to click on Accept Answer. Accepted answers helps community as well. Thank you.

1 answer

Your answer

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-09-13T09:56:06.857+00:00

Hi @AzRobo ,

Following up to see if below provided answer helps you? If yes, Please consider to click on Accept Answer. Accepted answers helps community as well. Thank you.

Answer 1

MarkKromer-MSFT 5,231 Microsoft Employee Moderator

While you cannot dynamically change the IR assigned to the data flow activity in the ADF UI today, you can parameterize the core counts and compute type in the data flow pipeline activity directly. Just set the Azure IR to the default auto-resolve IR and you'll see this dynamic option.

AzRobo 16 Reputation points

2021-09-02T16:24:59.557+00:00

Thanks for the response.

we are looking for this option for user created Azure IR( Region specific). Any other possible way to replace the assigned IR for the dataflows?.

Thanks
Indra
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-09-08T17:43:54.28+00:00
Hi @AzRobo ,

Thank you for follow-up query.

As mentioned by @MarkKromer-MSFT , Unfortunately at this moment dynamically changing IR assigned to data flow activity is not possible. Please check below screenshot for same.

Hope this will help. Please let us know if any further queries. Thank you.

-----------------------------

Please don't forget to click on Accept Answer button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

Want a reminder to come back and check responses? Here is how to subscribe to a notification

If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Share via

Data Factory Dataflows - Integration runtime parameterization

1 answer

Your answer