Share via

parallelism in ADF

Vineet S 1,390 Reputation points
2024-11-19T14:09:40.22+00:00

Hi,

how parallelism works in ADF..Please explain with scenario

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.


Answer accepted by question author

Nandan Hegde 36,886 Reputation points MVP Volunteer Moderator
2024-11-19T14:31:43.3866667+00:00

Can you please specify what and in which context you mean by parallelism?

  1. Pipeline parallelism

You can set up concurrency level at a pipeline to ensure concurrent session of the same pipeline.

In case if not set, there can be parallel executions of the same pipeline if triggered simultaneously.

The impact of that would depend on the dataflow within the pipeline and would differ from design to design

  1. for loop parallelism

There is for each loop activity and you can ensure that it is either sequential execution if the sequence is dependant or parallel is the looping is independant

Was this answer helpful?


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.