How to structure ADF when having multiple data projects?

Tim Hellegers 26 Reputation points
2021-08-03T14:53:31.617+00:00

Hi all,

What is this best way to organize ADF when there are multiple projects that are not related?

We now have one project with two ADF components (ADF-DEV and ADF-PROD). We will be using GitHub to control the versions and updates to production. But in the future we want to use ADF for multiple projects that are not related.
Is it better to create two additional ADF components (DEV and PROD) for each project or structure them in the excisting components?

I cannot find a proper way to this question on the internet.

Best,
Tim

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
0 comments No comments
{count} vote

Accepted answer
  1. Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator
    2021-08-03T22:56:02.52+00:00

    Hi @Tim Hellegers ,

    Thanks for using Microsoft Q&A !!

    In my opinion, you could create separate ADF's for different projects as those are separate. Also, I suggest you to establish a CI/CD Pipeline for each your Project ADFs which will help you move pipelines easily from one environment(dev/prod) to another instead of using two different ADF's (ADF-DEV, ADF-PROD), one for development and one ADF for production.
    Please refer to the documentation for more details. This way you will not affect pipeline of any other projects.

    Please let me if this helps.

    Thanks
    Saurabh

    ----------

    Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.

    2 people found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.