![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,990 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Hi @Vineet S
Welcome to Microsoft Q&A platform and thanks for posting your query here.
When using DevOps templates for deployment in Azure Data Factory (ADF), you can streamline and automate your CI/CD processes. Here is a brief overview of how it works:
DevOps Template Deployment in ADF
- Template Structure: DevOps templates typically define pipelines, parameters, and configurations used in your ADF deployment process. These templates can be included in your Azure DevOps repo and used as part of your build and release pipelines.
Setting Up CI/CD for ADF:
- In Azure DevOps, create a pipeline that retrieves ADF artifacts (e.g., pipelines, datasets, linked services) from source control.
- Define the build process to validate and package the ADF assets.
- Deploy the artifacts to different environments (development, test, production) using release pipelines.
Development in ADF with Azure DevOps GIT Integration
Azure Data Factory has two modes - GIT mode and Live mode. In the development environment (Dev ADF), GIT mode is where the development happens. Follow the steps below to set up Git Integration for the Dev ADF.
Step 1: In the Dev Azure Data Factory Studio, navigate to the Manage tab > select Git configuration under Source control section > click Configure.
Step 2: In the Repos settings, choose "Azure DevOps Git" as the repository type. Select your Azure DevOps Account, Project name and the existing Repository that you have created in your DevOps project. Use main as the Collaboration branch and the default adf_publish as the Publish branch. You should create a sub-folder adf-code under the Root folder for easy organisation of all your ADF artifact files.
ADF development process with Git integration:
- Each developer creates their own Feature branch as a clone of the Collaboration branch ('main').
- Once the developer has made and tested the changes in the Feature branch, he/she needs to create a Pull Request (PR) to merge into the Collaboration branch ('main').
- When the PR is approved and completed, changes will be committed in the 'main' branch which will automatically trigger the first pipeline that will build and deploy the changes to the Live mode of the Dev ADF. More details on how to set up this build-and-deploy-dev pipeline are in the next section.
Reference:
- https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-improvements
- https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-automate-azure-pipelines
- https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery
Hope this helps. Do let us know if you any further queries.
If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.