Thank you for letting me know for given more explanation.
You simply need to use Azure Data Factory in Azure DevOps pipeline. You can follow the steps below:
- From the Azure Repos, select the repo that contains the Data Factory code.
Prior to this you must have:
- Set up your code repository in Azure Data Factory:
- In Azure Data Factory, go to Author & Monitor. Select Set up code repository and then connect your repo.
- Repository type: Azure DevOps Git;
- Azure DevOps organization: Your active account;
- Project name: Your Azure DevOps data pipeline project.
- Import the data pipeline solution.
- Add pipeline variables.
Select Start Pipeline as your build pipeline type.
Check the default YAML code, you might need to replace and modify where necessary (if not an experiment) CHECK that everything is correct similar to the below code:
trigger: - master pool: vmImage: 'windows-latest' steps: - task: AzurePowerShell@5 inputs: azureSubscription: 'Your subscription' ScriptType: 'FilePath' ScriptPath: '$(System.DefaultWorkingDirectory)/adf_publish.ps1' ScriptArguments: '-ResourceGroupName $(ResourceGroupName) -DataFactoryName $(DataFactoryName) -Region $(Region) -ArmTemplateFile $(System.DefaultWorkingDirectory)/arm_template.json -ParameterFile $(System.DefaultWorkingDirectory)/arm_template.parameters.json' azurePowerShellVersion: 'LatestVersion'
- You can then save your code and move on.
- Upload data to your storage container.
- Set up Key Vault.
However, I found many resources and link for some out-of-box YouTube, check it out from the followings:
- Azure Data Factory Deployment with Azure DevOps CICD pipeline
- Continuous integration and delivery - Azure Data Factory
- Build a data pipeline by using Azure Pipelines
- YouTube Video: How to deploy azure data factory pipelines with DevOps CICD pipeline
Hope this is helpful! Kindly let us know if this is useful, you can ask for more if there is a need.
Good Success,
Sina