How to configure Azure Artifacts to Azure Data Factory?

Question

I am trying to see whether I could use Azure Artifacts to do the data integration that I need.

So, I am trying to pull data from Sage Intacct application (third party application) into Azure SQL server.
This is a diagram of their web service data flow:
https://developer.intacct.com/web-services/

I learned that I could use Nuget package (.NET SDK) thru Azure Artifacts (https://azure.microsoft.com/en-us/services/devops/artifacts/).

I am trying to understand how Azure Artifacts and Nuget work.

I am also trying to understand how Azure Artifacts works with Azure Data Factory.
I watched one YouTube video and it appears that I could connect to Azure DevOps and get code to Azure Data Factory.
How do we configure between Azure Artifacts and Azure Data Factory?

Thanks.

Answer 1

Hi @KingJava ,

Thank you for ask Microsoft Q&A Platform.

This YouTube video, actually trying to explain having CI/CD approach to ADF using DevOps repo. That means all your developed ETL pipelines of ADF go and land in repo as files and from there you can try to have CI/CD approach for your ADF as well. Click here for documentation of ADF CI/CD.

Q. I am trying to pull data from Sage Intacct application (third party application) into Azure SQL server.
A. For this, If you are planning to make API call to get data from Sage Intacct application, then below approach may work.
Step1: Create a REST connector type dataset for your source.
Step2: Create a Azure SQL connector type dataset for your sink.
Step3: Use Copy activity, Inside source tab select stp1 dataset and inside sink tab select step2 dataset.
Step4: Inside copy activity mapping tab import schema and do column mappings between source and sink if require.

Q. I am trying to understand how Azure Artifacts and Nuget work.
Azure Artifacts is an extension that makes it easy to discover, install, and publish NuGet, npm, and Maven packages in Azure DevOps. So, in some terms if you want to save your packages into DevOps and utilize them during deployments then Azure Artifacts is right place.

Q. I am also trying to understand how Azure Artifacts works with Azure Data Factory.
Azure data factory doesn't have any native connector for Azure artifacts. Click here to know about connectors in Azure data factory.

Q. How do we configure between Azure Artifacts and Azure Data Factory?
Azure artifacts has REST API to communicate with them, so we can make REST call to Azure artifacts using web activity or REST Connector from Azure data factory.

Please let us know if this helps or any further queries.