Export Dynamics 365 (Dataverse) tables to csv files with Azure Data Factory

HSever 136 Reputation points
2022-05-08T04:14:39.887+00:00

I need to run an export of 20 custom tables located in Dynamics 365/PowerApps (with Dataverse backend) to blob storage csv files. Each table to be copied 1:1 to the csv file. The total data volume for all tables is less than 2 GB. I plan to use Azure Data Factory.

  1. Can I use the ADF copy functionality for the table to csv copy (please point me to couple of good links for this)?
  2. Do you see limitations?

Many thanks for your input !

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,334 questions
0 comments No comments
{count} votes

Accepted answer
  1. KranthiPakala-MSFT 46,412 Reputation points Microsoft Employee
    2022-05-10T19:50:06.55+00:00

    Hello @HSever ,

    Thanks for the question and using MS Q&A platform.

    Yes, you can copy data from Dynamics 365 (Microsoft Dataverse) to any supported sink data store using ADF Dynamics 365 connector in ADF copy activity.

    Please note that the ADF Dynamics connector supports Dynamics versions 7 through 9 for both online and on-premises. More specifically:

    • Version 7 maps to Dynamics CRM 2015.
    • Version 8 maps to Dynamics CRM 2016 and the early version of Dynamics 365.
    • Version 9 maps to the later version of Dynamics 365.

    For Dynamics 365 specifically, the following application types are supported:

    • Dynamics 365 for Sales
    • Dynamics 365 for Customer Service
    • Dynamics 365 for Field Service
    • Dynamics 365 for Project Service Automation
    • Dynamics 365 for Marketing This connector doesn't support other application types like Finance, Operations, and Talent.

    Note: To copy data from Dynamics 365 Finance and Operations, you can use the Dynamics AX connector.

    When you copy data from Dynamics, the following document has a table which shows mappings from Dynamics data types to interim data types within the ADF service. Configure the corresponding interim data type in a dataset structure that is based on your source Dynamics data type by using the mapping table mentioned in this document: Data type mapping for Dynamics

    Limitation: Please note the Dynamics data types AttributeType.CalendarRules, AttributeType.MultiSelectPicklist, and AttributeType.PartyList aren't supported.

    In case if you have a requirement to copy tables to ADLS Gen2 then instead of ADF, there is an out of box service called Azure Synapse Link for Dataverse with Azure Data Lake which can be used to export the D365 data to ADLS Gen2 directly. But it has below prerequisites and limitations:

    200742-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

0 additional answers

Sort by: Most helpful