Is it possible to syncronize Dynamycs365 CRM with a CosmoDB Mongo API with Azure Data Factory?

Giuseppe Di Leo 1 Reputation point
2022-03-01T16:11:51.193+00:00

Hello,
I'm trying create a flow in order to syncronize some Dynamics365 CRM items in Dataverse with some collections in CosmosDB MongoDB API.
I started trying with synapse link, I've connected it with a storage account and this produced a set of folders with csv files and a model.json file.
After that I've created a pipeline with a data flow. I've used a "Common Data Model" connected to the storage containing data exported by Synapse.
But when I try to add a Sink using Azure Cosmos DB the connector is disabled.
What am I doing wrong? How can I reach that result, even with some data transformation (e.g. building mongo nested documents).

Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,906 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,236 Reputation points
    2022-03-04T17:58:05.433+00:00

    Hello @Giuseppe Di Leo ,
    Thanks for the question and using MS Q&A platform.

    As we understand the ask here is "How to use Cosmos DB MongoDB API as a sink in Mapping Data Flow".

    Unfortunately, at this time, only Cosmos SQL is supported in Data Flow. Cosmos Mongo is not supported at this time. See this link for compatibility of connectors.

    However, Cosmos Mongo is supported by Copy Activity, so perhaps a 2-step process would work. You Data Flow can write to an intermediate storage, and Copy Activity can read from that intermediate storage and write to Cosmos Mongo.

    Thanks
    Martin


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.