How to get data for all the fields listed there in CRM using Azure data factory

Jayasree Gade 5 Reputation points
2023-02-02T19:45:47.8566667+00:00

For getting full load data from the CRM database to the Azure SQL database, I am using the table option in the copy source and getting the data for all the columns.

User's image

But when I am trying to get incremental data using Query option for which I am using Fetch XML query like below:

<fetch mapping="logical" version="1.0">

<entity name="@{variables('TableName')}">

<all-attributes />

<filter>

<condition attribute ="modifiedon" operator="ge" value="@{variables('TransactionDate')}"/>

</filter>

</entity>

</fetch>

I am not getting data for many of the attributes in the table even though we have data for these columns at the source. I have used all the attribute names in the query and tested, but still no use. Only by using Table option i.e Full load we are getting correct data.

So, is there any workaround solution for getting incremental data from CRM source?

Thanks in advance for your assistance.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,534 questions
{count} vote