FetchXML drops columns, how else can I work with MS CRM Dataverse?

Question

I am trying to copy data from MS Dynamics CRM to an Azure SQL Database, but the table is large, resulting an a very expensive and slow Copy Data upsert. I switched the source from "Entity Name" to "Query" and wrote a FetchXML query to pull the data, but Data Factory's FetchXML drops columns if the first 10 records are all null.

Is there a way to get around this idiocy artificial limitation and pull data from CRM as-is? Another language or tool to use instead? A specific command or keyword in FetchXML?

Answer 1

Your request is not that clear, but based on what you provided so far, instead of relying on FetchXML to automatically include all columns, explicitly state each column you need in your FetchXML query.Dynamics CRM supports OData, which is a more flexible data access protocol and can be used to retrieve data.OData queries can be more detailed and less restrictive compared to FetchXML.

The Dynamics CRM SDK provides a rich set of APIs to interact with CRM data. You can write a custom application or script using the SDK to extract the data you need. This allows for more control and can bypass some of the limitations of FetchXML.