Lost column header when load data from Azure Synapse link

Question

I used data flow to load dataverse from Azure Synapse Link but the output file lost column header although I have chosed model.json from source options?

Could you support me.

Regards,

Answer 1

When loading data from Azure Synapse Link into Azure Data Factory using a Data Flow and column headers are missing, ensure your Synapse Link data source is correctly configured in Data Factory. Verify the model.json file accurately describes the schema and is referenced correctly. Within Data Flow, make sure settings related to headers (like "Include headers") are enabled both in source and destination. Inspect your Data Flow transformations to ensure none remove headers, use Data Preview to debug, and check Azure monitoring/logs for issues. If unresolved, consult Azure Support.

Answer 2

Hello synapselink,

Welcome to the Microsoft Q&A forum.

When you use Azure Synapse Link to ingest Dataverse data into a data lake, the data is stored in a Common Data Model format. In CDM, the schema is not stored as headers but rather in a separate model.json file.

To properly read CDM data in Azure Data Factory, you should use mapping data flows with the source set as Common Data Model.

This approach handles schema handling for you and knows how to read the correct files for entities in the CDM structure.

You can find more information on how to export Dataverse data to a data lake using Azure Data Factory in this Microsoft Learn article:

https://learn.microsoft.com/en-us/powerapps/maker/data-platform/export-to-data-lake-data-adf

I hope this helps. Please let me know if you have any further questions.