Error reading empty Azure Synapse Link table in ADF
Hi All,
We are using Azure Synapse Link for Dataverse to keep track of changes in several Dynamics 365 entities. These changes are being synchronized to Azure Data Lake v2 blob storage. Through a Data Flow in Azure Data Factory we are able to successfully import these CSV files in an Azure SQL database.
In the Data Flow in ADF, we use using a Common Data Model Inline data set.
For tables that actually contain records, the Data Flow works perfect!
On the other hand, when trying to import empty tables, we receive an error.
Error: at Source 'sourcetable': Could not read '/tablename' from the 'cdm' namespace. Reason 'com.microsoft.commondatamodel.objectmodel.storage.StorageAdapterException: Could not read content at path: /logical/tablename'
Source settings:
Source options:
In the Azure Synapse Link configuration in the make.powerapps.com portal, I can see the table contains no data. This is confirmed by looking at the corresponding folder in the datalake. This folder contains no CSV files.
The model.json does contain the actual metadata of the empty table with all attributes and so on, although the partitions.locations is empty.
The reason why we don’t want to leave out this Data Flow is that it works fine in our development environment, where the table does contain data. In production the table is yet empty, but will contain data in the near future, so we would like to prepare the corresponding pipelines in production as well.
Has someone experienced this behavior and / or is there a workaround?
Thank you for your input!
Gerrie