Error reading empty Azure Synapse Link table in ADF

Gerrie Siersema 1 Reputation point
2022-07-07T14:19:25.04+00:00

Hi All,

We are using Azure Synapse Link for Dataverse to keep track of changes in several Dynamics 365 entities. These changes are being synchronized to Azure Data Lake v2 blob storage. Through a Data Flow in Azure Data Factory we are able to successfully import these CSV files in an Azure SQL database.

In the Data Flow in ADF, we use using a Common Data Model Inline data set.
For tables that actually contain records, the Data Flow works perfect!
On the other hand, when trying to import empty tables, we receive an error.
Error: at Source 'sourcetable': Could not read '/tablename' from the 'cdm' namespace. Reason 'com.microsoft.commondatamodel.objectmodel.storage.StorageAdapterException: Could not read content at path: /logical/tablename'
218625-image.png

Source settings:
218592-image.png

Source options:
218672-image.png

In the Azure Synapse Link configuration in the make.powerapps.com portal, I can see the table contains no data. This is confirmed by looking at the corresponding folder in the datalake. This folder contains no CSV files.
218626-image.png

The model.json does contain the actual metadata of the empty table with all attributes and so on, although the partitions.locations is empty.
218634-image.png

The reason why we don’t want to leave out this Data Flow is that it works fine in our development environment, where the table does contain data. In production the table is yet empty, but will contain data in the near future, so we would like to prepare the corresponding pipelines in production as well.

Has someone experienced this behavior and / or is there a workaround?
Thank you for your input!

Gerrie

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,208 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.