Azure synapse link creates model.json with no partitions

Question

Azure synapse link creates model.json with no partitions

Oladipupo Onibile 0

Hi,

I am following this link below to copy dataverse data to Azure SQL DB using azure data factory pipelines. The model.json file created by my synapse link for dataverse is correctly creating the schema and attribute names for all the tables/entities. However, no data is coming across in the pipeline because the model.json file is not updated with partition location for any of the entities.

phemanth 15,765 Reputation points Microsoft External Staff Moderator

2024-06-28T06:08:57.3866667+00:00

@Dipo Onibile We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
phemanth 15,765 Reputation points Microsoft External Staff Moderator

2024-07-01T04:38:40.5766667+00:00

@Dipo Onibile just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Flemming Haurum 0 Reputation points

2024-08-23T12:58:50.5166667+00:00

Hi Dipo
Did you find a solution to this problem?
I am facing the same problem as you I believe.
In the model.json file the partitions element is empty like this - "partitions":[]
In another installation it looks like this and how it should be - "partitions":[{"name":"???","location":"https://???.dfs.core.windo.....

1 answer

Your answer

phemanth 15,765 Reputation points Microsoft External Staff Moderator

2024-06-28T06:08:57.3866667+00:00

@Dipo Onibile We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
phemanth 15,765 Reputation points Microsoft External Staff Moderator

2024-07-01T04:38:40.5766667+00:00

@Dipo Onibile just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Flemming Haurum 0 Reputation points

2024-08-23T12:58:50.5166667+00:00

Hi Dipo
Did you find a solution to this problem?
I am facing the same problem as you I believe.
In the model.json file the partitions element is empty like this - "partitions":[]
In another installation it looks like this and how it should be - "partitions":[{"name":"???","location":"https://???.dfs.core.windo.....

Answer 1

@Dipo Onibile

Welcome to Microsoft Q&A platform and thanks for posting your question.

It seems like you’re facing an issue with the model.json file not being updated with the partition location for the entities. This could be due to formatting issues of the partition location path in the model.json file. Here are the steps you can follow to fix this issue:

Open the model.json file in a text editor.
Find the partitions.Location property.
Change "blob.core.windows.net" to "dfs.core.windows.net".
Fix any "%2F" encoding in the URL to "/".

Please note that the model.json file in a Common Data Model folder describes the data in the folder, metadata and location, as well as how the file was generated and by which data producer. The partitions.Location property in the model.json file is crucial as it provides the location of the data files.

If you continue to face issues, I recommend checking out these resources:

These resources provide detailed steps on how to copy data from Dataverse to Azure SQL using Azure Data Factory and might help you troubleshoot

Hope this helps. Do let us know if you any further queries.

Share via

Azure synapse link creates model.json with no partitions

1 answer

Your answer