inline common data model data set not reading pass the 1st entity in a set variable

Question

inline common data model data set not reading pass the 1st entity in a set variable

Ade 26

Hi,

ii created an Adf to move data from a blob storage to sql , the adf uses Model.json and it works for the first entity in the list of entities I parsed as variable, then just skips over the rest, on checking i got the error message below :

ERROR Logger: Could not read '/contsa' from the 'cdm' namespace. Reason 'com.microsoft.commondatamodel.objectmodel.storage.StorageAdapterException: Could not read content at path: /logical/contsa'

KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-08-01T18:08:58.83+00:00

Hello @Ade ,

Thanks for the question and using MS Q&A platform.

Just an FYI - I have updated the tag to azure-data-factory for better visibility across the community.

To better assist on your issue, could you please elaborate a bit on this statement the adf uses Model.json and it works for the first entity in the list of entities I parsed as variable, then just skips over the rest, on checking i got the error message below and also please do include additional screenshot on how and where you are using those variable values in your dataflow.

We look forward to your response.

Thanks
Ade 26 Reputation points

2022-08-01T22:43:29.143+00:00

Thanks for the response

To elaborate I build a adf to move data from Common data service to Azure Sql database - the build worked as required when I tested parsing through just one entity as a variable, but once the variable array contains more than one entity - the 1st entity move over fine but the rest returns empty (which is wrong as the source contains data)

thanks
KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-08-30T18:39:06.477+00:00

Hello @Ade ,

Just wanted to check if your issue was resolved or still need assistance. I see that you are parameterizing the array list of entities and seems like a configuration issue. If you still need assistance, I recommend filing a support ticket for deeper analysis as we may have to look at your configuration for array parameters/variables.
Ade 26 Reputation points

2022-08-31T07:21:38.357+00:00

Hi @KranthiPakala-MSFT ,

Thanks so much for this, the issue has been sorted.
KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-08-31T16:40:56.963+00:00

Hello @Ade ,

Glad to know your issue has been resolved and appreciate much for confirming. Would you please share the root cause and resolution here with community members as it can be helpful for others reading this thread.

Thank you

1 answer

Your answer

KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-08-01T18:08:58.83+00:00

Hello @Ade ,

Thanks for the question and using MS Q&A platform.

Just an FYI - I have updated the tag to azure-data-factory for better visibility across the community.

To better assist on your issue, could you please elaborate a bit on this statement the adf uses Model.json and it works for the first entity in the list of entities I parsed as variable, then just skips over the rest, on checking i got the error message below and also please do include additional screenshot on how and where you are using those variable values in your dataflow.

We look forward to your response.

Thanks
Ade 26 Reputation points

2022-08-01T22:43:29.143+00:00

Thanks for the response

To elaborate I build a adf to move data from Common data service to Azure Sql database - the build worked as required when I tested parsing through just one entity as a variable, but once the variable array contains more than one entity - the 1st entity move over fine but the rest returns empty (which is wrong as the source contains data)

thanks
KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-08-30T18:39:06.477+00:00

Hello @Ade ,

Just wanted to check if your issue was resolved or still need assistance. I see that you are parameterizing the array list of entities and seems like a configuration issue. If you still need assistance, I recommend filing a support ticket for deeper analysis as we may have to look at your configuration for array parameters/variables.
Ade 26 Reputation points

2022-08-31T07:21:38.357+00:00

Hi @KranthiPakala-MSFT ,

Thanks so much for this, the issue has been sorted.
KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-08-31T16:40:56.963+00:00

Hello @Ade ,

Glad to know your issue has been resolved and appreciate much for confirming. Would you please share the root cause and resolution here with community members as it can be helpful for others reading this thread.

Thank you

Answer 1

Ade 26

Hi @KranthiPakala-MSFT ,

It more about my understanding of how the "Checkpoint Key" works

the job wasn't repopulating 'Entities' in SQL : as the checkpoint sees no changes coming from the CRM Side

So the fix was to overwrite the "Checkpoint Key" forcing the job pick up all the CRM data from the base

Thanks

KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-09-01T23:47:23.767+00:00

Thank you @Ade for sharing the details here and helping the community. Appreciate much!

Share via

inline common data model data set not reading pass the 1st entity in a set variable

1 answer

Your answer