Issue in Creating Trigger for ADF pipeline that copies data from dataverse (Synapse Link) datalake to AzSQL

Question

Hi,

I am working to copy data from Azure Synapse link to Az SQL. I have data in the datalake including model.json.
I am using the ADF template as suggested on this page tutorial
https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-pipelines?tabs=data-factory

I am facing an issue while creating the trigger for storage event.

The page tutorial is asking to put "/model.json" in the field called Blob Path ends with

However, when I do that, on the next page, I am not getting any matching Blob

I tried putting "model.json" instead of "/model.json"

It matched "model.json" but it shows all other model.json for other entities and I am unable to unselect that. I only want trigger for any change in model.json

I went ahead and created trigger with all these model.json files as it included my "model.json" too. Trigger was created but it threw error

ErrorCode=UserErrorFileNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code 'NotFound'. Account: ''. FileSystem: '. Path: 'Microsoft.Athena.TrickleFeedService/model.json'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'.

Could you advise how can I just select my model.json and not select the entity based files. As mentioned I tried using /model.json but it matched no Blob for trigger

Answer 1

Can you guide further

Hi

Just correcting your interpretation.
I am trying to create an event based trigger which executes the pipeline when only 1 blob file named 'model.json' is changed. It is the main model.json file and it is present in container and not any subfolder.

I dont want to create trigger based on other model.json files like account_model.json

When I provide '/model.json' it is not showing me any BLOB file . I expect it to show me just my main "model.json"
Please check my first two screenshots again from the first post.

Answer 2

Hi @Mav ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

As I understand your issue, you are trying to create an event based trigger which executes the pipeline when the blob file ending with 'model.json' gets created/deleted. Please correct me if my interpretation of your query is incorrect.

• '/model.json' will work when the filename is 'model.json'. In the entire list of files, there is no file with file path as 'Microsoft.Athena.TrickleFeedService/model.json' . That's the reason it's throwing error saying path not found. All the file names end with model.json under 'Microsoft.Athena.TrickleFeedService' folder, but the filename is not model.json. So no need to provide '/'

If you want to filter out few of the files which ends with 'model.json' under 'Microsoft.Athena.TrickleFeedService' folder, I would recommend you to create a subfolder and place all the needed files within that and configure like this:

Blob path begins with : "Microsoft.Athena.TrickleFeedService/subfoldername"
Blob path ends with : "model.json"

For more details, kindly check out Examples of storage event triggers

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators