Errors when trying to create a storage event trigger in Synapse pipeline

Question

Hello Everyone,

I am developing an ETL pipeline and part of the process is to copy .cvs files from ADLS gen 2 into Synapse dedicated pool. I have tried creating a Storage Event Trigger to run the pipeline whenever a new file is uploaded. However, I get the following error:

"The received access token is not valid: at least one of the claims 'puid' or 'altsecid' or 'oid' should be present. If you are accessing as application, please make sure service principal is properly created in the tenant"

The account I am using has onwer access and I went on and registered resource provider: Microsodt.EventGrid

Secondly, how can I ensure that only newly added files will be copied to the SQL pool rather than copying all the files available in the ADLS container?

Answer 1

Have you registered the Data Factory resource provider (Microsoft.DataFactory)? Please try that.

Answer 2

Hello @Alberto Morillo . Thank you for your reply. Yes, I have registered the Data Factory resource provider (Microsoft.DataFactory) and I could publish the trigger.

I would also like to know how I can ensure that only newly added files will be copied to the SQL pool rather than copying all the files available in the ADLS container. It is my first time working with Synapse Analytics workspace and its storage accounts.