Hello Daniel Woodhouse,
Greetings! Welcome to Microsoft Q&A Platform.
Synapse notebooks use Azure Active Directory (Azure AD) pass-through to access the ADLS Gen2 accounts and your account needs Storage Blob Data Contributor to access the ADLS Gen2 account (or folder). If you are running the notebook via the pipeline, the synapse workspace managed service identity needs Storage Blob Data Contributor to access the ADLS Gen2 account (or folder).
the error message seems like there was an authentication failure when trying to access a resource.
Please check if you provided the storage blob data contributor access
https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/using-the-workspace-msi-to-authenticate-a-synapse-notebook-when/ba-p/2330029
Follow the above tech community article and run the code using the service principle. You can use either managed identity or the service principal.
ACLs are used by Azure Data Lake Storage Gen2 to provide granular control over files and directories. Make sure that the user account trying to access the data or the Synapse service principal has the necessary read, write, or execute permissions set.
you can check the following link for more details
https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-access-control.
Similar thread for reference - https://learn.microsoft.com/en-us/answers/questions/1382065/synapse-notebook-got-accessdeniedexception
Hope this answer helps! Please let us know if you have any further queries. I’m happy to assist you further.
Please "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.