When we are accessing (Adls Gen2)data lake folders in databricks, we are getting error as This request is not authorized to perform this operation using this permission

Question

we are getting below error while accessing azure datalake gen2 subfolders in databricks, getting the below error.
Error:
Operation failed: "This request is not authorized to perform this operation using this permission.", 403, GET, https://adlslandingprodeu.dfs.core.windows.net/ibe?upn=false&resource=filesystem&maxResults=5000&directory=data-fuel/fuel/chub/2023&timeout=90&recursive=false, AuthorizationPermissionMismatch, "This request is not authorized to perform this operation using this permission. RequestId:74746d45-d01f-0042-4671-52eba3000000 Time:2024-01-29T05:13:25.4587894Z"

Answer 1

ACLs are used by Azure Data Lake Storage Gen2 to provide granular control over files and directories. Make sure that the user account trying to access the data or the Databricks service principal has the necessary read, write, or execute permissions set.

you can check the following link for more details

https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-access-control

Answer 2

Hello

Thanks for the question and using MS Q&A platform. To resolve this issue, you need to verify the access permissions for the ADF and user type: Note: Storage Blob Data Contributor: Use to grant read/write/delete permissions to Blob storage resources.

ADF permissions: Kindly check the permissions on the Storage account (Select the required ADF)

Check the user permission on the storage account. ( In your case your username)

For more details, refer to the below threads addressing similar issue:

• https://learn.microsoft.com/en-us/answers/questions/25915/azure-databricks-throwing-403-error.html
• https://learn.microsoft.com/en-us/answers/questions/775151/index.html

Hope this will help. Please let us know if any further queries. Please accept if it helps