Saprk Azure blob Writer with Principal Secret (entraID)

Prem 25 Reputation points
2024-05-14T21:48:16.7733333+00:00

i am trying to write to azure blob using the entra ID it gives the following error :

ERROR AzureNativeFileSystemStore: Encountered Storage Exception for delete on Blob: https://<acc>.blob.core.windows.net/<container>/_$azuretmpfolder$/ba8b5467-b477-460a-97c8-662223b4d21epart-0082fb-41b238001672.c000.snappy.parquet, Exception Details: This request is not authorized to perform this operation using this permission. Error Code: AuthorizationPermissionMismatch

Please help . files are being written in _temprory folder

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,470 questions
0 comments No comments
{count} votes

Accepted answer
  1. Amrinder Singh 2,770 Reputation points Microsoft Employee
    2024-05-15T02:28:14.22+00:00

    Hi Prem - Thanks for reaching out.

    Based on the exception, the SPN seem to be missing some permission in order to perform the write operation.

    Are you making of RBAC or ACLs? If ACL's, you can try using RBAC with role such as Storage blob Data Contributor that shall help in the isolation.

    Another pointer to check is if there are any networking level restriction on the account level?

    Please let us know if you have any further queries. I’m happy to assist you further.    


    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Prem 25 Reputation points
    2024-05-15T09:50:38.73+00:00

    Okay I have changed that: It still shows the same error where its not able to delete _$azuretmpfolder$

    .Can you please help on that?Screenshot 2024-05-15 at 3.18.57 PM

    0 comments No comments