spark pool notebook error

Question

Hello,
Do you know the solution?

Error :

java.nio.file.AccessDeniedException: Operation failed: "This request is not authorized to perform this operation.", 403

Notebook:

%%pyspark
df = spark.read.load('abfss://container@storagegen2name.dfs.core.windows.net/foldername/filename.csv', format='csv'
## If header exists uncomment line below
##, header=True
    )

Answer 1

Hello @arkiboys ,

Thanks for the question and using MS Q&A platform.

To resolve this issue, you need to verify that the Storage Blob Data Contributor role is assigned to user, who is accessing the file from ADLS gen2 account.

The below steps explains in details on how it works:

Step1: Ran the same query in the Notebooks, gave me same error message as shown above:

Step2: Checked the permissions on the Storage account permission and found Storage Blob Data Contributor role is not assigned to user.

Step3: Grant Storage Blob Data Contributor role is assigned to user.

Access Control (IAM) => + Add => Add role assignment => select Storage Blob Data Contributor role => Select User => Review and assign

Step4: Verify that the Storage Blob Data Contributor role is assigned to user.

**Step5: ** Re-run the notebooks

Note: Wait for 10-15 mins to reflect the RBAC - Storage Blob Data Contributor permissions.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators