Hi there, Resources: Storage Account - Networking: Enabled from selected virtual networks and IP addresses [my IP is whitelisted] IAM: Synapse MI and my user has Storage Blob Data Contributor role. Private Endpoint to Storage Blob. Synapse: Networking: My IP is whitelisted. Synapse Studio: My user is Synapse Administrator I am able to browse the Container and files using Synapse Linked Services. I am querying a file using Synapse Notebook and getting an error: Py4JJavaError: An error occurred while calling 0723.load. :java.nio.file.AccessDeniedException: Operation failed: "This request is not authorized to perform this operation.", 403, HEAD, Please help me with the error.

403 Error while executing notebook using spark.

Pushpendra Kumar Singh 6

Hi there,

Resources:

Storage Account -

Networking: Enabled from selected virtual networks and IP addresses [my IP is whitelisted]
IAM: Synapse MI and my user has Storage Blob Data Contributor role.
Private Endpoint to Storage Blob.

Synapse:

Networking: My IP is whitelisted.
Synapse Studio: My user is Synapse Administrator

I am able to browse the Container and files using Synapse Linked Services.

I am querying a file using Synapse Notebook and getting an error:

Py4JJavaError: An error occurred while calling 0723.load.
:java.nio.file.AccessDeniedException: Operation failed: "This request is not authorized to perform this operation.", 403, HEAD,

Please help me with the error.

PRADEEPCHEEKATLA-MSFT 76,586 Reputation points Microsoft Employee

2022-08-08T04:57:27.45+00:00

Hello @Pushpendra Kumar Singh ,

Thanks for the question and using MS Q&A platform.

Could you please share the complete stack trace of the error message which you are experiencing?
Pushpendra Kumar Singh 6 Reputation points

2022-08-08T14:02:31.067+00:00

Hi @PRADEEPCHEEKATLA-MSFT ,

Please find the error message in the attached file.

Thanks,
Pushpendra
PRADEEPCHEEKATLA-MSFT 76,586 Reputation points Microsoft Employee

2022-08-09T08:52:20.657+00:00

Hello @Pushpendra Kumar Singh ,

Thanks for sharing the error message. Could you please share the code snippet which you are using to access the storage account?
Pushpendra Kumar Singh 6 Reputation points

2022-08-10T17:44:25.71+00:00

Hi @PRADEEPCHEEKATLA-MSFT ,

The code I am using is.
----
%%pyspark
df = spark.read.load('abfss://nyc-taxi-data@pkslearningsa.dfs.core.windows.net/raw/calendar.csv', format='csv'
)
display(df.limit(10))

----
Thanks in Advance.
Pushpendra Kumar Singh 6 Reputation points

2022-08-10T17:48:13.42+00:00
Additional Information.

I have removed Storage Blob Data Contributor role for my user.
Created a managed private endpoint to Azure Storage Data Gen2.

I have two containers inside the default storage account.

def1

nyc-taxi-data (Second)

I am able to query the data for def1 but not nyc-taxi-data container.

Thanks.
PRADEEPCHEEKATLA-MSFT 76,586 Reputation points Microsoft Employee

2022-08-22T05:21:15.663+00:00

Hello @Pushpendra Kumar Singh ,

Apologize for the delay in response.

Have you resolved the above issue? In case if you are not resolved the issue - I would suggest you to share the Public access level permissions for the both containers?