Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
How to read data from blob storage using Linked Service token in Synapse
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 28.999999999999996%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
BEPV
0
Reputation points
Hello,
I am trying to use Linked Service token to read from an azure blob storage (NOT AZURE DATA LAKE STORAGE GEN2) in a Synapse Notebook, I created a linked Service and test the connection and it was succesfull but when I am trying to read using spark from the synapse notebook I am getting the following error:
spark.conf.set(f
spark.conf.set(f
full_path = "abfss://******@storageaccount.dfs.core.windows.net/"
df = spark.read.format('csv').load(full_path)
Py4JJavaError: An error occurred while calling o4165.load. : java.nio.file.AccessDeniedException: Operation failed: "This request is not authorized to perform this operation using this permission.", 403, HEAD, ...
The Linked Service is allow to connect successfully, I need to use Linked Service token because I need to use certificate instead of secret for authentication.
Azure Blob Storage
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 98%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KarishmaTiwari-MSFT 20,827 Reputation points Microsoft Employee Moderator2024-07-09T23:45:49.1066667+00:00 @BEPV Thanks for posting your query on Microsoft Q&A.
Ensure that the Synapse workspace managed service identity (MSI) has the necessary permissions to access the data in the storage account. You can assign the workspace to the “Storage Blob Data Contributor” role on the storage accountThe easiest way of doing this is to assign the workspace to the Storage Blob Data Contributor role on the storage account.
Check if the storage account has any firewall rules configured. If so, ensure that the Synapse workspace IP address is allowed. If you’re using a private container, verify that the firewall rules allow access from the Synapse workspace.
If you have enabled the firewall on the storage account, you need to follow these instructions: Configure Azure Storage firewalls and virtual networks | Microsoft Docs
-
BEPV 0 Reputation points
2024-07-10T15:52:58.49+00:00 I am not using Synapse Managed Identity, I am using an app as Service Principal as authentication method and that one has the required permissions, we already read from this storage we are just updating our auth from using secrets to use certificates
Sign in to comment
Sign in to answer