How to setup REST with managed identity to call Azure Tables?

Durand, Guillaume 6 Reputation points
2021-06-21T09:27:22.653+00:00

I store events in Azure Storage Tables, with one table per year+month e.g. EventLog202105.
I want to process all the events (so all the tables whose name starts with EventLog). Unfortunately there is no Lookup activity to handle this. So I thought about using the Tables REST API.
I created a REST linked service using Managed Identity to authenticate, and a REST dataset using this service.
I added the datafactory system identity as Contributor to the Storage.
However the data retrieval fails with a 403.

How to setup the REST service/dataset for the authentication to work?
Or what is the proper way to get the names of all the tables of a Storage account?

Service configuration:
107581-adf-rest-service.png

Dataset configuration
107591-adf-rest-dataset.png

Storage account IAM
107500-adf-iam.png

Failure when previewing the data from the dataset
107546-adf-failure.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
0 comments No comments
{count} vote

2 answers

Sort by: Most helpful
  1. PRADEEPCHEEKATLA 90,641 Reputation points Moderator
    2021-06-22T10:45:05.307+00:00

    Hello @Durand, Guillaume ,

    Welcome to the Microsoft Q&A platform.

    Unfortunately, you cannot access Azure Table storage with a managed identity.

    Reason: Only Azure Blob and queue storage are currently supported with managed identities.

    108154-image.png

    For more details, refer Services that support managed identities for Azure resources

    You can use Azure Table Storage linked service to connect with table storage by using Account Key or SAS URI.

    108122-image.png

    For more details, refer to Copy data to and from Azure Table storage by using Azure Data Factory

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

  2. Jorge Rodrigues 181 Reputation points
    2022-04-01T15:29:32.407+00:00

    Hello all, from what I can see. Managed Identity access is now possible according to https://learn.microsoft.com/en-us/azure/storage/tables/authorize-managed-identity

    Has anyone tried it?

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.