ADF - Timeout when all parts have access to resources.

Malvaro 125 Reputation points
2024-11-07T09:06:10.92+00:00

Hi Community!

I’m running into a challenging issue with my Azure Data Factory setup. Here’s what my current infrastructure looks like:

  • Azure Data Factory (ADF)
  • CosmosDB
  • Key Vault
  • Storage Account
  • Private Networks

Everything was set up months ago and worked smoothly until this week—now my ADF pipelines are failing.

Here's an overview of the pipeline:

  1. Step 1: Data is extracted from one storage account, processed, and saved in another storage account.
  2. Step 2: The stored data is then retrieved and saved into CosmosDB.

User's image

Before that,:

I have a runtime runningUser's image

And a Linked service with connection to the CosmosDB

User's image

After testing the linked service I can see that I have access and I can see the data.

User's image

However, when I run the pipeline I see this informationUser's image

And after 10 min I have the following error

User's image

And I don't see what could happen.

Extra information:

The ADF has the following roles and assignments

User's image

And the networking using private endpoints:

User's image

In short, if I test them independently, everything works, but running the pipeline I have no access...

Has anyone encountered a similar problem or has any advice? Any help would be much appreciated!

Thanks a lot for your help.!

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,693 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,990 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Smaran Thoomu 17,920 Reputation points Microsoft Vendor
    2024-11-14T09:17:15.3966667+00:00

    Hi @Malvaro & moialbla,

    Welcome to Microsoft Q&A platform and thanks for posting your query here.

    We have received confirmation from the PG team that the issue has been resolved. I wanted to inform you of this and kindly ask you to check on your end. If the issue still persists, please let us know. Thank you for your patience and understanding.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.