12,145 questions with Azure Data Factory tags

Sort by: Updated
3 answers

Why an activity was not triggered on the Failure of previous Web activity in ADF

My web activity, Get ChangeOrderRequest, is in a sequential ForEach Prime Contract activity and can fail with the message, "Item not found". I have a Set exit message variable activity to be executed upon failure of the Get ChangeOrderRequest…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-27T15:00:54.9466667+00:00
Deirdre Clark 30 Reputation points
commented 2026-05-03T10:05:10.21+00:00
SAI JAGADEESH KUDIPUDI 2,535 Reputation points Microsoft External Staff Moderator
3 answers

how connect to a source system - SAP database?

how connect to a source SAP database?This project involves the migration of the existing data warehouse environment from Qlik to Microsoft Azure. The initiative aims to modernize the analytics platform by leveraging Azure’s scalable storage, compute, and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-15T09:42:26.0466667+00:00
Makama, ANTHEA (404) 0 Reputation points
commented 2026-05-03T09:25:55.75+00:00
SAI JAGADEESH KUDIPUDI 2,535 Reputation points Microsoft External Staff Moderator
1 answer

Azure Data Factory: Managed Identity Authentication Support for Cosmos DB for MongoDB

We need to copy data from Azure Cosmos DB (for MongoDB) to Azure Data Explorer via Azure Data Factory using managed identity authentication for security compliance. Currently, it appears only connection string authentication is supported for Cosmos DB…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-30T10:26:14.5166667+00:00
Yakov Epelbaum 0 Reputation points Microsoft Employee
answered 2026-05-02T06:05:24.15+00:00
kagiyama yutaka 1,745 Reputation points
2 answers

Xero 2.0 ADF connector not supporting the same tables as Xero 1.0 connector

The Xero 2.0 connector in ADF no longer supports the ProjectTasks and Time tables while the Xero 1.0 connector does. This is also mentioned in the documentation: …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-03-25T12:25:27.0333333+00:00
Michael van Leent 0 Reputation points
commented 2026-05-01T18:35:47.85+00:00
Manoj Kumar Boyini 13,605 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Deleted DataFactory Trigger still executing daily for months after being disabled and deleted

We used to execute an SSIS package 2x daily on a Data Factory trigger that started an Integration Runtime, ran the package, and stopped the runtime. This was all supposedly disabled over a year ago. Today I accidentally found from the logs that the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-29T22:38:09.0666667+00:00
Garrison Roberts 20 Reputation points
answered 2026-04-30T17:42:38.5133333+00:00
Garrison Roberts 20 Reputation points
0 answers

Join: Microsoft Azure Q&A Champions Program

The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-30T17:40:28.5+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
answered 2026-04-30T17:40:52.0933333+00:00
Q&A Assist
3 answers One of the answers was accepted by the question author.

Azure Datafactory to Fabric Lakehouse Migration

We used to see a popup in Azure Data Factory about migration to Fabric Lakehouse, but that notification is no longer appearing. Could you let us know if the migration is still required? If so, is there a timeline for it? Attaching the screenshot of how…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-22T09:57:27.6466667+00:00
USHA SREE GENJI (NON EA SC ALT) 20 Reputation points Microsoft Employee
accepted 2026-04-30T10:13:20.54+00:00
USHA SREE GENJI (NON EA SC ALT) 20 Reputation points Microsoft Employee
2 answers

SFTP Linked service using Public & Private Keys

Hello, Trying to create a SFTP linked service using " SSH Public key Authentication "and getting errors. One of the errors I am receiving is 'Invalid Sftp credential provided for 'SshPublicKey' authentication type.Invalid private key…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2025-11-18T17:13:54.4733333+00:00
Madhukar Muddasani 10 Reputation points
commented 2026-04-30T08:27:13.59+00:00
FlorisZ 26 Reputation points
2 answers

SftpFailedToConnectToSftpServer

I am having an issue with a client supplied SFTP account from within Data Factory, I am able to connect with the credentials via FileZilla locally, and with some C# code when deployed, but Data factory cannot create a valid connection to this AWS server.…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2025-04-15T16:26:17.8066667+00:00
Daniel Woodhouse 0 Reputation points
answered 2026-04-29T10:41:10.2633333+00:00
Senthil kumar 110 Reputation points
2 answers

The Validation Activity has a timeout of 13 hours, but i configured it to time out after 7 days in Blusehift Env.

The Validation Activity has a timeout of 13 hours, but i configured it to time out after 7 days in Blusehift Env.. this's my validation activity settings: {     "dataset": {         "referenceName": "DependencyPath_EU",     …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-14T08:24:18.4766667+00:00
Yang Bai 0 Reputation points Microsoft Employee
edited a comment 2026-04-29T05:38:57.18+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
1 answer

unable to see resources and pipelines

Hi Team, I want to see my old resources and all the azure data factories pipeline i created, but this time i am unable to see anything, suggest how to check those pipelines.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-28T15:09:01.5333333+00:00
Vishal7 Sinha 0 Reputation points
commented 2026-04-29T03:18:22.5133333+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
2 answers

I could not connect to ADF. it is asking me to pay-as-you-go. previously with *******@gmail.com

Hi, I could not connect to ADF. it is asking me to pay-as-you-go. previously with ****@gmail.com , connected with other user . How could I use free . It is showing my one subscription and all. Even I closed that subscription also. I can not open other…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-28T12:03:18.78+00:00
udaya P 0 Reputation points
edited the question 2026-04-29T03:04:22.11+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
1 answer

ADF pipeline succeeds but data is wrong - common patterns and how to catch them

Wanted to start a discussion around a category of ADF issues that I see repeatedly in production but rarely documented well. These are cases where the pipeline runs successfully with no errors, but the data loaded is incorrect. Examples include column…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-28T18:07:17.42+00:00
chandramouli kondamudi 0 Reputation points
commented 2026-04-28T19:32:06.28+00:00
Amira Bedhiafi 41,386 Reputation points MVP Volunteer Moderator
2 answers

ADF ARM Template validation issue

I am getting error while running : run: | # node ./adf/node_modules/@microsoft/azure-data-factory-utilities/lib/index validate ./adf ${{env.RESOURCEID_DEV}} "message":"undefined not found in linked-service-registery"

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-24T09:18:29.3766667+00:00
Anju K Joy 0 Reputation points
commented 2026-04-28T17:49:47.2566667+00:00
Pilladi Padma Sai Manisha 7,310 Reputation points Microsoft External Staff Moderator
2 answers

ADF delete activity failure because of storesettings

ADF delete activity fails with this error. It works fine in Debug mode, but fails in Trigger mode. We checked that the collaboration branch has the same changes as in adf_publish. So not sure why this fails. One observation is whenver we open the delete…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-22T15:11:34.9733333+00:00
commented 2026-04-28T17:33:41.3233333+00:00
Pilladi Padma Sai Manisha 7,310 Reputation points Microsoft External Staff Moderator
2 answers

Azure-SSIS IR (ssis-ir03) in ADF (adf-ssis-08) is stuck and cannot be stopped or deleted. Cannot delete ADF resource.

Azure-SSIS IR (ssis-ir03) in ADF (adf-ssis-08) is stuck and cannot be stopped or deleted. Cannot delete ADF resource. Initial error was: “Operation failed. Cannot find key vault” The dependent Key Vault had been soft-deleted, and I successfully…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-26T20:44:47.6366667+00:00
Lynn Tao Personal 0 Reputation points
answered 2026-04-27T01:26:22.7233333+00:00
SAI JAGADEESH KUDIPUDI 2,535 Reputation points Microsoft External Staff Moderator
1 answer

Data Factory - Copy Activity - Azure Blob Storage to Snowflake V2 - Extremely long queue times

Noticing this morning unusual queue times on copy activities in the second part of the staged copy from Azure to Snowflake (Azure Blob Storage to Snowflake V2). The first part of the copy activity (reading from API for instance) is fine but after it…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-24T14:52:27.5+00:00
answered 2026-04-24T17:25:32.6133333+00:00
2 answers One of the answers was accepted by the question author.

Parameterize MongoDB linked service Database Name in ADF

I have many databases in MongoDB (nearly 20). I need to create linked services for all of them in Azure Data Factory. After creating one, I found that linked services for MongoDB are not parameterized for database name. Is there any way to create a…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-24T06:29:28.07+00:00
Dhruv Singla 250 Reputation points
commented 2026-04-24T13:20:03.7266667+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
2 answers

Table lock whiile runing multiple UPDATE statements on the same Warehouse table.

I am using Microsoft Fabric Data Pipelines with a ForEach activity to run multiple UPDATE statements on the same Warehouse table. When multiple updates run at the same time, I get concurrency or locking errors. I tried reducing the batch count in the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-24T07:38:15.05+00:00
Abdul Ismail Shaik 0 Reputation points
answered 2026-04-24T09:33:57.3066667+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
2 answers

Azure data factory pagination rule cannot work for dataflow mapping but copy activity

Hi! I planned to move some data using Rest API and then do some transformation like join and cleaning. So instead of use move activity I prefer directly use mapping data flow to do pagination. my rest API setting is like this: Base URL: …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,145 questions
asked 2026-04-22T08:16:02.7233333+00:00
Alan Chen 0 Reputation points
commented 2026-04-23T17:43:04.5633333+00:00
Pilladi Padma Sai Manisha 7,310 Reputation points Microsoft External Staff Moderator