Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
0 answers
ADF unable to connect to the sql db
Hi, I just deployed via devops my ADF pipeline from uat to prod. The deployment went fine and now when i execute the prod ADF, it fails. The job is to read from a source into the sql db. It fails with the error "Cannot connect to SQL Database.…
Azure Data Factory
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 42%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
0 answers
Azure ADF copy activity - Copy file from local file system to ADLS
Hello, I am trying to copy a bunch of files from my local machine to ADLS2.0 using copy activity. Though this functionality works as expected, the original file timestamp from source (local file) is not retained. Post file copy, the timestamp is…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-15T21:32:43.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 70%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Raghavendra
0
Reputation points
commented 2025-05-15T23:25:45.61+00:00
Raghavendra
0
Reputation points
0 answers
Errors adding a day to a date in ADF script
I'm having an issue where I'm trying to add a day to a start date parameter, this is the script I used in the Script activity within ADF: @concat('SELECT DATEADD(dd, 1, CONVERT(DATETIME, ''',variables('v_POLLED_DT'), '''))') However I'm getting the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-15T18:59:44.0833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 84%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYH%3C/text%3E%3C/svg%3E)
Yi Han Wong
0
Reputation points
commented 2025-05-15T22:02:24.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
6,780
Reputation points Microsoft External Staff
Moderator
0 answers
Error details Error code 9054 Details Failed to connect to Integration Runtime or connection is broken unexpectedly.
Here are all the checks we perfomed and were successful. I cant get this to connect to anything but key vault Summary of Executed PowerShell Commands and Results Subnet Delegation…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-15T21:52:21.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 68%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chris Buchanan
0
Reputation points
asked 2025-05-15T21:52:21.2633333+00:00
Chris Buchanan
0
Reputation points
0 answers
Error details Error code 9054 Details Failed to connect to Integration Runtime or connection is broken unexpectedly.
Error details Error code9054 DetailsFailed to connect to Integration Runtime or connection is broken unexpectedly. Please retry the operation later. If the issue persists, please contact Microsoft support for further assistance. Activity ID:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-15T21:49:05.5733333+00:00
Chris Buchanan
0
Reputation points
asked 2025-05-15T21:49:05.5733333+00:00
Chris Buchanan
0
Reputation points
0 answers
How to trigger an Azure Data Factory pipeline through API using praameters
Hello All, I have a use case where I want to trigger an Azure Data Factory pipeline through API. Right now I am calling the API in Databricks and using Service Principal(token based) to connect to ADF from Databricks.The ADF pipeline has some parameters…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-15T12:06:06.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 99%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDA%3C/text%3E%3C/svg%3E)
Datta, Andolina
0
Reputation points
commented 2025-05-15T19:24:39.21+00:00
Datta, Andolina
0
Reputation points
0 answers
How to fix ADF Data Flow Performance Issue: Long Runtime on 28M Record Upsert?
We are running an Azure Data Factory Mapping Data Flow that processes approximately 28 million records from a SQL source and performs an upsert operation into a SQL sink based on a key column (DataMappingId). After previous failures due to tempdb quota…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-14T15:04:44.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 71%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENG%3C/text%3E%3C/svg%3E)
Narendra Gopi Uppalapati
0
Reputation points
commented 2025-05-15T15:52:20.5133333+00:00
Ganesh Gurram
6,780
Reputation points Microsoft External Staff
Moderator
1 answer
The ADF Databricks job Activity doesn't seem to pass parameters
I have created an ADF pipeline that uses the databricks job activity. The linked service works well. When I run the pipeline, the databricks job fails - the ADF component fails, and I see a failed job run in databricks too. The problem seems to be the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-14T12:15:22.5966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 41%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDH%3C/text%3E%3C/svg%3E)
Debie, Hanneke
5
Reputation points
edited a comment 2025-05-15T14:48:45.73+00:00
Debie, Hanneke
5
Reputation points
1 answer
One of the answers was accepted by the question author.
Is Action required on ADF?
Current Environment: Public Accessed SQL Database (PaaS) - No Private endpoints. Public Accessed Azure Data Factory with Selfhost agent- No Private endpoints. ADF Pipeline that connects and pushes data into SQL Database (PaaS). Required…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 37%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ2%3C/text%3E%3C/svg%3E)
2 answers
Integration runtimes are not auto-updating
Our Azure Data Factory integration runtimes are not auto-updating even though we have them set to auto-update. We checked the troubleshooting items listed, and none seem to apply. auto-update is turned on we are able to access the download center…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2024-09-04T22:21:08.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 47%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
JB
196
Reputation points
edited a comment 2025-05-15T12:38:28.8333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 0%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Swanger, Susan
20
Reputation points
0 answers
How to use Oracle Wallet with password on LS 2.0
Hi, i am using oracle wallet with password on ADF. Like this: Host=<host>;Port=<port>;Sid=<sid>;User …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-15T09:07:29.3966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 16%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJB%3C/text%3E%3C/svg%3E)
Jachym Bielesz (DHL Data & Analytics), external
0
Reputation points
commented 2025-05-15T11:37:02.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 99%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJN%3C/text%3E%3C/svg%3E)
J N S S Kasyap
2,125
Reputation points Microsoft External Staff
Moderator
0 answers
Failure happened on 'Source' side. Message=The semaphore timeout period has expired,Source=
Hi Team, I am getting this below error while ingesting data from SQL Server to ADLS.While the same pipeline is running in dev environment with much higher data volume(2x). Failure happened on 'Source' side.…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-13T13:19:04.2066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 2%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVK%3C/text%3E%3C/svg%3E)
Vanaja Kasturi
0
Reputation points
commented 2025-05-15T08:31:37.47+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
23,260
Reputation points Microsoft External Staff
Moderator
0 answers
[Azure Data Factory] cannot be evaluated because property 'RuntimeStatus' Cannot be selected. Property selection is not supported on values of type 'String'.
I have an error in running my Azure Data factory which saids here "cannot be evaluated because property 'RuntimeStatus' Cannot be selected. Property selection is not supported on values of type 'String'.", this pipeline didn't occur this year…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-14T00:55:24.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 13%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Abarquez, Daniel
0
Reputation points
commented 2025-05-15T08:31:01.04+00:00
Smaran Thoomu
23,260
Reputation points Microsoft External Staff
Moderator
1 answer
ADF Copy Activity is failed and getting an error AdlsGen2OperationFailed
Hi Team, I have successfully configured the linked service connection to ADLS in ADF, and the test connection was successful. However, when I attempt to copy data from the source database to ADLS, I encounter the following error. The issue is…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-09T05:33:20.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 16%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHG%3C/text%3E%3C/svg%3E)
Hari Guvvala
0
Reputation points
answered 2025-05-15T04:28:47.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
15,570
Reputation points Microsoft External Staff
Moderator
1 answer
Azure Key Vault secrets in pipeline activities of ADF
I need to fetch secret from keyvault and set in variable in data factory pipeline. I am using web activity and following step exactly as given in this link…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-13T07:59:49.4933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 35%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPJ%3C/text%3E%3C/svg%3E)
Pankaj Joshi
391
Reputation points
commented 2025-05-15T01:17:59.41+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 80%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKB%3C/text%3E%3C/svg%3E)
Krupal Bandari
180
Reputation points Microsoft External Staff
Moderator
1 answer
How to fix ClientIPNotAuthorized on ADF
How do I fix the ClientIDNotAuthorized error message? I am on VPN as well.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 24%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
How to download Salesforce object's attachments to Azure Blob
I want to use Azure Data Factory to download Salesforce object's attachments to Azure Blob Storage. How do I do this? Thanks
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2021-09-18T03:17:06.647+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 43%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENN%3C/text%3E%3C/svg%3E)
Nghia Nguyen
26
Reputation points
commented 2025-05-14T17:56:23.1166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 74%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Muskan
0
Reputation points
1 answer
How to ingest a binary file received via a rest api call in ADF
I have a sharepoint rest api that return a file in the binary format. It is uses step authentication: call the on auth 2 token url by passing the client and secret and get the access token Call the main url using the access token and receive the excel…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2024-02-29T14:28:59.66+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 66%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Narender Kumar
70
Reputation points
commented 2025-05-14T17:51:58.12+00:00
Muskan
0
Reputation points
0 answers
How to fix dataflow performance issue: 28M records Upsert?
We are using Azure Data Factory Mapping Data Flow to upsert around 28 million records into a SQL table using the key column DataMappingId. Previously, the data flow failed due to tempdb size limits. We have made the following improvements: Switched to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-05-14T15:33:42.1566667+00:00
Narendra Gopi Uppalapati
0
Reputation points
commented 2025-05-14T15:48:09.91+00:00
Narendra Gopi Uppalapati
0
Reputation points
2 answers
Problems connecting ADF to ServiceNow with large tables.
Good day to you all, We use ADF to retrieve many data from many systems. Also from SNOW (ServiceNow) we had this working and the end of November 2024. Now we encounter problems with the tables who are big. Like sn_customersrvice_case When I now try to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,503 questions
asked 2025-01-14T10:32:15.8533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMR%3C/text%3E%3C/svg%3E)
Marc Rijnders
10
Reputation points
commented 2025-05-14T15:39:16.02+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 87%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Smith, Darren (IT-LON)
0
Reputation points