Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
1 answer
ADF Copy Activity Generating negative acknowledgements on SFTP Server while execution.
The Copy Activity in Azure Data Factory (ADF) is configured to copy files from SFTP Server. This copy activity is triggering a negative acknowledgement (NACK) first on the SFTP server while downloading the files and after a few seconds file copy is…
Azure Data Factory
asked 2025-07-04T05:22:21.0766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 76%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Shashank Thogaru
0
Reputation points
commented 2025-07-04T14:45:00.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 50%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
1 answer
Key-pair Authenication snowflake authenication using linked Service
Please I need assistance with resolve the error message i got while connection to snowflake using Key-Pair Authentication. I followed the procedure outlined in both snowflake and Azure Data factory. I'm still getting the same error message see…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-03T12:26:22.5633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 69%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EOO%3C/text%3E%3C/svg%3E)
Owhondah Ogundu Raymond
0
Reputation points
commented 2025-07-04T14:17:45.9833333+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
0 answers
Can't get Data Factory to recognize string as Time Stamp
I keep getting the following error when trying to upload data from a csv file to a database: "Operation on target Copy_SR_to_THER47 failed: ErrorCode=TypeConversionFailure,Exception occurred when converting value '2023-01-25 04:51:07' for column…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-03T15:01:12.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 46%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AE90
20
Reputation points
commented 2025-07-04T13:43:55.4933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
24,260
Reputation points Microsoft External Staff
Moderator
1 answer
How to Report File Metadata for 2000+ Files Uploaded by Multiple Users to Azure Blob Storage
Hi Team, I would like to know following questions. Please do needful. 1.How to Report File Metadata for 2000+ Files Uploaded by Multiple Users to Azure Blob Storage 2.How to connect Hadoop hive to databricks Regards, Prasad, 5017654887.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-03T02:41:39.2233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 57.99999999999999%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPS%3C/text%3E%3C/svg%3E)
Prasad Sandu
0
Reputation points
commented 2025-07-04T13:30:11.3066667+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
1 answer
How does Azure Data Factory handle data movement ?
How does Azure Data Factory handle data movement and transformation across hybrid environments, and what are the best practices for optimizing pipeline performance and cost efficiency
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-02T22:05:28.1966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 59%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHS%3C/text%3E%3C/svg%3E)
Himanshu Sinha
11
Reputation points
commented 2025-07-04T13:21:52.3633333+00:00
Smaran Thoomu
24,260
Reputation points Microsoft External Staff
Moderator
3 answers
How to iterate through Nested folders and read file after the file in adf
Hi, How can I iterate through folder and inside subfolder by folder and process one file after another without using regex in azure data factory
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-02T13:02:06.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 45%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERJ%3C/text%3E%3C/svg%3E)
Radha Jahnavi Pusarapu
0
Reputation points
commented 2025-07-04T12:00:48.7433333+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
1 answer
Seeking solution for intermittent "SqlFailedToConnect" errors when writing to Azure SQL Managed Instance from Azure Data Factory
I have multiple ADF pipelines that copy data from a variety of sources into our Azure SQL Managed Instance. All of these jobs, regardless of source, fail intermittently with a Sink error such…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-02T18:12:10.1166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 47%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERL%3C/text%3E%3C/svg%3E)
Rob Lamb
0
Reputation points
commented 2025-07-04T11:51:21.78+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
3 answers
ADF copy activity loading 2 different files into same variant table
so when am loading data from azure blob to snowflake variable table, its copying the content of 2 files into one variant table i.e. students 2 files in blob - sql.students, sql.subjects 2 variant table in snowflake - stage.sql_students_variant &…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-03T11:01:27.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 77%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azure_learner
45
Reputation points
answered 2025-07-04T10:09:57.26+00:00
Amira Bedhiafi
33,631
Reputation points
Volunteer Moderator
0 answers
Recommended approach to update reconciliation log tables during DB2-to-Azure SQL Hyperscale migration using ADF + Databricks
We are migrating data from IBM DB2 to Azure SQL Hyperscale using a combination of Azure Data Factory (ADF) and Azure Databricks. As part of our reconciliation framework, we calculate row counts and hash values within Databricks after each major stage…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-04T08:12:46.2533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 56.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJC%3C/text%3E%3C/svg%3E)
Janice Chi
160
Reputation points
commented 2025-07-04T09:52:10.8066667+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
2 answers
Error while running data factory pipeline in fabric
Hi Team, I am getting below error while executing data pipeline in fabric. Can you please help me on this how to resolve it. Failed to get User Auth access token. The error message is: Failed to get User Auth access token. The error message is:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-03T14:28:23.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 9%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Sharad Gawade
20
Reputation points
answered 2025-07-04T05:01:13.3466667+00:00
Nandan Hegde
36,151
Reputation points MVP
Volunteer Moderator
2 answers
Error: 11402 -The value of the property '' is invalid: 'The remote name could not be resolved:
I am setting up a Linked service for ODATA in ADF, for IntegrationRuntime I am selecting "AutoResolveIntegrationRuntime" but connection to ODATA resource is failing: The value of the property '' is invalid: 'The remote name could not be…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2024-05-08T05:48:44.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 3%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBA%3C/text%3E%3C/svg%3E)
Bhat, Asif
20
Reputation points
answered 2025-07-03T18:14:19.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 45%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBC%3C/text%3E%3C/svg%3E)
Bharath Chandran
0
Reputation points
1 answer
data extraction issues since upgrading to Odata 4.0 in ADF
Our data extraction process, using the Odata connector in ADF has shown problems since our client upgraded their service to Odata 4.0. The issues consist of not succesfully extracting an endpoint. Our client shows that their network gets overloaded even…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-01T09:34:47.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 21%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETB%3C/text%3E%3C/svg%3E)
Thijs Bakker
0
Reputation points
commented 2025-07-03T11:50:11.5366667+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
dataset showing warning even after updating linked service version from 1 to 2
ADF dataset showing warning even after updating linked service version from 1 to 2 also tried to refresh the page tried to reopen the ADF ports but still the same warning also the test connection is successful in linked service after updating…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-06-05T07:38:46.85+00:00
azure_learner
45
Reputation points
accepted 2025-07-03T10:50:52.7433333+00:00
azure_learner
45
Reputation points
1 answer
ServiceNow Incident table extraction with V2 Connectors
Using the new ServiceNowV2 connectors in Azure Data Factory, we are trying to extract the incident table. When setting up a copy activity, we receive the error message below. I have tried to limit the number of records by providing a filter to small…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-01T06:53:26.65+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 13%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJS%3C/text%3E%3C/svg%3E)
Joshoua Simon
0
Reputation points
commented 2025-07-03T10:16:27.89+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator
4 answers
How to configure ADF pipeline run, linked service, so it uses Databricks serverless compute
Databricks has recently announced serverless compute for workflows: https://learn.microsoft.com/en-us/azure/databricks/workflows/jobs/run-serverless-jobs I would like to be able to execute Azure Data Factory (ADF) jobs using this…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,527 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2024-05-01T12:12:06.9033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 31%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKP%3C/text%3E%3C/svg%3E)
Krzysztof Przysowa
20
Reputation points
answered 2025-07-03T09:06:41.83+00:00
Krzysztof Przysowa
20
Reputation points
1 answer
One of the answers was accepted by the question author.
dataset is using 'AzureFileStorage' linked service type,which is not supported in dataflow. How to resolve this issue?
dataset is using 'AzureFileStorage' linked service type,which is not supported in dataflow. How to resolve this issue?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-02T06:02:32.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 2%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETA%3C/text%3E%3C/svg%3E)
Tom Abraham
20
Reputation points
commented 2025-07-02T12:43:07.2733333+00:00
Tom Abraham
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Can I use a KeyVault Connection String with the Azure Data Factory Mysql Linked Service Driver v2.0?
Hi all, I currently use a V1.0 MySQL linked services as part of my Azure Data Factory setup. I use a secret connection string stored in Azure Key Vault. I am being asked to upgrade the linked service driver to 2.0, but it seems this does not support the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-07-02T08:34:26.1233333+00:00
Peter Rush
61
Reputation points
accepted 2025-07-02T10:39:36.35+00:00
Peter Rush
61
Reputation points
1 answer
One of the answers was accepted by the question author.
Conditional Split in ADF Data Flow issue - no rows in sink
I have a Conditional Split transformation that works fine except one sink results empty although there are source rows matching the split condition. In my scenario I have - say - 4 conditions, two of which are supposed to end up in the same table sink.…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-06-26T14:28:01.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 50%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EUP%3C/text%3E%3C/svg%3E)
Ulrike Pick
20
Reputation points
accepted 2025-07-02T09:36:51.0866667+00:00
Ulrike Pick
20
Reputation points
1 answer
Azure Data Factory: No 'Name' Key Appearing Under Additional Headers For REST APIs Data Copy Action
Hello, I'm trying to bring in data to SQL Server using a REST API. I've successfully completed the first stage, where I needed to call the Login endpoint to fetch the apiToken in order to request all other endpoints using the bearer authentication. I'm…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-06-24T17:19:53.7366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 54%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
sk900
0
Reputation points
commented 2025-07-02T08:35:53.86+00:00
Smaran Thoomu
24,260
Reputation points Microsoft External Staff
Moderator
1 answer
Failure happened on 'Source' side. Copy activity Error in Fabric
Failure happened on 'Source' side. ErrorCode=UserErrorWriteFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
asked 2025-06-27T00:32:51.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 93%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Sri Ram Katta
0
Reputation points
commented 2025-07-01T16:29:24.6466667+00:00
Venkat Reddy Navari
3,465
Reputation points Microsoft External Staff
Moderator