Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,740 questions
0 answers
branch movement
How can we move branch from 1 repo to another repo... from an example Branch1 move to devrepo-- UATRepo Branch1 Please share screenshot...to move it manually without codings
0 answers
Azure Data Factory Question
Azure Data Factory Question Hi, I want to extract data from an API, and I'm confused about which activity in ADF I should use. Should I go with COPY or WEB activity? Can anyone please help?
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,031 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,740 questions
asked 2024-10-19T13:54:52.2833333+00:00
Ayaan Shaikh
0
Reputation points
asked 2024-10-19T13:54:52.2833333+00:00
Ayaan Shaikh
0
Reputation points
1 answer
Azure Container App internet outages
Hi everyone! I'm struggling with a problem and could use some advice. I have a Python application that acts as a typical data sink, listening to data from a websocket provided by an exchange. The program runs in Docker, with the image stored in Azure…
asked 2024-10-18T23:12:34.4366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 4%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDL%3C/text%3E%3C/svg%3E)
Daniel Lasota
0
Reputation points
answered 2024-10-19T11:17:15.28+00:00
Vinodh247
21,881
Reputation points
1 answer
Azure Data Factory SFTP Linked Service: Failed to read binary packet data! (ProtocolError)
Hi everyone, I'm facing a problem with a SFTP server, where some restrictions are applied to avoid the usage of RSA Keys with SHA1 signature. I can connect without any problem to the SFTP server using WinSCP. There are no network restrictions so I can…
.NET
.NET
Microsoft Technologies based on the .NET software framework.
3,877 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,740 questions
asked 2024-06-17T09:23:48.5933333+00:00
Paul Hernandez
666
Reputation points Microsoft Employee
commented 2024-10-19T10:41:52.88+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 40%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Ashwin Antony
0
Reputation points
2 answers
One of the answers was accepted by the question author.
How to Set Proper Time in Azure Data Factory Trigger (numbers are not viewable properly)?
Hi Team, When I trying to schedule a trigger. It seems there is issue.. The time is not properly visible. If you observe in below visual, its says 5. 5. 5... this is not clear. Is the bug or existing issue? Or i am missing something?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 51%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESJ%3C/text%3E%3C/svg%3E)
1 answer
Microsoft Fabric Data Factory - MS Graph API - Groups/Users - Unable to reference response paging attribute
I am trying to get all groups and users from MS Graph. These both use paging (limit 100 records per page). To get the next page I need to reference an attribute in the previous repsonse. However, the attribute has '@' and '.' in it... how do I reference…
asked 2024-10-18T14:59:57.8433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 27%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELL%3C/text%3E%3C/svg%3E)
Laron Lemon
0
Reputation points
answered 2024-10-18T20:43:35.7166667+00:00
Amira Bedhiafi
25,261
Reputation points
1 answer
Azure Data Factory : How to set the bucket region of an Amazon S3 Compatible data source
Hi there, I'm trying to connect my Supabase storage, an Amazon S3 compatible storage to my Azure Data Factory for a copy flow. I'm able to connect to it with tools like Cyberduck, but it does not work with ADF. I guess the 403 error is related to the…
asked 2024-10-18T10:00:18.4833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 94%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAL%3C/text%3E%3C/svg%3E)
Aurélien L
0
Reputation points
answered 2024-10-18T20:38:28.0633333+00:00
Amira Bedhiafi
25,261
Reputation points
1 answer
ADF Data Flow Mapping shows 0 rows written to Dataverse sink
Running a simple set of pipelines with data flow mappings to Dataverse sinks. Data flow runs successfully, but Rows Written through interface consistently shows 0 rows. I can see the rows were written by going to the table in Dataverse.
asked 2024-09-26T16:19:01.5633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 12%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENG%3C/text%3E%3C/svg%3E)
Noah Gilbert
26
Reputation points
commented 2024-10-18T20:27:58.07+00:00
Noah Gilbert
26
Reputation points
1 answer
Facing error while posting data to api using web activity
Post is working fine in postman but getting below error in synapse web activity Error calling the endpoint. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the…
asked 2023-04-12T15:24:31.5333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELN%3C/text%3E%3C/svg%3E)
Lakshmi Niharika Paladugu
15
Reputation points
commented 2024-10-18T19:30:43.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 13%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPS%3C/text%3E%3C/svg%3E)
Patel, Siddhartha
0
Reputation points
1 answer
Convert to tab file
Hi am running activity and converting table from SQL server to .tab file but it contains 20 lacs records how can I convert this in a minute. Pls share screenshot
asked 2024-10-18T09:36:27.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Vineet S
950
Reputation points
edited an answer 2024-10-18T19:22:06.3333333+00:00
Amira Bedhiafi
25,261
Reputation points
1 answer
No code found for {source} ~> {derivedColumn}
Hi, I created a flowlet in ADF which reads various sources and does appropriate transformations. This flowlet is called from a data flow and when previewing data, I get the error "No code found for stream DataFile ~> derivedColumn1". The…
asked 2024-10-18T13:07:57.0133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 66%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBN%3C/text%3E%3C/svg%3E)
Bansal, Nimish
0
Reputation points
answered 2024-10-18T19:15:06.69+00:00
Amira Bedhiafi
25,261
Reputation points
1 answer
Shutdown hooks cannot be modified during shutdown
What does the ADF pipeline error message mean? 'Shutdown hooks cannot be modified during shutdown'.
asked 2024-10-18T16:34:23.73+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 70%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAW%3C/text%3E%3C/svg%3E)
Alan Waddington
0
Reputation points
answered 2024-10-18T18:49:28.5433333+00:00
Amira Bedhiafi
25,261
Reputation points
1 answer
Main Repo in ADF
How to set up main repo between Dev and Accptance envionment in ADF. Genrally it should be same repo or diffrerent ...please share screenshot any
asked 2024-10-16T18:03:42.5633333+00:00
Vineet S
950
Reputation points
commented 2024-10-18T18:09:18.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
2,200
Reputation points Microsoft Vendor
0 answers
Azure Data Factory: Copy from Blob to Blob Container with Hierarchical Namespace Fails with 409 Conflict
I am trying to copy data from one storage account to another. I have a pipeline with an activity that copies data from source storage account to sink. The pipeline runs successfully and I can see data has been copied. But, as soon as I try to copy the…
asked 2024-10-17T21:22:59.98+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 20%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENY%3C/text%3E%3C/svg%3E)
Noman Yaqub
0
Reputation points
commented 2024-10-18T17:56:06.1566667+00:00
Chandra Boorla
2,200
Reputation points Microsoft Vendor
1 answer
gnupg decrypting some files from an external sftp
Is it posible to decrypt some file than lands in an external sftp using ADF? Thanks
asked 2024-10-17T15:51:13.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJZ%3C/text%3E%3C/svg%3E)
Jon Z
100
Reputation points
commented 2024-10-18T17:54:10.2666667+00:00
Chandra Boorla
2,200
Reputation points Microsoft Vendor
0 answers
ADF Snowflake New Connector Issues with KeyPair Authentication and Private Link
We are using Azure Data Factory (ADF) to connect to Snowflake with a Self-hosted Integration Runtime configured for Private Link. Recently, we migrated the Snowflake connector to the latest version that supports Key Pair authentication. Currently, Basic…
asked 2024-10-18T09:55:11.7766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 92%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDV%3C/text%3E%3C/svg%3E)
Datta, Vinay
0
Reputation points
commented 2024-10-18T15:54:18.6066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
16,230
Reputation points Microsoft Vendor
2 answers
No code found for stream [nameofstream1] ~> [nameofstream2]
Hello I'm doing a preview on a data flow that is calling a flowlet. There is no validation error on the flowlet and all the modules display correctly but when I try preview I get the above error. Does anyone know what it could be?
asked 2024-10-09T07:00:38.5666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 3%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
V
0
Reputation points
commented 2024-10-18T15:23:21.9466667+00:00
Smaran Thoomu
16,230
Reputation points Microsoft Vendor
6 answers
SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?
Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik
asked 2024-04-23T11:45:42.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 52%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETZ%3C/text%3E%3C/svg%3E)
Tarik Zaaboul
5
Reputation points
commented 2024-10-18T15:11:01.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 44%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECG%3C/text%3E%3C/svg%3E)
Christopher Grancher
0
Reputation points
0 answers
Configuration for Transferring JSON from Azure Cosmos DB to Snowflake Using Azure Data Factory
We need to transfer an entire JSON object from Azure Cosmos DB to a Snowflake table. We have created a table in Snowflake with a single column named emp_details of type VARIANT to store the JSON data. How can we configure the mapping in Azure Data…
asked 2024-10-15T09:40:05.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 91%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sowndar Kumaresan
0
Reputation points
commented 2024-10-18T10:54:05.7666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
10,740
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Time Zone Parameter Ignored in Azure Data Factory PostgreSQL Connector After Migration
I'm experiencing an issue with Azure Data Factory (ADF) when using the PostgreSQL connector. Problem: The "Time Zone" parameter in the Linked Service appears to be ignored, and timestamps are always retrieved in UTC, despite attempts to set…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 55.00000000000001%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EI%3C/text%3E%3C/svg%3E)