branch movement
How can we move branch from 1 repo to another repo... from an example Branch1 move to devrepo-- UATRepo Branch1 Please share screenshot...to move it manually without codings
Azure Data Factory Question
Azure Data Factory Question Hi, I want to extract data from an API, and I'm confused about which activity in ADF I should use. Should I go with COPY or WEB activity? Can anyone please help?
Azure Container App internet outages
Hi everyone! I'm struggling with a problem and could use some advice. I have a Python application that acts as a typical data sink, listening to data from a websocket provided by an exchange. The program runs in Docker, with the image stored in Azure…
Azure Data Factory SFTP Linked Service: Failed to read binary packet data! (ProtocolError)
Hi everyone, I'm facing a problem with a SFTP server, where some restrictions are applied to avoid the usage of RSA Keys with SHA1 signature. I can connect without any problem to the SFTP server using WinSCP. There are no network restrictions so I can…
How to Set Proper Time in Azure Data Factory Trigger (numbers are not viewable properly)?
Hi Team, When I trying to schedule a trigger. It seems there is issue.. The time is not properly visible. If you observe in below visual, its says 5. 5. 5... this is not clear. Is the bug or existing issue? Or i am missing something?
Microsoft Fabric Data Factory - MS Graph API - Groups/Users - Unable to reference response paging attribute
I am trying to get all groups and users from MS Graph. These both use paging (limit 100 records per page). To get the next page I need to reference an attribute in the previous repsonse. However, the attribute has '@' and '.' in it... how do I reference…
Azure Data Factory : How to set the bucket region of an Amazon S3 Compatible data source
Hi there, I'm trying to connect my Supabase storage, an Amazon S3 compatible storage to my Azure Data Factory for a copy flow. I'm able to connect to it with tools like Cyberduck, but it does not work with ADF. I guess the 403 error is related to the…
ADF Data Flow Mapping shows 0 rows written to Dataverse sink
Running a simple set of pipelines with data flow mappings to Dataverse sinks. Data flow runs successfully, but Rows Written through interface consistently shows 0 rows. I can see the rows were written by going to the table in Dataverse.
Facing error while posting data to api using web activity
Post is working fine in postman but getting below error in synapse web activity Error calling the endpoint. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the…
Convert to tab file
Hi am running activity and converting table from SQL server to .tab file but it contains 20 lacs records how can I convert this in a minute. Pls share screenshot
No code found for {source} ~> {derivedColumn}
Hi, I created a flowlet in ADF which reads various sources and does appropriate transformations. This flowlet is called from a data flow and when previewing data, I get the error "No code found for stream DataFile ~> derivedColumn1". The…
Shutdown hooks cannot be modified during shutdown
What does the ADF pipeline error message mean? 'Shutdown hooks cannot be modified during shutdown'.
Main Repo in ADF
How to set up main repo between Dev and Accptance envionment in ADF. Genrally it should be same repo or diffrerent ...please share screenshot any
Azure Data Factory: Copy from Blob to Blob Container with Hierarchical Namespace Fails with 409 Conflict
I am trying to copy data from one storage account to another. I have a pipeline with an activity that copies data from source storage account to sink. The pipeline runs successfully and I can see data has been copied. But, as soon as I try to copy the…
gnupg decrypting some files from an external sftp
Is it posible to decrypt some file than lands in an external sftp using ADF? Thanks
ADF Snowflake New Connector Issues with KeyPair Authentication and Private Link
We are using Azure Data Factory (ADF) to connect to Snowflake with a Self-hosted Integration Runtime configured for Private Link. Recently, we migrated the Snowflake connector to the latest version that supports Key Pair authentication. Currently, Basic…
No code found for stream [nameofstream1] ~> [nameofstream2]
Hello I'm doing a preview on a data flow that is calling a flowlet. There is no validation error on the flowlet and all the modules display correctly but when I try preview I get the above error. Does anyone know what it could be?
SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?
Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik
Configuration for Transferring JSON from Azure Cosmos DB to Snowflake Using Azure Data Factory
We need to transfer an entire JSON object from Azure Cosmos DB to a Snowflake table. We have created a table in Snowflake with a single column named emp_details of type VARIANT to store the JSON data. How can we configure the mapping in Azure Data…
Time Zone Parameter Ignored in Azure Data Factory PostgreSQL Connector After Migration
I'm experiencing an issue with Azure Data Factory (ADF) when using the PostgreSQL connector. Problem: The "Time Zone" parameter in the Linked Service appears to be ignored, and timestamps are always retrieved in UTC, despite attempts to set…