Content
insert record from azure datafactory into a delta table generated in databricks
Hi team, i'm trying to insert value into a delta table from datafactory, the table has been created in databricks and in the table properties i setted "delta.enableChangeDataFeed=true", for this reason the protocol minWriterVersion of my delta…
Generated ADF pipelibe using Python
Hello, I am working on the dynamic data pipeline framework were i can generate Azure data pipeline programatically. till now, i have done for creating copy activiyt and dataflow. the final step is, need to link between this two by creating another…
Adding Azure Data Factory Managed Identity to Azure SQL DB Failes - Error Msg 33132
When trying to grant a Data Factory instance access to an Azure SQL DB I get the following error. "Msg 33132, Level 16, State 1, Line 1 This principal type is not supported in Azure SQL Database." Using this command - CREATE USER…
how to fix -Your account is under review
Hi , I am facing below message while login Azure free Account. Your account is under review Kindly help met to get solved. Thanks in advance.
Stored procedure with parameters not working in azure data factory
In my Azure Data Factory pipeline, I have an "if" activity. Within the "if" activity, I have a "stored procedure" activity that executes a delete statement and requires a parameter. In the ADF "stored procedure"…
Dataset works with pipeline but does not connect with dataflow
Hello, On azure data factory I created some datasets that work flawlessly on pipelines: The pipeline execution works as expected: And I get the data I need. But when I try to use that dataset in a dataflow I get a connection error: It says it could be…
ADF Ingestion
What different ways you can ingest the data using ADF and Synapse
How to connect to Azure PostgreSQL with AAD login, from ADF or Synapse pipeline?
Hello, I have a PostgreSQL (PG) database that exclusively permits Azure Active Directory (AAD) logins. I want to establish a linked service in Azure Synapse to import data from this database. If I obtain an authentication token from a user who belongs…

Data Flow using Temp File on SFTP by Default
I am creating a process that picks up a txt file based on "blob created" event trigger in ADF Data Flow. Once this txt file triggers, my data flow picks up the file translates and maps it to a CSV. On my sink I have it connected to an SFTP…

How to bring through text readable fields (for lookup/choice fields in dataverse) when copying data using the azure synapse link or azure data factory
I have two situations where I copy data from Dataverse into other storage locations: using azure synapse link to copy data from dataverse into azure data lake storage using azure data factory copy activity to copy data from dataverse into azure sql…

Azure Data Factory set variable add backslash before double quote.
In Azure Data Factory, I need to copy the output of a REST API, which is an array of nested JSONs, to a CSV file. I used a loop for the array and dynamic content for the copy activity's mapping. I have a Pipelines_Mappings variable, it contains a JSON…

ADF - Error at sink side - Rest API- Key Content-Type conflicts in AuthHeaders/AdditionalHeaders
Hello, I am getting error as below when I am trying to use the copy activity which as source as Json file from container and sink as Rest API. I have defined auth token in linked service . Content Type header is defined in additional headers in…
How to clone/copy Azure Data Factory to another tenant?
My organization is moving to another Azure tenant. We have an Azure Data Factory with 50 pipelines, 40 datasets, 15 linked services and 5 triggers configured in the current tenant that needs to be available in the new tenant. I know that moving Azure…
While copying multiple files in for each file, i am getting AzureStorageOperationFailedConcurrentWrite issue. Even though folder and files names are diffrent
Using look-up activity i am trying to read a file which contains the api data information(with folder structure) . Next I used for each activity to loop those records. In for each activity i have placed a copy activity to copy those files as per folder…
Unable to replace valid phone number
https://examregistration.microsoft.com/ I am unable to register the exam as it fails to update my valid number exists in USA "The Phone Number you provided is invalid, please provide a valid phone number and try again."
How to create single dataset for multiple azure data flows?
I have about 50 files that i need to transform using a Azure Data Flows. Is there a way i can create a single data set for multiple data flows? I want to avoid creating a dataset for every single file.
Error when using Window activity in Azure Data Factory Data Flow
Hi, I am currently attempting to use the window activity in a data flow to recreate partition over order by. What I want is for the activity to rank rows with the same RECID and DML_Action by their LastProcessedChange_DateTime value, with the most recent…
ADF -- Extract from SAP with RFC table option, filter on 2 or more columns
Hello Is there any way we can use multiple conditions on the RFC Table Option field of a copy activity? Something like this: Doing this on 1 column works. However having multiple conditions doesn't seem to work. I've seen that 'AND' operator or 'OR'…
can we bulk copy and migrate mysql database tables using azure data factory
i know we can bulk copy SQL database tables using for each in azure data factory, but can we do the same for mysql database tables?, if it is possible please suggest some solutions.
Azure Data Factory - Copy activity using REST connector - Unable to access response headers
Hi team, I use ADF pipeline comprising copy activity to pull data from a remote endpoint using REST connector and then place the data on the blob. I do not have a need to use the pagination feature available with REST connector as the response is not…