Content
Data Factory: turn on data flow debug error
Hello! I need the "Data Preview" for checking, and it require me to turn on "Data flow debug". However, error received and no ErrorCode. I can't do anything. Data flow debug Failed to setup debug session. Error: An error…
Long running Databricks notebook but cumulative processing time is short
Hi Microsoft experts, I have a long running Databricks notebook tonight, and I can't see a reason why. My Data Factory pipeline which calls the notebook has been running reliably everyday for about 8 months, but this week it has had some problems and now…


How the pass a session ID for a SOAP API in ADF
Hi all, Struggling for a while now with creating an API request in ADF to load data from a SOAP API. I'm having difficulties with passing a session ID to another API request which will provide the transactional data. step 1: API request (OpenSession)…


Merging 2 Array variables
Hello All. I might be missing some simple aspect here but wanted to confirm : Is there any way in ADF to merge 2 Array variables without the use of any iteration activity. Like ask is as below: Input1= [1,2,3] Input2=[1,4,5] Output=[1,2,3,1,4,5] Note:…


change column name in delta parquet file
hello, data fatory data flow is being used to upsert into delta parquet files. The delta parquet files have several columns. How is it possible to change the name of a column without affecting the data using the delta sink in the data flow? for…
Your account or password is incorrect. If you don't remember your password, reset it now.
Hello! When I try to enter incorrect password, I give this error: Your account or password is incorrect. If you don't remember your password, reset it now.also when I try to click on reset now, I give this message: Verify your identity How would you like…


Change Data Capture in Azure Data factory High level resources does not ask for DelimitedText value, instead it takes comma(,) by default
Hi I am trying to implement CDC High Level Resources through Blob to SQL DB. But my mapping was incorrect as my source is delimited by "|", due to which I am unable to implement. Can we look into this? on how to change default comma(,) to…


Can we convert R script to M code (Power Query)
As we are having few scripts in R which we are consuming in another scope, as per the new scope that needs be migrated to M (Power Query). If so, are there any best practices to migrate existing scripts to M code. Do we have any tools that can be used…


ADF copy data to cosmosdb producing errors
I created a copydata pipline in azure data factory to move data from a blob to cosmos mongo api database. All necessary dataset connections connected successfully .But while i debug or execute i get the errors below relating to the sink. Is there a way…


pivot hour to minutes workflow
I need to pivot each row in a table as follows. From: To: Each hour of the day represented from h1 to h24 listing total minutes worked minus break. What would be the best workflow for this process?


Where is the storage account key for cosmos db
I have a copy data pipeline which loads data from a json file within a blob to a cosmos DB collection. Now the sink is the cosmos dB connection . At creation time account selection method is Azure subscription , subscription is selected and then Azure…


Airtable API Patch Request Fails in ADF
I'm trying to update data in Airtable using Rest API in ADF. I get an error. I'm trying to execute a PATCH. Here's my mapping. Example request from Airtable API documentation: Why is this not working? Error Message: Response:…


Upsert to Azure SQL Database Failed because Interim Table Exists
I have created a Copy Activity on Azure Data Factory that moves the data from a CSV file hosted on Data Lake to Azure SQL Database. When I select the write behavior to be INSERT, the pipeline runs fine. But when I changed to UPSERT and provide the proper…
How to update data into Azure storage table from datafactory?
1) Can i use storage table for capture log details of pipeline via datafactory. will it allow insert new values in table? 2) I want to update specific column in storage table. how do i update the column which activity I should use? like I want to…


Error to set lookup field in N:1 relationship while writing data to Dynamics CRM from Azure Data Factory
While trying to sync data from sql staging table to Account entity in CRM, I faced an issue in populating the multi-lookup column. The input column is Manager Name that is of string data type. The destination field is dfws_sareportingmanager (GUID data…


Azure Storage explorer stuck on Loading.. any suggestion
i am facing this problem on my intel arc gaming pc running on windows 11 rightnow. when i Try to connect to blob storage in Azure Storage Emulator its stuck on Loading.. Was working last week before I did a windows update and storage explorer update. I…


Problem with ADF Dataflow pipeline when writing data to SQL Server
I have an ADF Dataflow pipeline that reads data from a data lake and writes it to a SQL Server table. I have a problematic column called "gdtxft" that I converted from binary to string using the 'toString' function in the Derived column…


Does Interactive authoring of the integration runtime have to be activated manually?
Hello! I just wanted to know if there's a way to automate the enabling of the interactive authoring of the AutoResolveIntegrationRuntime. Thanks!


How to convert data row into valid json in ADF Dataflow
I have data in tabular format. As part of dataflow transformation want add another derived column like below. Basically converting column data into valid Json string


Very Old System: Failed to load SOAP Service definition file.
defunct quetion, posted it before editing, will do another to fix it

