10,012 questions with Azure Data Factory tags

Sort by: Updated
3 answers

Setting Pane in Mapping Data FLow in Azure Data Factory

Hi Experts , Can anyone advise me why am getting 'Settings pane'/'Data Preview Pane 'for configuring activity in Mapping Data FLows in bottom right hand corner of the screen ?. It was ok yesterday but seems from today am getting this View . Can…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-02T06:54:42.487+00:00
n k 106 Reputation points
commented 2020-06-08T20:33:34.937+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
1 answer

AZURE SQL MI Error: Stale/aborted version cleanup was aborted for database id '10' due to database shutdown.

Hi, I am trying to restore SQL server .bak file to Azure SQL Managed Instance database through SSMS but getting an error Msg 22003, Level 16, State 1, Line 18 Stale/aborted version cleanup was aborted for database id '10' due to…

Azure SQL Database
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-05T18:47:16.897+00:00
HemantSudehely-0557 266 Reputation points
commented 2020-06-08T18:03:41.503+00:00
Navtej Singh Saini 4,221 Reputation points Microsoft Employee
0 answers

toString does not accept array types

Hi All, Dataflows which have been working in the production environment have now started failing due to this error (DF-FN-006 - toString does not accept array types) This seems to be a recent change and I have quite a lot Mapping Dataflows which…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-02T21:06:13.117+00:00
Rajneel Sharma 1 Reputation point
commented 2020-06-04T21:38:20.647+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Use single self hosted IR to source on-Prem sql database and target Azure VM sql server data server

I have required to perform Azure Data Factory Copy activity. My source is the On-Prem SQL server database and target sink activity to the Azure VM SQL server data server. I did try by creating 2 self-hosted IR(one for source and one for target) but…

Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,470 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-03T16:40:42.713+00:00
HemantSudehely-0557 266 Reputation points
accepted 2020-06-04T13:38:37.177+00:00
HemantSudehely-0557 266 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Data Factory extracting Activities from Dynamics 365

I have a ADF extracting 'activity' (activitypointer) from Dynamics 365 Online. The ADF runs for 60+ minutes and fails with the below error for the copy activity. The sink is a gen2 data lake. I have 'AutoResolveIntegrationRuntime' for this data factory.…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-03T15:08:45.177+00:00
Satya D 136 Reputation points
commented 2020-06-03T21:00:16.067+00:00
Satya D 136 Reputation points
1 answer

ADF extract data from an on-premises oracle database into azure SQL database in real time

We have lots of web application on-premises, and its database include: Oracle, SQL Server, MySQL and SAP HANA. For Oracle DB, is it possible that ADF can extract data in read time? When there is any update in Oracle database, ADF can SYNC these…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-02T02:02:42.407+00:00
Wenjian Feng 41 Reputation points
commented 2020-06-03T08:43:10.39+00:00
Wenjian Feng 41 Reputation points
1 answer

How to push data from Azure Data lake to remote file server (network file folder)

Hello Experts, I need your guidance on how to push files from Azure Data lake to remote file server(network file folder). Our requirement is to send files from Azure Data Lake Gen2 to Remote File Server( Network File Folder), once the data pushed…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-06-01T08:56:36.84+00:00
fbmsdn511 1 Reputation point
commented 2020-06-03T01:24:27.297+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Error on dynamic content at Set Variable Activity

When trying reading the output for a Web Actvity I get the following error message: {"code":"BadRequest","message":"ErrorCode=InvalidTemplate, ErrorMessage=The expression…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-05-29T17:17:22.803+00:00
Lawrence Borbón 21 Reputation points
commented 2020-06-01T16:32:45.913+00:00
Lawrence Borbón 21 Reputation points
1 answer

Unable to open the Author & Monitor page from my ADF subscription

I'm unable to open the Author & Monitor page from my ADF subscription. my Subscription id is ########-####-####-####-############ I've tried to use different browsers. I've enabled my cookies on my browser, but I continue to see a blank screen…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-05-27T20:17:00.183+00:00
Adnan Rahman 1 Reputation point
commented 2020-05-28T20:31:03.27+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
0 answers

Azure Data Factory - Copy activity from ADLS to Cosmos Mongo DB

Hi, While running an Azure Data factory pipeline which copies data from AZure ADLS Gen storage 1 location to Azure Cosmos Mongo DB, I am receiving the below exception. Request to please help with regards to resolution. Thanks, Guru EXCEPTION : …

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-05-22T16:04:01.897+00:00
Banaji, Gurumohan 1 Reputation point
commented 2020-05-28T05:53:49.447+00:00
Mike Ubezzi 2,776 Reputation points
1 answer

Copy Activity in Azure data factory do not copy multi line text in sql table maintaining the line breaks.

I am using copy data activity from CSV to SQL. In CSV I have a field with multiline string in csv for e.g. Refer attachment But when I run the pipeline in SQL I an seeing the data in a single line like 1 Eastlawn Alley 8528 Coolidge Trail 0133…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-05-04T07:12:21.883+00:00
Govinda Kumar 1 Reputation point
answered 2020-05-08T13:58:21.857+00:00
Vaibhav Chaudhari 38,676 Reputation points
1 answer

Summary of pipelines

I want to document all the details of a particular pipeline in my ADF. Ex: which linked services are being used in my parent pipeline and child pipeline or which datasets are being used. Is there any option to summarize these details in Azure portal?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,012 questions
asked 2020-02-11T16:40:05.99+00:00
Manideep Unnamadala 1 Reputation point
answered 2020-02-11T22:30:04.157+00:00
Marilee Turscak-MSFT 36,061 Reputation points Microsoft Employee