Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,657 questions
1 answer
Prompt Funds Customer's service number..8340353818..call
Did you you have know have have you know how much as you know how much as
asked 2024-10-02T07:10:39.7033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 9%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYU%3C/text%3E%3C/svg%3E)
Ydyxudyd ufufjcuc
0
Reputation points
answered 2024-10-02T07:10:50.3866667+00:00
Ydyxudyd ufufjcuc
0
Reputation points
1 answer
One of the answers was accepted by the question author.
When to use deployment jobs vs. normal jobs in Azure Pipelines for Bicep deployments?
As a data engineer working on infrastructure-as-code using Bicep, I'm trying to understand the best practices for structuring my Azure Pipeline. I have separate environments for DEV and PRD, and I'm not sure when to use a deployment job versus a normal…
asked 2024-09-26T14:37:01.7233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 86%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Melvin Tran
20
Reputation points
accepted 2024-10-02T07:04:17.2733333+00:00
Melvin Tran
20
Reputation points
0 answers
Cannot connect to SQL Database. Please contact SQL server team for further support.
Hello support from time to time i get an error that username/password is invalid for database. However database is up and running and in use. below are the infromation activityid 701ef079-7056-4d6b-b941-c2e2f011e57a
asked 2024-10-01T08:13:02.49+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 83%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENZ%3C/text%3E%3C/svg%3E)
Ninoslav Zekic
10
Reputation points
commented 2024-10-02T02:07:35.69+00:00
LiHongMSFT-4306
27,016
Reputation points
1 answer
Salesforce connector : I am getting TaskCanceledException error while doing full load for Service__c and Service_Step__c entity.
Hello, We have recently transitioned to the Salesforce Bulk API 2.0 Connector in Azure Data Factory (ADF) for our integration processes. As part of our use case, we perform a full data load for all Salesforce entities once a month. However, we are…
asked 2024-10-01T07:32:09.8266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 0%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDU%3C/text%3E%3C/svg%3E)
Dhaval Uday Shah
0
Reputation points
commented 2024-10-01T22:18:03.5+00:00
Dhaval Uday Shah
0
Reputation points
1 answer
How to set ADF linked services and triggers parameterized for respective environment when we create pull request
How to Set ADF linked services and triggers parameterized for respective environment when we create pull request like dev-parameter.json
asked 2024-10-01T11:22:51.0433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 38%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMR%3C/text%3E%3C/svg%3E)
Madhu Ram
0
Reputation points
commented 2024-10-01T20:24:58.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
1,575
Reputation points Microsoft Vendor
1 answer
Can we extract data from SAP S/4HANA using extractors (not CDS views) with CDC capabilities in the same way as we are doing for SAP ECC?
Our client is using Azure Data Factory (ADF) to extract data with CDC capabilities from SAP ECC, utilizing extractors to load data into Azure Data Lake Storage (ADLS Gen2). Now, they are planning a Brownfield conversion from SAP ECC to SAP…
asked 2024-10-01T08:20:24.3833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 71%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDS%3C/text%3E%3C/svg%3E)
Devendra Singh Rathore
0
Reputation points
commented 2024-10-01T20:23:27.3166667+00:00
Chandra Boorla
1,575
Reputation points Microsoft Vendor
2 answers
What does ADF SSIS Error "Disk Full Exception Caught" mean
Hi, we are running an Azure-SSIS Type Integration Runtime in Azure Data Factory. This morning this IR suddenly got Unavailable for some reason. Fortunately we hat the Diagnostic Settings ADFSSISIntegrationRuntimeLogs enabled and I found the following…
asked 2024-09-25T10:26:26.61+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 89%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Cedric Ahlers
35
Reputation points
commented 2024-10-01T19:12:02.81+00:00
Chandra Boorla
1,575
Reputation points Microsoft Vendor
1 answer
Need to install Self Hosted Integration Run time
Hello Team, I want to install the Self hosted Integration run time. Please let me know the link so that i can download and install in the server. Regard Rohit
asked 2024-09-30T17:26:55.08+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
691
Reputation points
commented 2024-10-01T18:06:12.4766667+00:00
Chandra Boorla
1,575
Reputation points Microsoft Vendor
0 answers
New BigQuery connector CopyData error when there's no data
I am trying to replace the Google BigQuery connector for the newer one before the deprecation. But the new Google BigQuery connector seems to make the "Copy Data" task fail when the source is a Query and there's no data returned from it. This…
asked 2024-09-27T17:04:22.26+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 91%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFT%3C/text%3E%3C/svg%3E)
Fredy Treboux
0
Reputation points
commented 2024-10-01T16:46:15.9933333+00:00
Fredy Treboux
0
Reputation points
0 answers
Azure Data Factory ServiceNow Connector Copy Activity Dynamic Date Filter Query Builder
Hello all, We recently received a notice to update our legacy ServiceNow connection driver and while updating our copy pipeline activities, I am struggling to add a filter on a date column. In the legacy connection driver, we were able to use a query…
asked 2024-10-01T16:38:41.4566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 24%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDG%3C/text%3E%3C/svg%3E)
David Gonzalez
0
Reputation points
asked 2024-10-01T16:38:41.4566667+00:00
David Gonzalez
0
Reputation points
2 answers
Switch from Legacy BigQuery to new BigQuery Linked Service
I have a BigQuery routine that takes start date and end date as input parameter and both input parameter is declared of type String in routine. This routine is working fine without errors. I want to invoke the BigQuery routine from Azure Data Factory.…
asked 2024-09-24T10:13:48.1233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 87%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
ShilpaGopal
100
Reputation points
answered 2024-10-01T16:07:39.35+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 23%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK%3C/text%3E%3C/svg%3E)
keller2812
0
Reputation points
1 answer
ADF Data Flow Mapping shows 0 rows written to Dataverse sink
Running a simple set of pipelines with data flow mappings to Dataverse sinks. Data flow runs successfully, but Rows Written through interface consistently shows 0 rows. I can see the rows were written by going to the table in Dataverse.
asked 2024-09-26T16:19:01.5633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 12%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENG%3C/text%3E%3C/svg%3E)
Noah Gilbert
26
Reputation points
commented 2024-10-01T15:42:07.5233333+00:00
Noah Gilbert
26
Reputation points
1 answer
One of the answers was accepted by the question author.
Running limited error in the status of ADF.
I have an on-premises environment where my Self-Hosted Integration Runtime (SHIR) is hosted. When I try to connect my SHIR to any resources, it generally runs well. However, frequently the status in Azure Data Factory (ADF) shows RUNNING (Limited). The…
asked 2024-09-30T13:03:51.28+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 55.00000000000001%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Balwant Singh Chouhan
10
Reputation points
accepted 2024-10-01T12:13:49.99+00:00
Balwant Singh Chouhan
10
Reputation points
1 answer
Why are there two TenantId's returned for an ADFPipelineRun log analytics query?
I am getting duplicate results in my log analytics queries on the ADFPipelineRun table, except for the TenantId column, which has two results instead of one. The __ResourceId's are identical for both rows. I can filter on one of the TenantIds, but why…
asked 2024-09-26T15:46:02.82+00:00
louw grobler
1
Reputation point
commented 2024-10-01T09:57:24.1866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
15,685
Reputation points Microsoft Vendor
1 answer
Availability of BasicDataSet_v0.MailFolder_v2 when creating a linkedservice in Azure Data Factory
Hi all. I have been attempting to complete a pipeline that draws info on a shared mailbox. I started out with the BasicDataSet_v0.MailFolder_v0 Dataset but discovered that it does not give a breakdown of child folders nor does it include shared inboxes…
asked 2024-09-10T01:26:55.4333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 6%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Matt
5
Reputation points
commented 2024-10-01T09:52:56.6566667+00:00
CarlZhao-MSFT
41,861
Reputation points
2 answers
How to add 100 plus source link in ADF pipeline to transfer data to single destintion.
I need to transfer data from multiple source sql servers( almost 100 plus) to a single destination using ADF, Is there is any way to add these much servers to ADF as source
asked 2024-09-29T13:21:02.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 81%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AGP
0
Reputation points
commented 2024-10-01T09:48:17.64+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
400
Reputation points Microsoft Vendor
2 answers
Suggest a way to replicate data from on premise sql server 2019 to azure synaspe analytics directly
Im using an sql server in my on premise with version 2019, I need to transfer or replicate real time data to azure synapse database, so which azure service will be more effective and flexible for large data transfer
asked 2024-09-26T14:30:15.38+00:00
AGP
0
Reputation points
commented 2024-10-01T09:47:32.87+00:00
Ganesh Gurram
400
Reputation points Microsoft Vendor
1 answer
Azure Private Link and Conditional Forwarders
We have a conditional forwarder setup for francecentral.datafactory.azure.net to our Azure DNS resolver, which is connected to the privatelink.datafactory.azure.net zone. The private A record is created and visible. When we test via nslookup from…
asked 2024-09-25T10:27:21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 20%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJR%3C/text%3E%3C/svg%3E)
J Rippon
81
Reputation points
commented 2024-10-01T09:46:59.4333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 71%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGP%3C/text%3E%3C/svg%3E)
Ganesh Patapati (Quadrant Resource LLC)
415
Reputation points Microsoft Vendor
0 answers
How to achieve the transaction replications setup from many on prem sql in azure.server
Currently we are using transactional replication to bring real time data from on prem sql source servers to azure db destination. I need to migrate this setup in azure with real time availability of data. I used the cdc ad event triggered methods but…
asked 2024-10-01T02:12:59.6466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 44%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJL%3C/text%3E%3C/svg%3E)
Jothi Lakshmi P M
0
Reputation points
commented 2024-10-01T09:14:52.54+00:00
PRADEEPCHEEKATLA-MSFT
89,296
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to increase throughput in ADF copy activity From Table Storage to Table Storage
Hello, Short background - I'm using ADF for creation of Table storage Backups for specific Storage Accounts (each account is different pipeline with separate copy activities for each Table), creating new Table storages from old ones using copy…
asked 2024-09-26T13:10:27.4533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 98%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETB%3C/text%3E%3C/svg%3E)
Tomas Blažauskas
40
Reputation points
edited a comment 2024-10-01T08:31:15.55+00:00
Tomas Blažauskas
40
Reputation points