Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,877 questions
1 answer
Redshift Connector in Azure Data Factory does not accept sslmode=verify-ca
From Azure Data Factory, I am trying to connect to a Redshift database as the source. I have created a Redshift Connector, but it fails to connect, with: ERROR [08S01] [Microsoft][Amazon Redshift] (10) Error occurred while trying to connect: [SQLState…
asked 2024-11-17T21:53:02.3866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 69%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
Peter McNamara
0
Reputation points
edited an answer 2024-11-18T05:50:37.6266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
3,230
Reputation points Microsoft Vendor
2 answers
Digi Finance Customer'v Care Number . 09516192422 =8926277268*//call.
Tanhai milti hai dil toot jata hai gam me jalte hai janne kiyo log muhabbat kiya karte hai
asked 2024-11-18T05:45:13.86+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 33%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFS%3C/text%3E%3C/svg%3E)
fivad80714@stenate.com
0
Reputation points
answered 2024-11-18T05:48:38.3366667+00:00
fivad80714@stenate.com
0
Reputation points
0 answers
How can I delete the Virtual Machine
Not able to delete my Virtual machine either by using powershell or by using azure portal or cli please help me out
asked 2024-11-14T01:07:10.0566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 98%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
shiva patpi
13,256
Reputation points Microsoft Employee
commented 2024-11-18T05:44:57.8933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 66%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELB%3C/text%3E%3C/svg%3E)
Lijitha B
500
Reputation points Microsoft Vendor
1 answer
Publishing to event hub via rest API is slow from ADF web activity
Publishing to message via rest api event hub using managed identity from dedicated integration runtime. Event Hub is premium with auto scale and there is enough TU. Messages are being sent one at a time. Each call takes 3 to 15 seconds to publish…
asked 2024-11-16T04:06:04.1233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 47%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHZ%3C/text%3E%3C/svg%3E)
Himanshu Zinzuwadia
45
Reputation points
commented 2024-11-18T03:42:04.93+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
ADF PII Detection and Masking - Schema Drift Issue
I am following the tutorial for setting up a pipeline for PII detection and masking (linked below). All steps have been followed exactly as described, without any changes to the pipeline settings or configurations. However, I am encountering an issue…
asked 2024-11-15T19:42:49.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 7.000000000000001%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Muhammad Abdulbaqi
20
Reputation points
commented 2024-11-18T02:36:35.0666667+00:00
Muhammad Abdulbaqi
20
Reputation points
1 answer
Wildecard in ADF copy activity
Hello , Is there a way in wildcard pattern in ADF copy activity to pick files from folders with certain naming convection. For example I have a following folder directory under bucket Myfolder **Main Folder** …
asked 2024-11-13T22:05:01.7466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 0%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Shweta Chavan
40
Reputation points
commented 2024-11-18T01:17:32.28+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
How can I write to a Dataverse lookup using an alternate key?
Hi I want to write data to Dataverse via a Synapse Copy Data task in a pipeline. The destination tables all have alternate keys set up. So for example, I could have a Country entity, with CountryAlternateKey (e.g. ISO code) and Name, and a City with…
asked 2024-11-13T10:32:20.5433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 86%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDP%3C/text%3E%3C/svg%3E)
Duncan Pryde
1
Reputation point
commented 2024-11-18T01:16:54.73+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
2 answers
Automating Azure Data Factory Sync with Git Branch After Python SDK Modifications
Hello, I've modified my datafactory through python SDK and added some trigger. Now my publish branch is out of sync with the main branch. I found the theoretical solution here:…
asked 2024-11-05T14:41:08.2666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 80%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Moritz Moeller
0
Reputation points
commented 2024-11-18T01:10:52.36+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
2 answers
How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio
I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…
asked 2024-10-24T05:42:30.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 20%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mitashi Malkani
0
Reputation points
commented 2024-11-18T01:09:46.1633333+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
How to fix UserErrorPermissionDeniedOnCloudIR
Hi, I'm trying to copy files from my sharepoint online document library into azure blob storage, but I am getting this error: ErrorCode=UserErrorPermissionDeniedOnCloudIR,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Access…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 30%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGY%3C/text%3E%3C/svg%3E)
0 answers
File system error - The specified network name is no longer available
This issue sometimes appears and then goes away on its own. How can I check and resolve it completely?" Please help me to resolve
Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,308 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,877 questions
Windows Network
Windows Network
Windows: A family of Microsoft operating systems that run across personal computers, tablets, laptops, phones, internet of things devices, self-contained mixed reality headsets, large collaboration screens, and other devices.Network: A group of devices that communicate either wirelessly or via a physical connection.
777 questions
asked 2024-11-14T10:08:09.6233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 55.00000000000001%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Balwant Singh Chouhan
50
Reputation points
commented 2024-11-17T07:58:34.4166667+00:00
Balwant Singh Chouhan
50
Reputation points
0 answers
Unable to create HDInsight On Demand Cluster in Azure Data Factory
I am getting the issue to creating the On Demand HDInsights in Azure Data Factory. The status is stuck at "PreparingCluster". Here's my LinkedService configuration. OS type : Linux
asked 2024-11-13T03:52:15.9866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 19%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETC%3C/text%3E%3C/svg%3E)
Tan Check Leam
10
Reputation points
commented 2024-11-16T15:30:52.6066667+00:00
Tan Check Leam
10
Reputation points
2 answers
Getting strange error when trying to connect ADF to dataverse using SPN
Im trying to connect ADF to Dataverse using a SPN. The SPN works properly, and is currently in use for pipelines. However when trying to connect using ADF is get the below error. Any ideas what I am doing wrong? Error code23604 DetailsFailed to…
asked 2022-04-14T13:58:49.81+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 42%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
Justin Adan
6
Reputation points
answered 2024-11-16T14:08:41.62+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 0%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHA%3C/text%3E%3C/svg%3E)
Hammed Abdulazeez
0
Reputation points MVP
0 answers
ADF PII Detect and Masking - Drifted schema
Hi, I followed the azure data factory documentation for adf pii detect and masking and when I have run the debugger it seems I'm getting an issue of the content being drifted. I have followed this documentation…
asked 2024-11-15T19:30:46.6433333+00:00
Muhammad Abdulbaqi
20
Reputation points
commented 2024-11-16T00:23:20.24+00:00
Muhammad Abdulbaqi
20
Reputation points
1 answer
No Reponse from ADF pipelines
Hi everyone. We are using Azure.ResourceManager.DataFactory library to run ADF pipelines. Here is the flow: Azure Web App triggers Azure Function that runs ADF pipeline In common case a pipeline run request takes ~2 seconds including sending request from…
asked 2024-11-13T12:54:49.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 52%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYC%3C/text%3E%3C/svg%3E)
Yevhen Chubarov
20
Reputation points
commented 2024-11-15T22:56:04.8833333+00:00
LeelaRajeshSayana-MSFT
16,286
Reputation points
2 answers
Parametrization for connection string is not working in linked service
Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…
asked 2024-11-07T19:55:32.4766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 49%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
Peter Michalik
0
Reputation points
commented 2024-11-15T19:30:22.4433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
11,455
Reputation points Microsoft Vendor
0 answers
Evaluating a bit/boolean in ADF If Condition Activity
You would think this would be incredibly simple, but apparently not. A SQL statement used in a lookup returns either CAST(1 as bit) or CAST(0 as bit) to a pipeline as column is_enabled. An If condition activity (inside a For Each) uses this expression to…
asked 2024-11-13T20:35:55.0633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 19%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPD%3C/text%3E%3C/svg%3E)
Pendleton, David
20
Reputation points
commented 2024-11-15T18:43:42.26+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
1,350
Reputation points Microsoft Vendor
1 answer
I am getting Table_or_View Not found error notebook activity run
My Notebook activity is under for each activity. under for each activity , i have copy activity. upon success of copy activity i have this note book activity. first copy activity creates a temp table and then notebook activity access this temp table in…
asked 2024-11-14T07:29:29.0733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 15%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKB%3C/text%3E%3C/svg%3E)
Ketan Bharat | MAQ Software
40
Reputation points
commented 2024-11-15T18:40:57.4933333+00:00
Ganesh Gurram
1,350
Reputation points Microsoft Vendor
1 answer
Why does the Azure Data Factory Web Activity return a compressed gzip response when there is an API error but returns a normal (uncompressed) JSON response when there is no error?
When I make a Postman POST call into a system, with a request that is designed to fail, I get back the appropriate error message. The only request header I add is Content-Type: application/json. { "error": { "message":…
asked 2024-11-14T23:44:26.5766667+00:00
Peter Kierstead
0
Reputation points
answered 2024-11-15T18:15:25.67+00:00
Peter Kierstead
0
Reputation points
0 answers
ADF GROUPED EXPERTquery
Hi, API receives input expert query in JSON format and returns related transitional data in JSON format. When data is transferred then separate request with expertquery for each combination is executed with QueryTarget = self, as a results result a lot…
asked 2024-11-15T14:55:09.8766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 34%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMR%3C/text%3E%3C/svg%3E)
Mahlaule, Rirhadzu
0
Reputation points
commented 2024-11-15T17:41:04.02+00:00
phemanth
11,455
Reputation points Microsoft Vendor