Azure Key Vault
An Azure service that is used to manage and protect cryptographic keys and other secrets used by cloud apps and services.
1,190 questions
0 answers
data factory managed identity is not being identified as a trusted service by keyvault
We have an issue with an ADF pipeline, when attempting to reach a secret from a KV in the same RG, the connection fails with the following error: "Client address is not authorized, and caller is not a trusted service" The setup is made…
asked 2024-07-23T21:23:39.3533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 10%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
Reyes Monsalve, Ruben Dario
26
Reputation points
asked 2024-07-23T21:23:39.3533333+00:00
Reyes Monsalve, Ruben Dario
26
Reputation points
2 answers
Why is FailureWebHook not executed in this case?
Please consider the following pipeline. The Execute Pipeline activity failed, so the ProcessTMONData notebook was skipped. Why was the failure webhook not triggered, as it's supposed to trigger when EITHER: ForEachEndpoint fails ProcessTMONData is…
asked 2024-07-23T12:10:36.8466667+00:00
Psychotechnopath
31
Reputation points
answered 2024-07-23T20:51:23.3566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
28,956
Reputation points Microsoft Employee
0 answers
Error during batchpoint invoke: Access to this resource is denied. Please check your ACL rules on the resource
Hello, I am getting a "Access to this resource is denied. Please check your ACL rules on the resource." when attempting to invoke a batch endpoint. I have tried both with Azure CLI and Azure Data Factory to invoke a batch endpoint, with both…
asked 2024-07-22T11:59:17.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 39%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKT%3C/text%3E%3C/svg%3E)
Khai-Tam Nguyen
0
Reputation points
commented 2024-07-23T20:32:05.28+00:00
Khai-Tam Nguyen
0
Reputation points
1 answer
How to solve the error in ADF- Rest call failed with client error
I am trying to copy data from share point using graph API. I am able to see the data through postman (by providing the authorization through access token), but when I use the same URL inside the Rest API dataset (source) in a copy activity, I am getting…
asked 2024-07-23T12:00:31.0466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 26%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Ananthu Sreedhar
0
Reputation points
answered 2024-07-23T20:18:20.6533333+00:00
Amira Bedhiafi
19,946
Reputation points
1 answer
ADLS connections with third party
Hi friends, we have ingested data from all the data sources and stored it in ADLS Gen2 but after that, there is a virtual layer in the form of Denodo. This virtualization tool only has views and once views are executed, it fetches the data from multiple…
asked 2024-07-23T07:31:13.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 15%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anshal
2,246
Reputation points
answered 2024-07-23T20:05:11.91+00:00
Amira Bedhiafi
19,946
Reputation points
1 answer
One of the answers was accepted by the question author.
Data flow Output metric Status as substatus instead of runstatus resulting error while capturing metrics for status using runstatus column for logging
Getting Status as Substatus instead of runstatus for DataFlow in Azure data factory, We are using this column to log the status of the pipelines for all data flows & pipelines, Few pipelines are getting failed for the same and getting fixed…
asked 2024-05-23T19:28:15.8766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 56.00000000000001%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
Hanuman Devineni
31
Reputation points
accepted 2024-07-23T19:22:53.49+00:00
Hanuman Devineni
31
Reputation points
0 answers
Staging of Source Data in Parquete vs SQL DB for DWH with ADF for Delta-Loads
Hi there, I have some "conceptual" question I would like to discuss. New DWH should is beeing build on Azure using ADF and SQL for Dimensions/Facts. Today, we have also running the landing on SQL DB. Also we are only loading delta datasets…
asked 2024-07-23T06:58:39.9333333+00:00
Jörg Lang
120
Reputation points
commented 2024-07-23T19:16:36.9066667+00:00
Bhargava-MSFT
28,956
Reputation points Microsoft Employee
2 answers
||Execution fail against sql server. Please contact SQL Server team if you need further support. Sql error number: 121. Error Message: A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - The sem
Hi, We have azure data factory pipeline and got error message below couple of times over week-end. ADF pipeline calls azure sql database stored procedure which failed with the message - stored procedure just removes rows from table. Intermittent and…
asked 2024-07-22T14:30:09.2033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 22%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPO%3C/text%3E%3C/svg%3E)
Philip O'Rourke
111
Reputation points
commented 2024-07-23T19:14:18.2933333+00:00
Erland Sommarskog
106.8K
Reputation points
0 answers
How to process this JSON structure
Hi, i get this structure back from a web activity. Showing only a part { "Response": "[\r\n {\r\n "CreationDate": "2024-01-07T00:00:00Z",\r\n "Operation": "ViewReport",\r\n "UserId":…
asked 2024-07-23T15:27:30.86+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 92%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Poel van der, RE (Ron)
431
Reputation points
commented 2024-07-23T18:48:41.6166667+00:00
Bhargava-MSFT
28,956
Reputation points Microsoft Employee
0 answers
How to Handle Case Sensitivity in Dynamic JSON Input Keys ("A" vs "a") for Derived Columns in ADF Dataflow Pipeline?
I am working on a dataflow pipeline in ADF with an input dataset schema that includes a column 'A'. The dataflow processes various JSON files with dynamic schemas, where some JSON files use 'A' and others use 'a' as keys. Since the schema is case…
asked 2024-07-17T12:59:49.7733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 16%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHP%3C/text%3E%3C/svg%3E)
Hrithik Purwar
0
Reputation points
commented 2024-07-23T18:44:07.88+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
3 answers
How to generate ETL pipeline for Python code which gives 2 JSON file in response
Requirement : I have python code in my local pc folder which returns 2 JSON file as a output (that code is using API and try to store the data of website in JSON file), I want to create automation for running that python code at particular time using…
asked 2024-07-13T15:19:01.0733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 80%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EUM%3C/text%3E%3C/svg%3E)
Utsav Mori
20
Reputation points
commented 2024-07-23T18:42:25.25+00:00
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
1 answer
Efficient Log Handling and Data Retention in Azure Data Factory and Databricks
I need to create a solution to send logs from Azure Data Factory to the Databricks Unity Catalog. I'm considering the following structure: Whenever an activity run results in either failure or success, the corresponding log will be sent to Azure Logic…
asked 2024-07-17T19:44:42.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 31%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Hanna
220
Reputation points
commented 2024-07-23T16:43:05.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
320
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Google drive on Azure without GCP
Hello, I'm wondering what options I have to transfer Google Drive data to Azure without GCP access. I found that the Google Drive API and Google Storage API require a Google Cloud account. What other options do I have to securely connect to and transfer…
asked 2024-07-21T12:18:22.7166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 43%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETM%3C/text%3E%3C/svg%3E)
Tony Minozi
20
Reputation points
commented 2024-07-23T15:46:30.81+00:00
Tony Minozi
20
Reputation points
1 answer
Inserting Error Logs from Data Factory into Databricks Delta Table (Catalog) - Streaming vs. Batch
Hi everyone, I'm working on a solution to capture and store error logs generated by my Azure Data Factory pipelines. My goal is to insert these logs into a Databricks Delta Table (catalog) for further analysis and troubleshooting. I'm considering two…
asked 2024-07-22T23:40:52.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 70%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEA%3C/text%3E%3C/svg%3E)
Elliot Alderson
0
Reputation points
answered 2024-07-23T15:30:35.4433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,615
Reputation points Microsoft Vendor
2 answers
Xero connection error using oAuth2
I'm trying to establish the connection to Xero using the Xero connector via oAuth2 with the clientId and clientSecret. In the UI form, the required fields are: ClientID ClientSecret TenantID RefreshToken After filling all fields with the correct…
asked 2024-07-23T14:53:58.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 55.00000000000001%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EOM%3C/text%3E%3C/svg%3E)
Oleksandr Muzychenko
0
Reputation points
answered 2024-07-23T15:28:00.64+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 22%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHS%3C/text%3E%3C/svg%3E)
Hiralal sarma
0
Reputation points
1 answer
How to build ETL Method for CDC Data Load for Multiple tables
Hi, I am trying to build an ETL Pipeline using data flows, so that multiple table data loads can be initiated (as a sequential activity), So far I have tried to achive this using an etl table and parameterizing pipeline and dataflows so that I can call…
asked 2024-07-22T12:52:11.4866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 32%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Anmol Ganju
176
Reputation points
commented 2024-07-23T14:38:06.4733333+00:00
Vinodh247
13,536
Reputation points
1 answer
How to change my tenant on azure data factory
I log in on my azure portal using my personal account. I have been able to create all resources required for my data factory. When launching the azure data factory studio, It prompter me to sign in again with 2fa enable etc, then redirect me to a wrong…
asked 2024-07-23T13:48:03.4433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 53%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVM%3C/text%3E%3C/svg%3E)
Vanessen Munisamy
0
Reputation points
answered 2024-07-23T14:33:34.7766667+00:00
David Broggy
5,701
Reputation points MVP
1 answer
Error Data Flow connection vs CosmosDb
I'm creating a ADF data flow to import data from CosmosDb. I have created a linked service and a dataset to connect with CosmosDb; these connections run successfully: Linked Service connection Dataset connection When i try to do a data preview…
asked 2024-07-16T13:46:31.1066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 11%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EID%3C/text%3E%3C/svg%3E)
Izaura Domi
0
Reputation points
commented 2024-07-23T14:10:27.7266667+00:00
Bhargava-MSFT
28,956
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Transfer documents from sqlserver in varbinary to Azure Blob storage
I am looking to move a large set of documents from a Managed Instance of SQL Server database where the documents are saved in varbinary data type on the sql server table. The ADF dataflow I created doesn't let me select a Azure Blob 'Binary' as the sink…
asked 2024-05-23T16:42:11.0466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 51%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERD%3C/text%3E%3C/svg%3E)
Reema DSouza
20
Reputation points
commented 2024-07-23T13:57:37.0433333+00:00
Reema DSouza
20
Reputation points
0 answers
How to Fix the InternalServerError in Executing a ADF Pipeline?
I have a foreach loop in my Azure Data Factory pipeline with three activities. The first activity uses a Self-Hosted Integration Runtime (SHIR) to copy data from an On-premises SQL Server to Azure Data Lake Storage Gen2 (ADLS2). The second activity is a…
asked 2024-07-22T17:39:46.4166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 95%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Nitin Patil
0
Reputation points
commented 2024-07-23T12:38:32.07+00:00
Nitin Patil
0
Reputation points