Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,335 questions
1 answer
Automate file transfer from REST API to Azure Blob Storage
I need to automate the download of several files (up to 100MB each) from a REST API endpoint, and then upload them to Azure Blob Storage. I need to do this using only Azure services (no local/on premises resources) on a scheduled basis. What Azure…
asked 2020-10-17T18:57:45.933+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 10%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMV%3C/text%3E%3C/svg%3E)
Mario VW
1
Reputation point
answered 2020-10-20T11:29:32.627+00:00
Pramod Valavala
20,591
Reputation points Microsoft Employee
2 answers
ADF Copy activity with PolyBase column size limit (8000 bytes)
There seems to be an error when loading columns with sizes greater than 8000 bytes via ADF Copy with Polybase and Synapse. Error message: { "errorCode": "2200", "message":…
asked 2020-10-14T12:16:02.553+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 15%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Robert Kostecki
6
Reputation points
answered 2020-10-20T09:15:14.307+00:00
Robert Kostecki
6
Reputation points
1 answer
One of the answers was accepted by the question author.
ADF - XML Flatten I can't unroll root
33254-samplefile.xml I thought I'd have a looked at the new XML import in ADF but I'm stuck trying to flatten the data. I have attached an xml sample file I'm using. The import looks to have worked OK as I can see the data But…
1 answer
One of the answers was accepted by the question author.
Copy behaviour of Azure Data Factory
Hi .. i have copied some sql table data which is in adls gen2 from source to destination .. our requirement was like data should be overwritten to destination tables but data has been appended. My question is what is the behaviour of ADF Copy :…
asked 2020-10-15T13:43:59.17+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 28.000000000000004%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Rohit Boddu
461
Reputation points
accepted 2020-10-20T06:15:37.54+00:00
Rohit Boddu
461
Reputation points
2 answers
No escape character not working as expected
I am using a copy data activity to copy data from ADLS into Snowflake. My source data is a gzip csv file which is pipe delimted. One of the field has the following value ending with a "\". The pipe delimiter after the field is ignored making my…
asked 2020-10-01T01:11:03.447+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 54%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Manohar Punna
1
Reputation point
commented 2020-10-19T18:52:29.207+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,036
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Data Factory Pipeline-Acquire Compute
Respected, I am running a Azure Data Factory pipeline using DataFlow as a POC(Proof of Concept) which does insert/update of about 5 rows. The pipeline is running for about 7-8 minutes. I am seeing that most of the time it is in status 'Acquire…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 25%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
1 answer
Cost of Azure Data factory(Copy Data)
Hi Team, I am new in this area. I am using Copy data in Azure data factory what is cost of Azure data thanks Shanvitha
asked 2020-10-13T14:23:39.087+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 79%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Shanvitha
221
Reputation points
commented 2020-10-19T08:10:49.453+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 9%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
Why do Azure data Factory Activities not appear in Activity Suceeded Metrics in the Azure Monitor UI?
I am attempting to set up an email notification via the Azure > Monitor > Alert Rules UI. I click on Create alert rule and select Resource = Data Factory v2 Condition Signal Type = Suceeded activity runs metric Under Configure signal…
asked 2020-10-14T10:16:56.433+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 28.999999999999996%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAB%3C/text%3E%3C/svg%3E)
Amie Barkes
41
Reputation points
commented 2020-10-19T06:46:13.443+00:00
PRADEEPCHEEKATLA-MSFT
78,576
Reputation points Microsoft Employee
0 answers
Azure Data Factory Web Activity save outputs
Is there a way to save the output of an Azure Data Factory Web Activity into a dataset? Here is my current use case: I have to dynamically build a JSON post request The API I'm trying to reach requires a SSL certificate so I have to use the Web…
asked 2020-10-16T18:18:18.81+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 57.99999999999999%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECH%3C/text%3E%3C/svg%3E)
Courtney Haedke
151
Reputation points
commented 2020-10-16T18:36:56.857+00:00
MartinJaffer-MSFT
26,036
Reputation points
1 answer
I have Source is one Tenant and Destination another Tenant -Which IR i need create
HI Team, I need create Integrate runtime(IR) my data factory I have question which IR i need create Azure IR or Self-host IR My Source is ABC company Tenant and Destination is XYZ comapny Tenant Thanks Shanvitha
asked 2020-10-13T14:00:07.82+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
answered 2020-10-16T11:58:47.08+00:00
Vaibhav Chaudhari
38,631
Reputation points
1 answer
Error while publishing: Cannot read property 'tableName' of undefined
Hi Team, When trying to publish an ADF from master to adf_publish I am getting the error: Error while publishing: Cannot read property 'tableName' of undefined There are no other details shown. I tried looking through the master branch and do not…
asked 2020-10-13T14:00:26.307+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 98%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPL%3C/text%3E%3C/svg%3E)
Pujari, Lavanya (External)
41
Reputation points
answered 2020-10-15T22:47:46.207+00:00
MartinJaffer-MSFT
26,036
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Data Factory - Stopped Trigger has run this morning
Just wondering what I have done wrong here, I have a trigger and in Master yesterday I changed it to Stopped: "name": "Daily - 0830 UTC", "runtimeState": "Stopped", But this morning the trigger has run:…
asked 2020-10-13T08:48:43.5+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 31%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Jay
556
Reputation points
commented 2020-10-15T19:18:01.05+00:00
MartinJaffer-MSFT
26,036
Reputation points
0 answers
Logs are missing in the Log Analytics Workspace - Azure Data Factory
We came across a situation where certain logs are missing of in the ADFPipelineRun in the log analytics workspace. For instance a log of Succeeded pipeline execution is missing even if the pipeline has finished the execution successfully. and there are…
asked 2020-10-14T18:37:22.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 99%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Sachin Srivastava
1
Reputation point Microsoft Employee
commented 2020-10-15T09:28:46.54+00:00
PRADEEPCHEEKATLA-MSFT
78,576
Reputation points Microsoft Employee
1 answer
ADF debug session error in data preview
Hello I have got enable the debug session mode, I'm trying to see the data preview of an input file but when I try to see it I got this error message The pipeline is running without problem but I don't know why is failling if i try to run a debug…
asked 2020-10-02T13:58:26.627+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 71%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECG%3C/text%3E%3C/svg%3E)
CORONADO GRANADOS Diana Milena
126
Reputation points
commented 2020-10-14T21:46:54.823+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Is it possible to add custom parameters (User Inputs) to an ADF Template I've created?
I saved an ADF copy pipeline as a template. When a user selects the template, in addition to the linked services, I would like to prompt the user to enter two additional string parameter values that would be used to set values in the pipeline. Is that…
asked 2020-10-08T14:30:51.72+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 33%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBB%3C/text%3E%3C/svg%3E)
Brian Barnett
116
Reputation points
accepted 2020-10-14T17:12:48.137+00:00
Brian Barnett
116
Reputation points
2 answers
DataFlow Sink not allow to on premise SQL sqrver
Hi Team, Currently we have requirement to dataflow output data load to on premise SQL server table, According to when we trying to add SQL server connector to data flow Sink connection, its hide and Not allow to select it. But same connection allow…
asked 2020-10-12T00:57:01.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 19%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mahesh Madhusanka
176
Reputation points
commented 2020-10-14T09:59:20.52+00:00
PRADEEPCHEEKATLA-MSFT
78,576
Reputation points Microsoft Employee
1 answer
Writing Append /Set variable
How can I write my Append/Set variable values to a blob storage (csv file)
asked 2020-10-10T03:27:44.42+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 70%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EU%3C/text%3E%3C/svg%3E)
usha
1
Reputation point
commented 2020-10-14T07:49:42.47+00:00
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
How to pass parameters from a pipeline to a data flow?
Hai All I am a newbie on ADF and learning bit by bit. Made a flow which works fine when I hard-code values. But I want the dataflow to be re-used over and over again, whereby the value of the parameters differ. So I want to give the…
asked 2020-10-09T13:13:05.407+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 92%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Poel van der, RE (Ron)
421
Reputation points
commented 2020-10-13T21:26:41.48+00:00
MartinJaffer-MSFT
26,036
Reputation points
1 answer
Conditional sink in Azure data factory
Hello, I have a mapping data flow that is checking for invalid data, with conditional split, in my file. (example row in column one < than in column two.) I the case I don't have any invalid data I would like to copy the file in new folder. if I…
asked 2020-10-08T14:54:56.363+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 49%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
Alexandre Munday
1
Reputation point
commented 2020-10-13T18:37:33.527+00:00
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
How to parameterise full connection string in Azure SQL Database linked service
Guides I've seen this show how to parameterise the components of the connection string, like the database name or user, but I want to make the whole connection string a parameter. When I try this, it doesn't let me save the JSON because it tries to…
asked 2020-10-09T11:44:36.173+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 93%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Steven Darby
1
Reputation point
commented 2020-10-13T17:33:23.92+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee