Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,564 questions
1 answer
One of the answers was accepted by the question author.
Sorry, MGdc is not supported in this region [GBR]
Hi, I have created a simple copy data pipeline in ADF that throws the following error. My intention was to POC copying the Office 365 users to a GEN2 storage container (data lake). I tried both UK data centers (west and south) where I have separate…
Azure Data Lake Storage
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-23T19:47:58.923+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 49%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVX%3C/text%3E%3C/svg%3E)
Vangelis Xanthakis
21
Reputation points
commented 2021-02-24T19:37:20.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,647
Reputation points Microsoft Employee
Moderator
1 answer
One of the answers was accepted by the question author.
Get activity/Pipeline Id that triggered a seperate Pipeline using PowerShell
I am using a powershell script to collect all activity Ids associated with a trigger and I do not know how to find the Pipeline Id or a pipeline that was triggered by an "Execute Pipeline" activity. I could alternatively search for pipelines…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-18T19:11:21.107+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 1%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESF%3C/text%3E%3C/svg%3E)
Shane Firnekas
21
Reputation points
commented 2021-02-24T18:30:29.783+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,156
Reputation points
1 answer
One of the answers was accepted by the question author.
Parameter in Pipeline
Hello Team, We have used parameter to delete the specific rows in pipeline. I got the error message : [Tuesday 11:33 PM] Rohit Kulkarni …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-19T10:12:22.247+00:00
Rohit Kulkarni
441
Reputation points
accepted 2021-02-24T16:18:24.777+00:00
Rohit Kulkarni
441
Reputation points
7 answers
One of the answers was accepted by the question author.
Sink Activity issue
Hello team, I have created a dataflow .And it is working fine. But when i mapp this dataflow to pipeline and run the pipeline at that time i am getting the below mentioned error : …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-18T13:00:02.193+00:00
Rohit Kulkarni
441
Reputation points
accepted 2021-02-24T16:14:42.537+00:00
Rohit Kulkarni
441
Reputation points
2 answers
Pass File in Web activity - Data Factory
Hi all, I am trying to call D365FO Odata entity from Web activity. I am able to import the data in the environment by passing the contents in BODY . (similar to the body request in postman) Now, I am finding a way to import the data from…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-01-29T11:23:31.603+00:00
Anitha Eswaran
61
Reputation points MVP
commented 2021-02-23T22:28:03.767+00:00
MartinJaffer-MSFT
26,156
Reputation points
1 answer
One of the answers was accepted by the question author.
Relative Path in Absolute URI error while setting up Data Flow Source in ADF V2
I am getting error below while setting up Source Options in ADF Data flow , I wanted to pickup all four .csv files under my Data lake folder MyFolder/2020/11/ alter the same column name Account ID in them using Derived Column , When I set the source…
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,564 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2020-11-23T22:03:29.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 38%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AzeemK
516
Reputation points
commented 2021-02-23T21:31:10.023+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 11%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
James Alsup
6
Reputation points
1 answer
Details on ADF Hackathon
Hi All, Was going through this link for ADF hackathon and had few questions: …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-22T06:35:01.993+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 27%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPJ%3C/text%3E%3C/svg%3E)
Priya Jha
896
Reputation points
commented 2021-02-23T19:30:31.603+00:00
KranthiPakala-MSFT
46,647
Reputation points Microsoft Employee
Moderator
1 answer
Transactions in Azure Data Factory & SSIS
I have a solution, in which an SSIS package is deployed on Azure. The package is being executed via Data Factory (V2) using Execute SSIS Package task in a pipeline. I have a sequence container within the package, in which I would like to enable the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-16T16:04:38.383+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 12%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKE%3C/text%3E%3C/svg%3E)
Khidir Elsanosi
21
Reputation points
commented 2021-02-23T18:31:50.48+00:00
MartinJaffer-MSFT
26,156
Reputation points
1 answer
One of the answers was accepted by the question author.
Promoting everything in a Data Factory to another except linked services and triggers with templates.
Hi, Is there a way to promote everything in a Data Factory to another except linked services and triggers with templates. The templates get exported with triggers and linked services and it expects the when you submit the template in the other data…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-11T15:06:06.66+00:00
Rodrigo Fernandez
21
Reputation points
commented 2021-02-23T18:30:44.82+00:00
MartinJaffer-MSFT
26,156
Reputation points
1 answer
Logic App emails Azure data factory
Hello I'm implementing a logic app service in order to sent Email with some statical data from the pipelines execution. I'm facing with some problems because I need the data from some output variables and I'm not able to reach them This is the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-10T12:50:06.567+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 36%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
Diana Milena Coronado Granados
1
Reputation point
commented 2021-02-23T18:28:52.247+00:00
MartinJaffer-MSFT
26,156
Reputation points
3 answers
Custom .NET Activity: The request was aborted: Could not create SSL/TLS secure channel. Unable to download API data.
Under the Batch Service option, we are running a custom dot net activity, and that .NET tool downloads data from some APIs. It was working fine without any issues until Yesterday(for more than 2/3 years). Now we are facing the below error while…
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
374 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2020-07-09T06:16:04.973+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 81%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK1%3C/text%3E%3C/svg%3E)
KathiresanSubramaniam-1168
1
Reputation point
answered 2021-02-23T16:41:00.14+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 70%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E1%3C/text%3E%3C/svg%3E)
17NBhoodoo
1
Reputation point
0 answers
Validation Activity - Not giving right error
I have a pipeline which works on files in a folder. At the start of the pipeline is a validate activity to check if files exist. If there are no files, then we do nothing. Because we do not want the pipeline to report an error every time there are no…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-19T08:57:44.177+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 6%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKR%3C/text%3E%3C/svg%3E)
Kothai Ramanathan
946
Reputation points Microsoft Employee
commented 2021-02-23T09:19:28.37+00:00
KranthiPakala-MSFT
46,647
Reputation points Microsoft Employee
Moderator
1 answer
One of the answers was accepted by the question author.
Can we trigger a pipeline on first business day of each month ? Do we have such option in ADF ?
Can we trigger a pipeline on first business day of each month ? Do we have such option in ADF ?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-23T05:43:11.247+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 95%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Nagendra Kumar
31
Reputation points
commented 2021-02-23T09:06:45.107+00:00
Nandan Hegde
36,241
Reputation points MVP
Volunteer Moderator
1 answer
how to read lookup activity output in HIVE activty
Hi Experts, I want to read lookup activity output in Hive activtiy. in my case i'm creating count using lookup activity. i want o use that count in Hive activity in SELECT statement. like below, SELECT 'Test' AS C1, …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-15T16:09:07.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 8%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECH%3C/text%3E%3C/svg%3E)
Chilukurthi Harikrishna
41
Reputation points
commented 2021-02-23T08:42:01.52+00:00
Chilukurthi Harikrishna
41
Reputation points
1 answer
copy data activity very slow
I have an activity copy in my pipeline to copy 4171 lignes from an Azure sql database to salesforce, and the copy data it's very slow, an i have at the end 400 skipped rows because of the CPU time limit, i've noticed also that the debit is low 3,55 ko/s …
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-16T10:33:57.2+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 18%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
Haydadi, Dounia
1
Reputation point
answered 2021-02-23T08:03:01.983+00:00
Haydadi, Dounia
1
Reputation point
3 answers
One of the answers was accepted by the question author.
CSV format not retained in Lookup - Azure Data factory
Hi experts, I am trying to call D365FO Recurrence job in my pipeline. I am facing the issue in the format of the data sent from Lookup activity. My lookup activity has the source data set as CSV file , in my case a customer group file.…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-12T09:10:06.417+00:00
Anitha Eswaran
61
Reputation points MVP
answered 2021-02-23T04:49:25.573+00:00
Anitha Eswaran
61
Reputation points MVP
2 answers
Data Type( Source and Target)
Hello Team, I am transferring the data from Source to target .There are more than 200 fields. The data type from source to Target are not matching. I don't want to hardcode the datatype Because if any function got changed then data type will be…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-22T15:50:59.58+00:00
Rohit Kulkarni
441
Reputation points
answered 2021-02-23T04:43:21.413+00:00
Rohit Kulkarni
441
Reputation points
2 answers
One of the answers was accepted by the question author.
Bulk insert to Web activity Data factory
Hi, I have approximately 500 records in my data set. In my design, I am using for loop to call the Web activity which then triggers the import of data to D365FO. My question here is, though I have set the BATCH COUNT in FOR loop to 20, is it…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-16T05:07:03.02+00:00
Anitha Eswaran
61
Reputation points MVP
answered 2021-02-23T03:18:41.513+00:00
Anitha Eswaran
61
Reputation points MVP
1 answer
How can we do multiple copy activity in one single run of adf pipeline
Hi Team, I have requirement like below As you can see in above image i have 4 paths in source and 4 in destination .. i want to copy all of the data in one run of adf pipeline .. as i many times comes across requirement where i need to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-18T13:14:46.84+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 31%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
@maddy
1
Reputation point
commented 2021-02-22T19:01:34.583+00:00
KranthiPakala-MSFT
46,647
Reputation points Microsoft Employee
Moderator
0 answers
How can I see EXACTLY what ADF is sending to a REST API?
I'm making a GET call to a REST API. This API passes parameters through the URL only and uses key authentication. When I try to call this service as part of a copy activity, it says that my key is either invalid or not recognized. I've confirmed that…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,674 questions
asked 2021-02-17T06:01:19.817+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 12%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG%3C/text%3E%3C/svg%3E)
GrayMonkey
1
Reputation point
commented 2021-02-22T18:57:34.067+00:00
KranthiPakala-MSFT
46,647
Reputation points Microsoft Employee
Moderator