Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Data Factory Pipeline executes twice
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 42%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EML%3C/text%3E%3C/svg%3E)
Michael Lee
1
Reputation point
Hello-
I have a pipeline with multiple copy activities, from an Azure SQL DB to an Azure SQL DB.
When I attempt to debug or "trigger now" the pipeline, it starts executing, but then after a minute I get a message in the UI and a second instance starts executing. Has anybody run into this or know the cause?
Azure Data Factory
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 46%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Sanjay Sanigarapu 1 Reputation point2021-01-13T15:29:46.273+00:00 In triggers menu you can edit trigger, check if your pipeline was mentioned twice
-
Michael Lee 1 Reputation point
2021-01-13T15:40:26.25+00:00 This is a new pipeline that has not been assigned a trigger. So I'm not sure where I would be looking for that?
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT 26,161 Reputation points2021-01-13T23:47:33.677+00:00 Hello @Michael Lee and welcome to Microsoft Q&A. Thank you for brining this issue to our attention.
I have not seen that particular message before. Could you please try reloading the page and then try several "Trigger now" runs spaced apart by 5 minutes. Also do the same with debug runs. I would like to know if you can reliably reproduce this. If you can, please record the runId's of each.
-
Michael Lee 1 Reputation point
2021-01-14T00:24:36.693+00:00 Hello @MartinJaffer-MSFT
This does not happen if the pipeline is executed via a scheduled trigger run ID: 668106d1-d7ff-478d-9e8d-580c158fe85d 1/13 @ 9:30 EST
I can do more tests at 13:00 EST on 1/14. I've also attached the pipleine code
I was able to reproduce this several times today and yesterday. All times are EST, here are the run IDs:DEBUG: 1/12
9:27 - 97fe924a-285d-4f5a-a85c-966038fc60a2
9:28 - b20e9267-7163-4706-945a-d83f44e957ac
14:16 - db9591c8-ebe8-4f21-8184-390e1d3492f3
14:17 - a7585c20-9a6b-4415-a54e-0513e9cbef6d1/13
9:01 - d4f68bcb-e9d1-4036-9ca2-4dfdba8c0ea3
9:02 - 611bcf48-69e7-461f-86f6-8aad046b6be2
9:06 - b5d0049a-2e17-4f37-8a71-8f120929e704
9:07 - 508c4d14-9570-4107-819c-540ef223f8baTrigger Now: 1/12
9:16 - 0d68dc98-3aa3-4c2d-8c08-786dbee5f0af
9:17 - 1bc2a26a-70dd-47b5-ba4a-7c26762f87c1
12:36 - 92654cc0-977a-4be8-80d6-729eb689c5a6
12:37 - 7b104390-7749-4ccd-90f8-0a69a028e5f0[PipelineCode][1]
-
MartinJaffer-MSFT 26,161 Reputation points
2021-01-14T19:49:10.917+00:00 @Michael Lee thank you very much for the detailed info. I am now escalating the issue internally.
-
MartinJaffer-MSFT 26,161 Reputation points
2021-01-14T19:58:58.667+00:00 @Michael Lee one thing I forgot to ask...
Are you doing a single-click or double-click? -
Michael Lee 1 Reputation point
2021-01-14T19:59:32.783+00:00 Single Click
Sign in to comment
Sign in to answer