Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF Pipeline created using Python fails its first run but succeeds later
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 48%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
vijayshankar
0
Reputation points
Hi,
I am using python script to create pipelines in ADF.
The issue I am facing is the pipeline gets created but fails its first run with schema not matching or column mapping issues.
But Once i click on some of the components but do not make any changes, i can see that i have an option to publish changes.
At this point, if I run the pipeline, it runs correctly.
Can anyone please explain this behaviour ?
What changes should I make in my python script to make it work from first run itself.
Thanks
Azure Data Factory
{count} votes
-
Nandan Hegde 36,716 Reputation points MVP Volunteer Moderator2025-01-02T07:17:47.8333333+00:00 Can you please share the JSON of the pipeline that is created via python and the failure message which you get on 1st execution?
Also can you share the post JSON manual pipeline which has a successful run
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu 32,530 Reputation points Microsoft External Staff Moderator2025-01-03T10:19:47.6+00:00 @vijayshankar We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
-
Smaran Thoomu 32,530 Reputation points Microsoft External Staff Moderator
2025-01-06T16:15:10.03+00:00 @vijayshankar We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Sign in to comment
Sign in to answer