Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,984 questions
adf_client.activity_runs.query_by_pipeline_run while debugging pipeline
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 78%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH0%3C/text%3E%3C/svg%3E)
hitler 007
1
Reputation point
I am using adf_client.activity_runs.query_by_pipeline_run inside my azure notebook to get pipeline details (such as output/pipeline status/child pipeline execution time). I am passing the pipeline run id as the base parameter to this notebook. However, I am able to get the details when i publish and trigger it but not when i debug the pipeline.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT 26,106 Reputation points2021-06-28T20:07:05.803+00:00 Hello @hitler 007 and welcome to Microsoft Q&A.
The reason you are able to query published & triggered pipelines, but not debug pipelines, is because they are considered to be different types of runs. Debug pipeline run data is not kept as long (I think?).
I will inquire as to how to retrieve activity data of debug runs.
-
hitler 007 1 Reputation point
2021-06-30T05:23:27.857+00:00 Hi @MartinJaffer-MSFT ,
Thank you for the response.
So, any update as to how to retrieve activity data of debug runs?
-
MartinJaffer-MSFT 26,106 Reputation points
2021-07-01T01:02:27.737+00:00 I'm sorry, @hitler 007 ,
I haven't gotten responses on any of my recent escalations. Just in case they tell me debug details aren't available via SDK, I have done some investigation into alternatives.By inspecting browser traffic when using the ADF UI, I found some endpoints that may be of use. While the endpoints aren't a class, they are a starting point for a work-around. I expect they work similar to the other ADF REST API endpoints.
base url:
... factories/{factory_name}/querydebugpipelineruns?api-version=2018-06-01
(with no other parameters)....factories/{factory_name}/sandboxPipelineRuns/{run_id}/sandboxActivityRuns?
with parameters
- startTime
- endTime
- api-version
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 48%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
danee130 0 Reputation points2023-03-22T14:38:28.4833333+00:00 Any updates on this matter?
Sign in to comment
Sign in to answer