Is it possible to fetch in-progress pipeline details via an API call in Azure Data Factory, and if so, how can it be done?

Parthkumar Pavra 0 Reputation points
2024-06-13T06:02:22+00:00

I attempted to use the following API:


POST https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/queryPipelineRuns?api-version=2018-06-01

However, I was only able to receive data for successful, failed, and canceled pipelines. At the time of the API call, I was unable to get details of in-progress pipelines.

Azure API Management
Azure API Management
An Azure service that provides a hybrid, multi-cloud management platform for APIs.
1,940 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,144 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Smaran Thoomu 12,615 Reputation points Microsoft Vendor
    2024-06-14T04:38:08.6533333+00:00

    Hi @Parthkumar Pavra

    Thanks for the question and using MS Q&A platform.

    To fetch in-progress pipeline details via an API call in Azure Data Factory, you can use the following API:

    POST https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/queryPipelineRuns?api-version=2018-06-01
    

    However, this API only returns data for successful, failed, and canceled pipelines. At the time of the API call, you cannot get details of in-progress pipelines.

    To get details of in-progress pipelines, you can use the following API:

    POST https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/queryActivityRuns?api-version=2018-06-01
    
    

    This API returns data for all activity runs, including in-progress pipelines. You can filter the results to only show in-progress pipelines by adding the following filter to the API call:

    $filter=status eq 'InProgress'
    
    
    

    For more information, please refer: https://learn.microsoft.com/en-us/rest/api/datafactory/activity-runs/query-by-pipeline-run?view=rest-datafactory-2018-06-01&tabs=HTTP

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

  2. Parthkumar Pavra 0 Reputation points
    2024-06-17T10:54:04.5566667+00:00

    I used this URL but received a 404 error, despite ensuring that all parameters, including the access token, headers, and request body, are correct.