Azure Log Analytics recursion - Get parent (or parent's parent) pipeline info for Activity in Data Factory

John Aherne 511 Reputation points
2020-09-18T16:09:04.547+00:00

I have a number of data factories hooked up to a log analytics workspace.
Currently I am creating a outage dashboard that looks at failed activities. I would like to show the initiating pipeline in this report for activities that failed. However, that initial pipeline could be 0 to 4 levels above the pipeline with the failed activity.
e.g. Pipeline1(activities) calls Pipeline2(activities) calls Pipeline3(Failed Activity) - Show details for Pipeline1 in the report.

Is there a way to recursively traverse up the tree in log analytics?

Thanks!

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,285 questions
Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
1,824 questions
{count} votes

1 answer

Sort by: Most helpful
  1. olufemia-MSFT 2,781 Reputation points
    2020-09-25T23:25:35.737+00:00

    @John Aherne - Kusto Query Language (KQL) doesn't have native "tree-like" structures that will make this feasible but there may be a creative alternative especially if the maximum depth is known. For this, the feature owner recommends top-nested operator as a starting point. Will continue to investigate on my end.

    Have a good weekend.

    28416-topnstdops.png

    No comments