Can adf pipeline level logs can be sent to data dog using streaming to event hub?

Ashwin Mohan 56 Reputation points
2021-08-11T09:14:40.33+00:00

Hi there,
Is it possible to stream pipeline logs, for eg a copy activity fail log and send it to data dog by using the streaming to event hub feature ?
Is there any other way to do this?
I have understood data factory metrics can be send as-is to data dog.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,704 questions
{count} votes

Accepted answer
  1. MartinJaffer-MSFT 26,036 Reputation points
    2021-08-12T10:06:48.973+00:00

    Hello @Ashwin Mohan and welcome to Microsoft Q&A.

    I don't know anything about "data dog", but I do know the details you seek are under "activityRuns", and I know that the logs can be streamed to event hub. In the portal, go to your Factory, then look under "diagnostic settings". You will also want "pipelineRuns" to correlate a given copy activity instance to a specific pipeline run.

    122742-image.png

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful