Can adf pipeline level logs can be sent to data dog using streaming to event hub?

Ashwin Mohan 56

Hi there,
Is it possible to stream pipeline logs, for eg a copy activity fail log and send it to data dog by using the streaming to event hub feature ?
Is there any other way to do this?
I have understood data factory metrics can be send as-is to data dog.

MartinJaffer-MSFT 26,211 Reputation points

2021-08-13T22:54:01.033+00:00

@Ashwin Mohan did my response answer your query? If it solved your issue please mark as accepted answer. If not, please let me know how I may better assist.
Ashwin Mohan 56 Reputation points

2021-08-14T03:47:54.053+00:00

Sorry for the delayed reply.
Thanks for the answer.

Accepted answer

MartinJaffer-MSFT 26,211 Reputation points

2021-08-12T10:06:48.973+00:00

Hello @Ashwin Mohan and welcome to Microsoft Q&A.

I don't know anything about "data dog", but I do know the details you seek are under "activityRuns", and I know that the logs can be streamed to event hub. In the portal, go to your Factory, then look under "diagnostic settings". You will also want "pipelineRuns" to correlate a given copy activity instance to a specific pipeline run.
Please sign in to rate this answer.

1 person found this answer helpful.
Ashwin Mohan 56 Reputation points

2021-08-14T03:51:59.993+00:00

Thanks a ton for this.
I I used to think that activityruns as a metric, like the
count of activityruns.
Now I know, it provides the entire log insights.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Can adf pipeline level logs can be sent to data dog using streaming to event hub?

0 additional answers

Your answer