ADF - Getting the error message of a previous activity

Question

ADF - Getting the error message of a previous activity

Kothai Ramanathan 946 Microsoft Employee

I have a pipeline with activities like this.

When the copy activity fails, I want to use the error message of the copy activity, and set it in the error variable. How do I get the error message of the copy activity - in the set variable activity for the error message.

Any pointers will be helpful, thanks

nweinric 6 Reputation points

2021-07-22T17:23:07.55+00:00

This needs to be answered.
Hemanthakumara Nanjundegowda 1 Reputation point

2022-09-16T08:03:59.317+00:00

Error details
Error code
InvalidTemplate
Troubleshooting guide
Failure type
User configuration issue
Details
The expression 'activity('Copy data1').output.error' cannot be evaluated because property 'error' doesn't exist, available properties are 'dataRead, dataWritten, sourcePeakConnections, sinkPeakConnections, rowsRead, rowsCopied, copyDuration, throughput, errors, effectiveIntegrationRuntime, usedDataIntegrationUnits, billingReference, usedParallelCopies, executionDetails, dataConsistencyVerification, durationInQueue'.
Source
Pipeline
pl_ice_eus_ingest_maclist_ice_postgre_oltp
How helpful or unhelpful was this error message?

8 answers

Your answer

nweinric 6 Reputation points

2021-07-22T17:23:07.55+00:00

This needs to be answered.
Hemanthakumara Nanjundegowda 1 Reputation point

2022-09-16T08:03:59.317+00:00

Error details
Error code
InvalidTemplate
Troubleshooting guide
Failure type
User configuration issue
Details
The expression 'activity('Copy data1').output.error' cannot be evaluated because property 'error' doesn't exist, available properties are 'dataRead, dataWritten, sourcePeakConnections, sinkPeakConnections, rowsRead, rowsCopied, copyDuration, throughput, errors, effectiveIntegrationRuntime, usedDataIntegrationUnits, billingReference, usedParallelCopies, executionDetails, dataConsistencyVerification, durationInQueue'.
Source
Pipeline
pl_ice_eus_ingest_maclist_ice_postgre_oltp
How helpful or unhelpful was this error message?

Answer 1

Vaibhav Chaudhari 38,916 Volunteer Moderator

Try to set below in set variable dynamic expression

@activity('Copy to destination').output.errors[0].Message

Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

Kothai Ramanathan 946 Reputation points Microsoft Employee

2020-12-22T03:40:46.277+00:00

Thanks @Vaibhav Chaudhari for the details. However I get the below error :

The expression 'activity('Copy to destination').output.errors[0].Message' cannot be evaluated because property 'errors' doesn't exist, available properties are ''.
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-22T12:07:59.033+00:00
Hi @Kothai Ramanathan ,

I was able to access the error message from copy activity as below and assign it to a variable as below. Please suggest if you are able to see errors in output of copy activity.

@activity('Copy data1').output.errors[0].Message

Output:
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-24T06:29:26.217+00:00
Hi @Kothai Ramanathan ,

We have not received a response from you. Please suggest if above suggested approach from @Vaibhav Chaudhari is helpful. Otherwise, let us know and we will continue to engage with you on the query.

---

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-28T12:34:20.447+00:00

Hi @Kothai Ramanathan ,

We still have not heard back from you. Following up to check if above suggested approach is helpful. Otherwise, let us know and we will continue to engage with you on the query.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.
saivamsisudheer 1 Reputation point

2021-11-10T12:44:10.937+00:00

Use Coalesce() to read output error message as a best practice.

https://learn.microsoft.com/en-us/azure/data-factory/data-flow-expression-functions#coalesce

The above link can help

Answer 2

Ryan Abbey 1,186

@activity('Copy to destination').error?.message

You will get a failure when there is no "error" output so the "?" says to set if it exists

Answer 3

Vinodh247 34,661 MVP Volunteer Moderator

Below is the correct pipeline expression that has to be provided to track the error message. The expressions that are provided in the above answers are wrong and doesn't work.

@activity('Execute Pipeline1').error.Message

Answer 4

Diponkar Paul 1

Hi Vaibhav,
I tried your answer but I get this error. My code is: @activity('DF_AAAAA').Output.errors[0].Message and passing this to store procedure. Please note that, my previous activity is data flow.

Fluna 21 Reputation points

2023-07-26T21:09:44.1166667+00:00

https://learn.microsoft.com/en-us/azure/data-factory/how-to-send-email#add-dynamic-messages-with-system-variables-and-expressions

Answer 5

Nasreen Akter 10,811 Volunteer Moderator

Hi @Diponkar Paul & @Kothai Ramanathan ,

Please try the following:

to get the error message from DataFlow Activity: @activity('DataFlow').error.Message
to get the error message from CopyActivity: @activity('CopyData').output.errors[0].Message

Thanks!

Diponkar Paul 1 Reputation point

2021-02-05T17:37:16.143+00:00

Hi Nasreen,
Unfortunately this doesn't work, I found this error:
Nasreen Akter 10,811 Reputation points Volunteer Moderator

2021-02-05T17:50:02.37+00:00

Hi @Diponkar Paul , did you connect your SetVariable with previous Activity Failed action? Would you please give a screenshot of your pipeline, it would be easier for me to understand what you are trying to achieve. Thanks!
Diponkar Paul 1 Reputation point

2021-02-05T23:14:57.097+00:00

Hi Nasreen,
Thanks, I don't have set variable. Return result from DF is passing through Store procedure parameter. And I got return result from DF like @activity('DF_AAA').ExecutionDetails which works fine but not the error message. I have tried both @activity('DF_AAA').Output.error.Message and @activity('DF_AAA').error.Message, both got same error message.
Nasreen Akter 10,811 Reputation points Volunteer Moderator

2021-02-06T01:45:25.873+00:00

Hi @Diponkar Paul , if you connect your Dataflow and SP with Failure link (please see the screenshot below), you will get the error message from @activity('DataFlow').error.Message. Thanks!
Diponkar Paul 1 Reputation point

2021-02-08T20:15:07.723+00:00

Thanks, Nasreen. In that case I have to create separate store procedure to pass error message. Currently I am getting all execution related log through this SP. But I understand your point, if it's error related then error message will only generate when there is failure.
Dinesh 1 Reputation point

2021-11-19T03:50:19.783+00:00

ErrorMessage:”@activity(‘executive pipeline1’).error.Message

I tried it’s getting failed
Dinesh 1 Reputation point

2021-11-19T04:00:03.6+00:00

That’s the error I am getting. Please help me out.

Share via

ADF - Getting the error message of a previous activity

8 answers

Your answer