Share via

data factory error

arkiboys 9,711 Reputation points
2023-12-19T14:45:06.7733333+00:00
Helo,
I get an error when I try to write into the storage account:
Job failed due to reason: com.microsoft.dataflow.Issues: DF-DSL-002 - Parameter stream  has parsing errors
Parameter(s) with errors: p_error_message. Not honoring the datatype of parameter(s) could be one of the causes.

pipeline flow:
copy_1 (On failure) --> v_error_message --> dataflow_1 

dataflow_1 has parameter: p_error_message which is being assigned as follows:
p_error_message --> @variables('v_error_message')

The error happens in dataflow_1 with the above error message:

I have checked all parameters and they are all as string
I believe I have narrowed down the cause which seems to be the actual text in v_error_message
-----------------------------------------------------------------------------------------------
copy_1 output error is as follows:
"errors": [
		{
			"Code": 23353,
			"Message": "Failure happened on 'Source' side. ErrorCode=RestCallFailedWithClientError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Rest call failed with client error, status code 404 NotFound, please check your activity settings.\nRequest URL: https:/x-1.xxxx.aaaaa.com/api/xyz/(updatedTimeStamp%20eq%202023-12-18%20OR%20(myDate%20gt%202023-11-19%20and%20myDate%20lt%202023-12-19))%20and%20buy_Sell%20eq%20'Sell'%20and%20sxxxx%20in%20('xxx/xxx/xxx/xxx',%20'xxx/xxx/xxx/xxx')%20and%20txxx%20eq%20'xxx'%20%20and%20xxxx%20in%20('xx.xxx',%20'xx.xxx.xx')%20and%20product%20eq%20'xxxx'%20and%20cxxx%20in('xxx-sss',%20'aaa').\nResponse: ,Source=Microsoft.DataTransfer.ClientLibrary,'",
			"EventType": 0,
			"Category": 5,
			"Data": {
				"FailureInitiator": "Source"
			},
...
---------------------------------------------------------------------------------------------------

v_error_message has the following expression: 
@replace(replace(activity('download Physical_split').error.Message, '''', ' '), '%', '')
---------------------------------------------------------------------------------------------------

Any suggestions how the variable expresion should be so that the dataflow_1 does not cause an error?

Thank you

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

0 comments No comments

Answer accepted by question author

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator
2023-12-20T06:46:13.22+00:00

Hi arkiboys,

Thank you for posting your query in Microsoft Q&A Platform.

It seems you are trying to replace single quote with space. Try to do that by creating a variable called singleQuote and having default value as ' and then use that singleQuote variable in the replace function. Also, when we pass some string with single quotes and slash to dataflow parameter, we generally end up with such errors. Try unchecking Expression Check Box in dataflow activity, under settings tab where you are passing value.

Hope this helps. If not, kindly share what string exactly you are passing to dataflow, so that I can try at my end and help better.


Please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.

Was this answer helpful?

1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.