I am facing Error( DF-DSL-002 - Parameter stream has parsing errors.) while Mapping the Activity error message to a Dataflow component.

Question

Hi,

I am trying to populate the Error Message from a Pipeline activity to another pipeline activity which calls Dataflow activity and finally write that Error Message to a Parquet File. But I am facing error ...
Job failed due to reason: com.microsoft.dataflow.Issues: DF-DSL-002 - Parameter stream has parsing errors. Parameter(s) with errors: FAILURE_MSG. Not honoring the datatype of parameter(s) could be one of the causes.

Please let me know what should be done to resolve the issue.

Answer 1

Hi Jaganathan, NK. (Naveen Kumar),

Thank you for posting query in Microsoft Q&A Platform.

From the error message, it seems you are passing some data to dataflow parameter FAILURE_MSG, when cannot be parsed correctly. It may be due to the data which you are passing to parameter is not in correct format to parse. Make sure you are using correct data types and sending data correctly.
In your error message, if you have quotes or slashes and not needed to have them then try to replace them with empty and then pass message to parameter. If we need them then try to escape them correctly.

Also, you can consider using copy activity itself and then try to send this error message as additional column to your parquet files. Please check below video of mine to understand about additional columns in copy activity.

Add additional columns during copy in Azure Data Factory

Hope this helps. Please let me know if any further queries.

---

Please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.