ADF error : DFExecutorUserError

Question

ADF error : DFExecutorUserError

Manisha Kottary 66

I have create a data flow in ADF and I am running it via a pipeline. The pipeline is validated and there are no errors. I am also able to preview all the data in the sink . But on executing the pipeline I am getting the following error :

Error code : DFExecutorUserError

Failure type : User configuration issue
Details:

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': java.sql.BatchUpdateException: Violation of PRIMARY KEY constraint 'employee_pk'. Cannot insert duplicate key in object 'dbo.employee'. The duplicate key value is (E04).","Details":"java.sql.BatchUpdateException: Violation of PRIMARY KEY constraint 'employee_pk'. Cannot insert duplicate key in object 'dbo.employee'. The duplicate key value is (E04).\n\tat shaded.msdataflow.com.microsoft.sqlserver.jdbc.SQLServerStatement.executeBatch(SQLServerStatement.java:1753)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter.executeBatchSQLs(JDBCStore.scala:457)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter.executeSQL(JDBCStore.scala:439)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter$$anonfun$executeTableOpAndPostSQLAndDDL$1.apply$mcV$sp(JDBCStore.scala:485)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter$$anonfun$executeTableOpAndPostSQLAndDDL$1.apply(JDBCStore.scala:485)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter$$anonfun$executeTableOpAndPostSQLAndDDL$1.apply(JDBCStore.scala:485)\n\tat com.microsoft.dataflow.transformers.StoreContext$.timed(Store.scala:130)\n\tat com.microsoft.dataflow.transformers.store.JDBCWriter.executeTableOpAndPostSQLAndDDL(JDBCSto"}

Mark Kromer MSFT 1,146 Reputation points

2021-06-18T16:57:46.127+00:00

This is a driver error being reported by your SQL sink because you are violating the primary key constraint. Either relax the database constraint or use "error row handling" on the Sink to handle this as an exception.

Answer accepted by question author

0 additional answers

Your answer

Mark Kromer MSFT 1,146 Reputation points

2021-06-18T16:57:46.127+00:00

This is a driver error being reported by your SQL sink because you are violating the primary key constraint. Either relax the database constraint or use "error row handling" on the Sink to handle this as an exception.

Answer 1

Nandan Hegde 36,886 MVP Volunteer Moderator

Hey,
Can you please tell us what your source and sink are ?
And based on the error message: The error is due to data issues at the source and no where related to your ADF.

Manisha Kottary 66 Reputation points

2021-06-18T10:27:11.527+00:00

Hy @Nandan Hegde ,

My source is a XML file and sink is a DB.

Thank you.
Nandan Hegde 36,886 Reputation points MVP Volunteer Moderator

2021-06-18T10:30:25.053+00:00

Search in your XML file and database for the value: E04.
At both the places you might find the value or there are might be multiple records in the XML file itslef.
This seems to be a data related issue and not ADF :)

Hope this helps!
Manisha Kottary 66 Reputation points

2021-06-18T10:32:39.047+00:00

Thank you I will look into it.
KranthiPakala-MSFT 46,827 Reputation points Moderator

2021-06-24T17:28:53.967+00:00

Hi @Manisha Kottary ,

We still have not heard back from you. Just wanted to check if the above suggestion from Nandan was helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Share via

ADF error : DFExecutorUserError

0 additional answers

Your answer