ADF: DFExecutorUserError java.lang.NullPointerException when running data flow activity

javier 941 Reputation points
2022-10-27T03:02:24.407+00:00

Getting the following error when triggering azure data factory pipeline

"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sinkNormalizedSales': Spark job failed in one of the cluster nodes while writing data in one of the partitions to sink, with following error message: java.lang.NullPointerException","Details":null

Both sink and source are csv files

Pipeline gets result when in debug mode.

Any idea what this means and how to solve it?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
{count} votes

1 answer

Sort by: Most helpful
  1. javier 941 Reputation points
    2022-10-28T18:19:19.86+00:00

    The issue is solved. It was caused by an invalid character for the sink/output filename. thanks

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.