The issue is solved. It was caused by an invalid character for the sink/output filename. thanks
ADF: DFExecutorUserError java.lang.NullPointerException when running data flow activity
javier
941
Reputation points
Getting the following error when triggering azure data factory pipeline
"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sinkNormalizedSales': Spark job failed in one of the cluster nodes while writing data in one of the partitions to sink, with following error message: java.lang.NullPointerException","Details":null
Both sink and source are csv files
Pipeline gets result when in debug mode.
Any idea what this means and how to solve it?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions