dataflow delta inline - error

Question

Hi,
Do you see why I get this below error in dataflow sink?
sink is set to inline delta dataset with delete and upsert checked.
before the sink, there is alter row transformation.

......java.lang.NullPointerException...

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': java.lang.NullPointerException","Details":"java.lang.NullPointerException...

storage folder structure is as follows and so the above error:
containerName/foldername/year/month/day

If the folder structure is as follows then there is NO error
containerName/foldername/year/month/day/companyNames/companyName1
containerName/foldername/year/month/day/companyNames/companyName2
containerName/foldername/year/month/day/companyNames/companyName3
...

Thank you

Answer 1

Hello @arkiboys ,
Thanks for the question and using MS Q&A platform.

As we understand the ask here is why you are getting the error " java.lang.NullPointerException" , please do let us know if its not accurate.
It will be tough to exactly pin out the reason , but I think the files which you are reading is at containerName/foldername/year/month/day/companyNames/companyName1
and not at
containerName/foldername/year/month/day

Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators