dataflow delta inline - error

arkiboys 9,686 Reputation points
2022-04-21T13:33:26.68+00:00

Hi,
Do you see why I get this below error in dataflow sink?
sink is set to inline delta dataset with delete and upsert checked.
before the sink, there is alter row transformation.

......java.lang.NullPointerException...

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': java.lang.NullPointerException","Details":"java.lang.NullPointerException...

storage folder structure is as follows and so the above error:
containerName/foldername/year/month/day

If the folder structure is as follows then there is NO error
containerName/foldername/year/month/day/companyNames/companyName1
containerName/foldername/year/month/day/companyNames/companyName2
containerName/foldername/year/month/day/companyNames/companyName3
...

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,127 questions
0 comments No comments
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2022-04-22T18:41:14.857+00:00

    Hello @arkiboys ,
    Thanks for the question and using MS Q&A platform.

    As we understand the ask here is why you are getting the error " java.lang.NullPointerException" , please do let us know if its not accurate.
    It will be tough to exactly pin out the reason , but I think the files which you are reading is at containerName/foldername/year/month/day/companyNames/companyName1
    and not at
    containerName/foldername/year/month/day

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

0 additional answers

Sort by: Most helpful