Azure Synapse Analytics - Data Factory - NoSuchElementException

Oex 1

Error message after adding a new flatten + sink, to a previously working fine ETL...

{"message":"java.util.NoSuchElementException: None.get. Details:java.util.NoSuchElementException: None.get","failureType":"UserError","target":"ETL_XXXXX","errorCode":"DFExecutorUserError"}

Any ideas?

1 answer

KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2020-06-10T19:35:36.37+00:00
Hi @Oexdeveloper,

Welcome to Microsoft Q&A and thanks for reaching out.

Sometimes this could be a transient issue. Could you please try rerunning your pipeline and let us know if the issue still persists. If the issue persists, please share below details for further investigation.

failed pipeline run ID?

failed activity run ID?

Data factory region?

Please let us know how it goes.

Thank you

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.
Please sign in to rate this answer.
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2020-06-11T21:57:54.337+00:00

Hi @Oexdeveloper,

Just checking to see if you are still experiencing the issue?

KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2020-06-15T17:47:36.957+00:00

Hi @Oex ,

Following up to see if you issue was resolved? If you still have the issue, please share details requested in my previous response.

----------

Thank you

Chaiwa 51 Reputation points

2022-09-11T10:05:59.713+00:00

@KranthiPakala-MSFT I am experiencing the same error with json as source and then transform using DataFlow with Delta inline dataset to sink. Any ideas?

See attached logs.

Thanks.

22/09/11 09:40:49 ERROR ADFDataflow: Found 1 job errors 22/09/11 09:40:49 ERROR ADFDataflow: DF-SYS-0 None.get java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:347) at scala.None$.get(Option.scala:345) at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:547) at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:545) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at com.microsoft.dataflow.FlowCode.com$microsoft$dataflow$FlowCode$$recurseLineageNode(FlowRunner.scala:545) at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:548) at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:545) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
Sign in to comment