Azure Synapse Analytics - Data Factory - NoSuchElementException

Question

Azure Synapse Analytics - Data Factory - NoSuchElementException

Oex 1

Error message after adding a new flatten + sink, to a previously working fine ETL...

{"message":"java.util.NoSuchElementException: None.get. Details:java.util.NoSuchElementException: None.get","failureType":"UserError","target":"ETL_XXXXX","errorCode":"DFExecutorUserError"}

Any ideas?

0 comments

1 answer

Your answer

Answer 1

KranthiPakala-MSFT 46,822 Microsoft Employee Moderator

Hi @Oexdeveloper,

Welcome to Microsoft Q&A and thanks for reaching out.

Sometimes this could be a transient issue. Could you please try rerunning your pipeline and let us know if the issue still persists. If the issue persists, please share below details for further investigation.

failed pipeline run ID?
failed activity run ID?
Data factory region?

Please let us know how it goes.

Thank you

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.

KranthiPakala-MSFT 46,822 Reputation points Microsoft Employee Moderator

2020-06-11T21:57:54.337+00:00

Hi @Oexdeveloper,

Just checking to see if you are still experiencing the issue?
KranthiPakala-MSFT 46,822 Reputation points Microsoft Employee Moderator

2020-06-15T17:47:36.957+00:00

Hi @Oex ,

Following up to see if you issue was resolved? If you still have the issue, please share details requested in my previous response.

----------

Thank you

Chaiwa 56

@KranthiPakala-MSFT I am experiencing the same error with json as source and then transform using DataFlow with Delta inline dataset to sink. Any ideas?

See attached logs.

Thanks.

22/09/11 09:40:49 ERROR ADFDataflow: Found 1 job errors  
22/09/11 09:40:49 ERROR ADFDataflow: DF-SYS-0 None.get  
java.util.NoSuchElementException: None.get  
	at scala.None$.get(Option.scala:347)  
	at scala.None$.get(Option.scala:345)  
	at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:547)  
	at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:545)  
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)  
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)  
	at com.microsoft.dataflow.FlowCode.com$microsoft$dataflow$FlowCode$$recurseLineageNode(FlowRunner.scala:545)  
	at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:548)  
	at com.microsoft.dataflow.FlowCode$$anonfun$com$microsoft$dataflow$FlowCode$$recurseLineageNode$1.apply(FlowRunner.scala:545)  
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)  
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)

Share via

Azure Synapse Analytics - Data Factory - NoSuchElementException

1 answer

Your answer