java.util.NoSuchElementException: None.get

Question

Getting below error while I am running data flow created from api.

But its working fine in debug mode.

{
"StatusCode":"DFExecutorUserError",
"Message":"Job failed due to reason: at Join 'sampleParquetazureJOIN1': None.get",
"Details":"java.util.NoSuchElementException: None.get\n\tat scala.None$.get(Option.scala:347)\n\tat scala.None$.get(Option.scala:345)\n\tat com.microsoft.dataflow.transformers.JoinPlanner$$anonfun$joinType$2.apply(Join.scala:42)\n\tat com.microsoft.dataflow.transformers.JoinPlanner$$anonfun$joinType$2.apply(Join.scala:42)\n\tat scala.util.Success$$anonfun$map$1.apply(Try.scala:237)\n\tat scala.util.Try$.apply(Try.scala:192)\n\tat scala.util.Success.map(Try.scala:237)\n\tat com.microsoft.dataflow.transformers.JoinPlanner$.joinType(Join.scala:42)\n\tat com.microsoft.dataflow.transformers.BaseJoinPlanner$$anonfun$logicalPlan$2$$anonfun$apply$11$$anonfun$apply$12.apply(BaseJoin.scala:317)\n\tat com.microsoft.dataflow.transformers.BaseJoinPlanner$$anonfun$logicalPlan$2$$anonfun$apply$11$$anonfun$apply$12.apply(BaseJoin.scala:306)\n\tat scala.util.Success.flatMap(Try.scala:231)\n\tat com.microsoft.dataflow.transformers.BaseJoinPlanner$$anonfun$logicalPlan$2$$anonfun$apply$11.apply(BaseJoin.scala:306)\n\tat com.microsoft.dataflow.transformers.BaseJoinP"
}

Answer 1

Hi KaranKampassi-5180, Thank you for posting query in Microsoft Q&A Platform.

Above error usually occurring when join condition in transformation not met or when there is a mismatch in the data types of the columns being joined. You can try to check the join condition and the data types of the columns being joined to resolve the issue.

The files or data which are getting used in debug execution and normal execution are same? If not, try with same files or data and see.

Also, kindly make sure you publish changes and then only trigger. Because trigger runs always takes only published changes.

Hope this helps. Please let me know it goes or if any further queries.

---

Please consider hitting Accept Answer button. Accepted answers help community as well.