error while flattening json using data flows in synapse

Anand 0 Reputation points
2024-07-29T00:04:58.5433333+00:00

I am facing error while reading json and performing data flattening using data flow in azure synapse.

Error json_flattening {"message":"Job failed due to reason: at Sink 'sink1': Failed to execute dataflow with internal server error, please retry later. If issue persists, please contact Microsoft support for further assistance. Details:org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 4) (vm-0e533693 executor 1): ExecutorLostFailure (executor 1 exited caused by one of the running tasks) Reason: Container from a bad node: container_1722209626697_0001_01_000002 on host: vm-0e533693. Exit status: 143. Diagnostics: [2024-07-28 23:44:12.016]Container killed on request. Exit code is 143\n[2024-07-28 23:44:12.017]Container exited with a non-zero exit code 143. \n[2024-07-28 23:44:12.017]Killed by external signal\n.\nDriver stacktrace:\n\tat com.microsoft.dataflow.FileStoreExceptionHandler$.extractRootCause(FileStoreExceptionHandler.scala:36)\n\tat com.microsoft.dataflow.transformers.DefaultFileWriter.$anonfun$write$16(FileStore.scala:1203)\n\tat scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)\n\tat scala.util.Try$.apply(Try.scala:213)\n\tat com.microsoft.dataflow.transformers.DefaultFileWriter.$anonfun$write$15(FileStore.scala:1175)\n\t","failureType":"UserError","target":"json_flattening","errorCode":"DF-Executor-InternalServerError"}

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,698 questions
0 comments No comments
{count} votes