org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 7.0 failed 4 times, most recent failure: java.lang.NoClassDefFoundError: Could not initialize class

Rajaniesh Kaushikk 476 Reputation points
2020-06-23T23:20:13.487+00:00

Hi,

I am getting this error despite defining the class. When I execute the notebook first time it works fine but when I execute the same notebook without code change it started throwing this error. As per the error class not defined but trust me class is already defined.

Not sure how to resolve this issue?

org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 7.0 failed 4 times, most recent failure: Lost task 0.3 in stage 7.0 (TID 10, 10.139.64.4, executor 1): java.lang.NoClassDefFoundError: Could not initialize class

Regards
Rajaniesh

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,072 questions
{count} votes