Databricks and CDM folder connectivity error - java.lang.NoClassDefFoundError: org/apache/spark/sql/sources/v2/ReadSupport

Question

Connecting Databricks to CDM folder issue -java.lang.NoClassDefFoundError: org/apache/spark/sql/sources/v2/ReadSupport

Answer 1

Hello @prathap adicherla ,
Did you already have a support case with Microsoft? If yes, could you please share the support case number for our tracking purposes?

I see you are using a Neo4J spark connector. This blog explains the root cause and solution that you are facing the error

Please try the below solution and let us know if you have any further questions.

Root cause:
It could be an incompatible connector, or you built it yourself.

Solution:

Remove all existing neo4j_connector jars from the Databricks UI.

Add the relevant jar that matches both the Spark & Scala runtimes. You don’t need to compile it yourself. Instead, you can download the artifact from here: https://github.com/neo4j-contrib/neo4j-spark-connector/releases

------------------------------

• Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators