getting error Incompatible format detected in databricks

shaik sarfaraj 21 Reputation points
2022-07-11T06:41:19.59+00:00

Earlier we were used the same code for our files, at that time there was no issue with that.
we were trying to use xlxs file and load it into another folder in adls by using delta format (destination). but it's not picking the source file, I'm getting error at source stage only.
from the past three days while I'm trying to execute the code it's throwing error. it's showing "A transaction log for Databricks Delta was found at abfss://******@********.dfs.core.windows.net//_delta_log"

I'm assuming that is that a cluster issue!

copy of error attached to this query, kindly find it.
219621-image.png

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha 19,527 Reputation points Microsoft Employee Moderator
    2022-07-11T21:19:26.657+00:00

    Hello @shaik sarfaraj ,
    Thanks for the question and using MS Q&A platform.

    As we understand the ask here is how to get rid of the , please do let us know if its not accurate.
    The code which you have shared , you are trying to read the a Excel file and the error says "A transaction log for Databricks Delta was found at abfss://******@********.dfs.core.windows.net//_delta_log" . You have not shared the full code , but i am inclined to beleive that "filename" variable is not set correctly .
    To me if nothing has changed from the code , then the location of the files are not correct , I suggest you to check that .

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.