FAILED_READ_FILE error class
Error while reading file <path>
.
Could not read footer. Please ensure that the file is in either ORC or Parquet format.
If not, please convert it to a valid format. If the file is in the valid format, please check if it is corrupt.
If it is, you can choose to either ignore it or fix the corruption.
<hint>
Possible cause: Parquet column cannot be converted.
File does not exist. It is possible the underlying files have been updated.
You can explicitly invalidate the cache in Spark by running ‘REFRESH TABLE
tableName’ command in SQL or by recreating the Dataset/DataFrame involved.
If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.
Data type mismatches when reading Parquet column <column>
. Expected Spark type <expectedType>
, actual Parquet type <actualType>
.