FAILED_READ_FILE error class
Article 07/10/2024
2 contributors
Feedback
In this article
CANNOT_READ_FILE_FOOTER
DBR_FILE_NOT_EXIST
FAILED_CONVERT_PARQUET_COLUMN
FILE_NOT_EXIST
NO_HINT
PARQUET_COLUMN_DATA_TYPE_MISMATCH
Show 2 more
SQLSTATE: KD001
Error while reading file <path>
.
Could not read footer. Please ensure that the file is in either ORC or Parquet format.
If not, please convert it to a valid format. If the file is in the valid format, please check if it is corrupt.
If it is, you can choose to either ignore it or fix the corruption.
<hint>
FAILED_CONVERT_PARQUET_COLUMN
Possible cause: Parquet column cannot be converted.
File does not exist. It is possible the underlying files have been updated.
You can explicitly invalidate the cache in Spark by running ‘REFRESH TABLE tableName’ command in SQL or by recreating the Dataset/DataFrame involved.
If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.
PARQUET_COLUMN_DATA_TYPE_MISMATCH
Data type mismatches when reading Parquet column <column>
. Expected Spark type <expectedType>
, actual Parquet type <actualType>
.