@Ketan Bharat | MAQ Software - The error you’re encountering, Error code 2200, typically indicates a user configuration issue on the destination side. Specifically, the message unable to get file list for the version2 suggests that there might be a problem with accessing or listing files in the Delta Lake destination1.
Here are some potential causes and steps to troubleshoot this issue:
- File Versioning: Ensure that the Delta Lake versioning is correctly configured and that the files are accessible. Sometimes, issues can arise if the versioning is not properly set up or if there are permissions issues.
- Permissions: Verify that the service principal or managed identity used for the data transfer has the necessary permissions to access the Delta Lake files.
- Intermittent Connectivity: Since the error occurs sporadically, it might be due to intermittent connectivity issues. Check the network stability and ensure there are no disruptions during the data transfer process.
- Resource Limits: Ensure that the destination storage is not hitting any resource limits, such as storage capacity or IOPS limits, which could cause intermittent failures.
- Retry Logic: Implement retry logic in your data pipeline to handle transient errors. This can help mitigate issues caused by temporary disruptions.
- Logs and Monitoring: Enable detailed logging and monitoring to capture more information about the failures. This can help identify patterns or specific conditions under which the error occurs.
Hope this helps. Do let us know if you have any queries!
------------
If this answers your query, do click Accept Answer
and Yes
for was this answer helpful. And, if you have any further query do let us know.