Error in read parquet files from extrenal storage with Synapse Analytics

Question

Error in read parquet files from extrenal storage with Synapse Analytics

Shlomi Lanton 76

Hey,

I'm using Synapse Analytics to query parquet files in blob storage. once every few queries (could be the exact same query), I get the error

Error handling external file: 'IO request completed with an error. ERROR = 0x0000000C'. File/External table name: 'https://xxxx.blob.core.windows.net/container/service_id=1111/month=10/partition_version=last/part-0.parquet'.

Note that it could be that the file is been updated while the query is running. Could it be the cause for this error? What can I do to prevent it?

Thanks

PRADEEPCHEEKATLA 90,616 Reputation points

2022-11-01T09:51:58.567+00:00
Hello @Shlomi Lanton ,

Thanks for the question and using MS Q&A platform.

Could you please confirm the below details for further investigation:

Are you quering using SQL serverless or dedicated pool?

How often you are experiencing this error message?

After you recieve this error message - does re-try works?

Please do share the screenshot of the query along with the error message which you are experiencing?
Shlomi Lanton 76 Reputation points

2022-11-02T08:51:09.737+00:00
Serverless
2+ 3. Every few queries, in most cases if I ran the query again it will pass 4. Will try to create one, but we have sensitive info in the query, I shared all the error message I got
PRADEEPCHEEKATLA 90,616 Reputation points

2022-11-07T05:34:58.887+00:00

Hello @Shlomi Lanton ,

You can hide the sentive info and share the detailed stacktrace of the error message?
PRADEEPCHEEKATLA 90,616 Reputation points

2022-11-14T09:43:47.607+00:00

Hello @Shlomi Lanton ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond with more details and we will try to help.
Anonymous

2023-06-21T12:22:58.61+00:00

DataSource.Error: <ccon>Microsoft SQL: Error handling external file: 'IO request completed with an error. ERROR = 0x0000000C'. File/External table name: 'CDM_Data/CustomerRequest/2023/06/CustomerRequest202306.parquet'. Statement ID: {E102A30C-4CDB-4047-9F5D-38F48AB10A9B} | Query hash: 0x5B237160A2994733 | Distributed request ID: {04C9F96A-4951-4268-A3F1-BB271993305E}. Total size of data scanned is 130 megabytes, total size of data moved is 70 megabytes, total size of data written is 0 megabytes.. DataSourceKind = SQL. DataSourcePath = xxxxxxxxxxxx-ondemand.sql.azuresynapse.net;Service. Message = Error handling external file: 'IO request completed with an error. ERROR = 0x0000000C'. File/External table name: 'CDM_Data/CustomerRequest/2023/06/CustomerRequest202306.parquet'. Statement ID: {E102A30C-4CDB-4047-9F5D-38F48AB10A9B} | Query hash: 0x5B237160A2994733 | Distributed request ID: {04C9F96A-4951-4268-A3F1-BB271993305E}. Total size of data scanned is 130 megabytes, total size of data moved is 70 megabytes, total size of data written is 0 megabytes.. ErrorCode = -2146232060. Number = 15813. Class = 16. </ccon>. The exception was raised by the IDbCommand interface. Table: Service Folder.
Anonymous

2023-06-21T12:25:45.31+00:00

@PRADEEPCHEEKATLA - I hope this stack trace provides the details you need. I am getting this more and more frequently. Sadly as Serverless does not allow for performance tracing, I am unsure why my View is failing. This happens on an intermittent basis, some days I never this this, some days plenty of times.

Please note that I get this error when performing a Power BI Dataset refresh against a Serverless Endpoint.
PRADEEPCHEEKATLA 90,616 Reputation points

2023-06-22T05:39:39.74+00:00

Hello @BHUDIA Dipak - Since this thread is too old, I would recommend creating a new thread on the same forum with as much details about your issue as possible. That would make sure that your issue has better visibility in the community.
Dipak Bhudia 0 Reputation points

2023-06-23T13:47:42.8433333+00:00

Hi @PRADEEPCHEEKATLA - Here is my new question link.
https://learn.microsoft.com/en-us/answers/questions/1316168/error-handling-external-file-io-request-completed

looking forward to a response the issues are still persisting.

Your answer

PRADEEPCHEEKATLA 90,616 Reputation points

2022-11-01T09:51:58.567+00:00

Hello @Shlomi Lanton ,

Thanks for the question and using MS Q&A platform.

Could you please confirm the below details for further investigation:

Are you quering using SQL serverless or dedicated pool?

How often you are experiencing this error message?

After you recieve this error message - does re-try works?

Please do share the screenshot of the query along with the error message which you are experiencing?
Shlomi Lanton 76 Reputation points

2022-11-02T08:51:09.737+00:00

Serverless
2+ 3. Every few queries, in most cases if I ran the query again it will pass 4. Will try to create one, but we have sensitive info in the query, I shared all the error message I got
PRADEEPCHEEKATLA 90,616 Reputation points

2022-11-07T05:34:58.887+00:00

Hello @Shlomi Lanton ,

You can hide the sentive info and share the detailed stacktrace of the error message?
PRADEEPCHEEKATLA 90,616 Reputation points

2022-11-14T09:43:47.607+00:00

Hello @Shlomi Lanton ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond with more details and we will try to help.
Anonymous

2023-06-21T12:22:58.61+00:00

DataSource.Error: <ccon>Microsoft SQL: Error handling external file: 'IO request completed with an error. ERROR = 0x0000000C'. File/External table name: 'CDM_Data/CustomerRequest/2023/06/CustomerRequest202306.parquet'. Statement ID: {E102A30C-4CDB-4047-9F5D-38F48AB10A9B} | Query hash: 0x5B237160A2994733 | Distributed request ID: {04C9F96A-4951-4268-A3F1-BB271993305E}. Total size of data scanned is 130 megabytes, total size of data moved is 70 megabytes, total size of data written is 0 megabytes.. DataSourceKind = SQL. DataSourcePath = xxxxxxxxxxxx-ondemand.sql.azuresynapse.net;Service. Message = Error handling external file: 'IO request completed with an error. ERROR = 0x0000000C'. File/External table name: 'CDM_Data/CustomerRequest/2023/06/CustomerRequest202306.parquet'. Statement ID: {E102A30C-4CDB-4047-9F5D-38F48AB10A9B} | Query hash: 0x5B237160A2994733 | Distributed request ID: {04C9F96A-4951-4268-A3F1-BB271993305E}. Total size of data scanned is 130 megabytes, total size of data moved is 70 megabytes, total size of data written is 0 megabytes.. ErrorCode = -2146232060. Number = 15813. Class = 16. </ccon>. The exception was raised by the IDbCommand interface. Table: Service Folder.
Anonymous

2023-06-21T12:25:45.31+00:00

@PRADEEPCHEEKATLA - I hope this stack trace provides the details you need. I am getting this more and more frequently. Sadly as Serverless does not allow for performance tracing, I am unsure why my View is failing. This happens on an intermittent basis, some days I never this this, some days plenty of times.

Please note that I get this error when performing a Power BI Dataset refresh against a Serverless Endpoint.
PRADEEPCHEEKATLA 90,616 Reputation points

2023-06-22T05:39:39.74+00:00

Hello @BHUDIA Dipak - Since this thread is too old, I would recommend creating a new thread on the same forum with as much details about your issue as possible. That would make sure that your issue has better visibility in the community.
Dipak Bhudia 0 Reputation points

2023-06-23T13:47:42.8433333+00:00

Hi @PRADEEPCHEEKATLA - Here is my new question link.
https://learn.microsoft.com/en-us/answers/questions/1316168/error-handling-external-file-io-request-completed

looking forward to a response the issues are still persisting.

Share via

Error in read parquet files from extrenal storage with Synapse Analytics

Your answer