What does ADF SSIS Error "Disk Full Exception Caught" mean

Cedric Ahlers 55

Hi,

we are running an Azure-SSIS Type Integration Runtime in Azure Data Factory. This morning this IR suddenly got Unavailable for some reason. Fortunately we had the Diagnostic Settings ADFSSISIntegrationRuntimeLogs enabled and I found the following logged Message:

source: AgentLog
issueCode: 10002
detail: Disk Full Exception Caught
parameters: null
time: 2024-09-25T03:29:06.9671206+00:00

Unfortunately I wasn't able yet to find some more detailed information about this type of error neither inside other Diagnostic Settings nor online. I was wondering what Disk was meant by this, our SKU is D8_v3 providing just 200 GB of temporary storage and I could see any additional disks configured - or does it mean some DB Storage?

Does someone can explain this error in more detail and perhaps even know how to troubleshoot his.

Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-09-27T19:02:44.2066667+00:00

Hi @Cedric Ahlers

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

I'm just reaching out to see if your issue has been resolved. If you have found a solution, kindly share it with the community as it might benefit others. If not, please provide more details, and we'll do our best to assist you.

Thank you.
Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-09-30T17:00:12.1633333+00:00

Hi @Cedric Ahlers

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you.
Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-10-01T19:12:02.81+00:00

Hi @Cedric Ahlers

Just wanted to follow up and see if you have had a chance to review the last message. If you have found a solution, it would be great if you could share it with the community to help others. If not, please let us know, and we'll provide further assistance.

Thank you.
Cedric Ahlers 55 Reputation points

2024-10-02T16:17:27.21+00:00

Hi @Chandra Boorla we were able to "fix" the issue itself by restarting the Azure SSIS-IR. However, I still want to find out more about this error to fix the root cause and avoid running into this again.
Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-10-05T01:33:45.2433333+00:00

Hi @Cedric Ahlers

Just checking in to confirm if the information shared above addressed your query.

Thank you.
Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-10-08T18:03:36.3033333+00:00

Hi @Cedric Ahlers

Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Thank you.

Accepted answer

Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-10-04T02:09:31.9466667+00:00
Hi @Cedric Ahlers

Glad to know that your issue got resolved.

I still want to find out more about this error to fix the root cause and avoid running into this again.

The "Disk Full Exception Caught" error in Azure Data Factory (ADF) when running SQL Server Integration Services (SSIS) packages typically indicates that the disk space on the machine where the SSIS package is being executed has been exhausted. This error usually occurs because the SSIS package operations require more disk space than is available.

Here are some potential root causes for this error:

Insufficient Disk Space: The most common reason is simply that the disk does not have enough free space to accommodate the operations being performed by the SSIS package. This can happen if the SSIS package involves large data transfers, large temporary files, or extensive logging.

Temporary Files: SSIS packages often create temporary files during execution. If these temporary files are large or numerous, they can quickly fill up the available disk space.

Data Size: If the SSIS package is processing a large amount of data, the intermediate steps might generate large temporary datasets that consume significant disk space.

Logging: If extensive logging is enabled in the SSIS package, the log files themselves can consume a lot of disk space, especially if the package runs for a long time or processes a large volume of data.

Other Processes: Other processes running on the same machine might also be consuming disk space, leaving insufficient space for the SSIS package operations.

For more details, please refer this document which might helps you.

Link: Troubleshoot package execution in the SSIS integration runtime.

I hope this information helps, please do let us know if you have any further queries.

Thank you.
Please sign in to rate this answer.
Cedric Ahlers 55 Reputation points

2024-10-06T17:38:25.3833333+00:00

Hi @Chandra Boorla , thanks for your answer! This helps to understand whats going on! However, I would like to ask some follow-up questions you may be able to answer too, but I think therefore it would be handy to have your commented answer as a real "answer" in this FAQ - could you repost it as a answer instead of a comment? I tried to do this for you but it was automatically deleted due to automated repost detection.

Erland Sommarskog 112.7K Reputation points MVP

2024-10-06T18:12:09.5766667+00:00

As a moderator, I have converted Chandra Boorla's comment to an answer, so that you can accept it as an answer.

I see that you attempted to repost Chandra's comment as an answer, but this attempt fell prey to the spam filter of the site.

Chandra Boorla 2,680 Reputation points Microsoft Vendor

2024-10-07T12:24:10.89+00:00

Hi @Cedric Ahlers

Thank you @ Erland Sommarskog for converting.

Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Cedric Ahlers 55 Reputation points

2024-10-09T13:55:01.8733333+00:00

Hi @Erland Sommarskog thanks for converting this!

@Chandra Boorla thanks again for you help! Your answer helped me out! Just one question left - do you know if it's possible to attach additional data disks to an Azure SSIS-IR or is the the available storage limited to the temp disk size of the SKU ?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

3 additional answers

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
1 deleted comment

Comments have been turned off. Learn more
Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
1 deleted comment

Comments have been turned off. Learn more
Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more

Share via

What does ADF SSIS Error "Disk Full Exception Caught" mean

3 additional answers

Your answer