What does ADF SSIS Error "Disk Full Exception Caught" mean

Cedric Ahlers 35 Reputation points
2024-09-25T10:26:26.61+00:00

Hi,

we are running an Azure-SSIS Type Integration Runtime in Azure Data Factory. This morning this IR suddenly got Unavailable for some reason. Fortunately we had the Diagnostic Settings ADFSSISIntegrationRuntimeLogs enabled and I found the following logged Message:

source: AgentLog
issueCode: 10002
detail: Disk Full Exception Caught
parameters: null
time: 2024-09-25T03:29:06.9671206+00:00

Unfortunately I wasn't able yet to find some more detailed information about this type of error neither inside other Diagnostic Settings nor online. I was wondering what Disk was meant by this, our SKU is D8_v3 providing just 200 GB of temporary storage and I could see any additional disks configured - or does it mean some DB Storage?

Does someone can explain this error in more detail and perhaps even know how to troubleshoot his.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,692 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,578 questions
{count} votes

4 answers

Sort by: Most helpful
  1. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

    1 deleted comment

    Comments have been turned off. Learn more

  2. Hazel james 0 Reputation points
    2024-09-30T17:04:41.1733333+00:00

    Hi Cedric,

    The "Disk Full Exception Caught" error usually indicates that the temporary storage (in your case, the 200 GB provided by the D8_v3 SKU) has reached its capacity. This could happen during high-intensity data processing. To troubleshoot, you could monitor the disk usage and consider increasing the available storage or cleaning up temporary files regularly. If the issue persists, reviewing the integration runtime's activity and logs for more specific resource usage may provide additional insights.


  3. Chandra Boorla 1,965 Reputation points Microsoft Vendor
    2024-10-04T02:09:31.9466667+00:00

    Hi @Cedric Ahlers

    Glad to know that your issue got resolved.

    I still want to find out more about this error to fix the root cause and avoid running into this again.

    The "Disk Full Exception Caught" error in Azure Data Factory (ADF) when running SQL Server Integration Services (SSIS) packages typically indicates that the disk space on the machine where the SSIS package is being executed has been exhausted. This error usually occurs because the SSIS package operations require more disk space than is available.

    Here are some potential root causes for this error:

    1. Insufficient Disk Space: The most common reason is simply that the disk does not have enough free space to accommodate the operations being performed by the SSIS package. This can happen if the SSIS package involves large data transfers, large temporary files, or extensive logging.
    2. Temporary Files: SSIS packages often create temporary files during execution. If these temporary files are large or numerous, they can quickly fill up the available disk space.
    3. Data Size: If the SSIS package is processing a large amount of data, the intermediate steps might generate large temporary datasets that consume significant disk space.
    4. Logging: If extensive logging is enabled in the SSIS package, the log files themselves can consume a lot of disk space, especially if the package runs for a long time or processes a large volume of data.
    5. Other Processes: Other processes running on the same machine might also be consuming disk space, leaving insufficient space for the SSIS package operations.

    For more details, please refer this document which might helps you.

    Link: Troubleshoot package execution in the SSIS integration runtime.

    I hope this information helps, please do let us know if you have any further queries.

    Thank you.


  4. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.


    Comments have been turned off. Learn more

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.