Issue with resourceFiles Property in Azure Data Factory Pipeline: "Total size of resourceFiles is using 141% of available space after processing"

Question

Hello,

I'm encountering an issue with Azure Batch related to the resourceFiles property in one of my pipelines. Despite verifying that the File Storage Size in the associated App Service Plan is only 7% of the available 10 GB, I'm receiving an error indicating that the total size of resourceFiles is using 141% of the available space after processing.

Here are the details of the error:

• Error Code: InvalidPropertyValue
• Error Message: "The value provided for one of the properties in the request body is invalid."
• Batch Error Code: InvalidPropertyValue
• Batch Error Message: "Total size of resourceFiles is using 141% of available space after processing."
• Effective Integration Runtime: AutoResolveIntegrationRuntime

Could someone help me understand why this error is occurring despite the low storage usage and how I can resolve this issue?

Thank you!

Answer 1

Hello @Sandeep Kumar Valluri

The error message you received indicates that the total size of resourceFiles is using 141% of the available space after processing, even though you have verified that the File Storage Size in the associated App Service Plan is only 7% of the available 10 GB.

This error can occur if the total size of the resourceFiles property exceeds the available space in the storage account. Even though the storage account may have enough space, the resourceFiles property may be using more space than expected due to the way it is processed.

To resolve this issue, you can try reducing the size of the resourceFiles property by removing unnecessary files or compressing them. You can also try increasing the available space in the storage account by upgrading the App Service Plan or creating a new storage account with more space.

This should help you.