Logic app to copy files from azure storage to onprem server fails

Question

Hello,

I have a problem with a Logic App that should copy csv files from an azure storage account to an onprem server through a data gateway.
When the logic app starts, it lists the files on the azure storage and then there is a loop to get each file content and create a file on the onprem server.
I see the file being created on the share on the onprem server but they are not complete.
Each time I launch the logic app, the size of the same files being transfered is different.
Example, I would like to transfer two 16MB files, one time I have 2MB and 8MB transfered, one time I have 4MB and 4MB etc....
The files are never completely transfered.

Each run of the logic app has a status 'failed' and on each files I have the error in the step 'create file' :
{
"status": 400,
"message": "The requested action could not be completed. Check your request parameters to make sure the path '//xxxxxxxxxxxxxxxxx_20231010-153328.csv' exists on your file system.\r\nclientRequestId: 5133d7b2-57f0-43cc-860e-532e385db6a9",
"error": {
"message": "The requested action could not be completed. Check your request parameters to make sure the path '//xxxxxxxxxxxxxxxxx_20231010-153328.csv' exists on your file system."
},
"source": "filesystem-we.azconn-we-002.p.azurewebsites.net"
}

 

Does anyone have an idea what could be wrong and how solve this ?

Thanks

Marc

Answer 1

Hi @MarcVanderhaegen - Thanks for reaching out. The ForEach loop, by default, runs all of its iterations at the same time in parallel which I suspect might be creating more connections and workload than the OPDG & its downstream processing at your on-prem can handle at a time. In order to prevent that from happening, you can enable the Sequential run: For each: Run sequentially Could you try this out and let us know if this helps?