Logic app to copy files from azure storage to onprem server fails

MarcVanderhaegen 241 Reputation points
2023-10-11T12:27:31.24+00:00

Hello,

I have a problem with a Logic App that should copy csv files from an azure storage account to an onprem server through a data gateway.
When the logic app starts, it lists the files on the azure storage and then there is a loop to get each file content and create a file on the onprem server.
I see the file being created on the share on the onprem server but they are not complete.
Each time I launch the logic app, the size of the same files being transfered is different.
Example, I would like to transfer two 16MB files, one time I have 2MB and 8MB transfered, one time I have 4MB and 4MB etc....
The files are never completely transfered.

Each run of the logic app has a status 'failed' and on each files I have the error in the step 'create file' :
{
"status": 400,
"message": "The requested action could not be completed. Check your request parameters to make sure the path '//xxxxxxxxxxxxxxxxx_20231010-153328.csv' exists on your file system.\r\nclientRequestId: 5133d7b2-57f0-43cc-860e-532e385db6a9",
"error": {
"message": "The requested action could not be completed. Check your request parameters to make sure the path '//xxxxxxxxxxxxxxxxx_20231010-153328.csv' exists on your file system."
},
"source": "filesystem-we.azconn-we-002.p.azurewebsites.net"
}

 

Does anyone have an idea what could be wrong and how solve this ?

Thanks

Marc

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,891 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Mike Urnun 9,761 Reputation points Microsoft Employee
    2023-10-11T18:10:31.66+00:00

    Hi @MarcVanderhaegen - Thanks for reaching out. The ForEach loop, by default, runs all of its iterations at the same time in parallel which I suspect might be creating more connections and workload than the OPDG & its downstream processing at your on-prem can handle at a time. In order to prevent that from happening, you can enable the Sequential run: For each: Run sequentially Could you try this out and let us know if this helps?