I am using Logic App standard and built in sftp connector to perform the following operation. I have a json object with SFTP folder paths. Using a parallel for-each loop, I loop in the json object to list sftp files using List folder action. Using a nested for-each, I loop in the list folder output and then read files using Get file content V2 action and pass the absolute path as input. I am getting error in 3rd step where I am trying to get the file content as it says the file was not found. which could not be true because it won't' enter the nested loop in that case. The same operations if I do with a for each loop with concurrency limit set to 1, it works. Is there any limitation to the built in connector which is causing this issue ?

Unable to download file parallelly using built in sftp connector - Get File Content Operation

Saroj Kumar 0

I am using Logic App standard and built in sftp connector to perform the following operation.

I have a json object with SFTP folder paths.
Using a parallel for-each loop, I loop in the json object to list sftp files using List folder action.
Using a nested for-each, I loop in the list folder output and then read files using Get file content V2 action and pass the absolute path as input.

I am getting error in 3rd step where I am trying to get the file content as it says the file was not found. which could not be true because it won't' enter the nested loop in that case.

The same operations if I do with a for each loop with concurrency limit set to 1, it works.

Is there any limitation to the built in connector which is causing this issue ?

MayankBargali-MSFT 68,656 Reputation points

2023-05-16T10:13:54.3533333+00:00

@Saroj Kumar Thanks for reaching out. I don't see any limitation that is documented for the inbuild SFTP connector. The error "File not found" error should observe when the file is deleted, and you are trying to access the file, or the file doesn't exist in the path that you have specified. As you have mentioned that it works when you set concurrency limit set to 1 then it should eliminate the first reason that the file is deleted, and the reason would be the file doesn't exist in the path that you have specified. It looks like you are passing the dynamic value, and can you please confirm whether you have defined any variable and using that variable to assign the path or any other configuration inside your loop as this would be only reason that you would observe this behavior as the value would be overwritten in loop running concurrently causing this behavior.

If you have validated that this is not the above case, then please share the workflow screenshot with expanding every action inside the loop so I can review it.
Saroj Kumar 0 Reputation points

2023-05-16T12:08:36.26+00:00

Hi @MayankBargali-MSFT ,

I am using just the for-loop output for downloading the files and deleting it
Below is a screenshot of the logic app, along with action inputs.

The absolute path here is an expression with value"items('For_each_file')?['absolutePath']"
Saroj Kumar 0 Reputation points

2023-05-25T13:39:25.9233333+00:00

Hi @MayankBargali-MSFT , Did you get a chance to try it out.