To create a Pipeline that generates ‘incremental’ folder names.

Question

I have the following task:
I have a Pipeline in an Azure Data factory (V2). The Pipeline contains several Copy data elements. Each of them copies data from an SQL database into an FTP folder. As a result, the Pipeline generates files like <FTPserver>/FolderName/FileNameOFCopyData1; <FTPserver>/FolderName/FileNameOFCopyData2 etc.
Now I need to improve the Pipeline to have it generate ‘incremental’ sub-folder names (‘1’, ‘2’ etc) for each run of the Pipeline. In other words, after 1st run of the Pipeline we will have the files with the following names:
<FTPserver>/FolderName/1/FileNameOFCopyData1; <FTPserver>/FolderName/1/FileNameOFCopyData2; …

After 2nd run of the Pipeline we will have the files with the following names:
<FTPserver>/FolderName/2/FileNameOFCopyData1; <FTPserver>/FolderName/2/FileNameOFCopyData2; …

The question is: how could I do this?

Answer 1

Hi there,

Closing this thread as this is a duplicate of
https://learn.microsoft.com/en-us/answers/questions/56471/to-create-a-pipeline-that-generates-incremental-fo.html.

Thanks.