Azure Pipeline Filter Activity

Question

Hi, How do I get Copy Data activity that inside a Foreach loop to copy the folders that have ben filtered by a Filter Activity as @item().name is just capturing the name of the folders and not the contents?

Answer 1

Hi @COG ,

Thank you for posting query in Microsoft Q&A Platform.

From your ask and screenshots I understand it as correctly you are fetching folder names using GetMetaData activity and Filtering desired folder names using Filter activity and then looping those folders using ForEach activity. Inside ForEach activity using Cop activity. Now you want to make sure this copy activity to copy all parquet files data inside that folder. Please correct me if I am wrong by sharing more details.

In the wild card path you can consider mentioning *.parquet at the end to copy all data from that folder.

For your better idea please check below screenshot.

Hope this helps. Please let us know if any further queries.

------------------

Please consider hitting Accept Answer button. Accepted answers helps community as well.