How to use multiple wildcard (filename extensions) to pick files in ADF?

Question

I have requirement to move files from share path to SFTP using ADF.

Source location have multiple files with extensions like .json, .txt, .xml, .xls, .pdf

But I need to pick only .json, .xml and .xls files alone?

Is there any way to use multiple wilcard?

Answer 1

Hi @KANNIBALA MISKIN KANNISAH ,

Welcome to Microsoft Q&A platform and thanks for posting your question here.

As I understand your ask, you want to know if there is any way to use multiple wildcards in copy activity to copy multiple file formats at the same time. Please correct me if I am wrong.

There is no option to use multiple wildcards , however , you can use Filter activity to check for the availibility of multiple file formats using expressions like @or(contains(item().name,'.json'),contains(item().name,'.txt'),contains(item().name,'.xml')) as per your requirement

In the following video, I have tried to reproduce your case by trying to filter out .json and .csv format.

• Use Get Metadata activity to get the files and folders within the container
• Use Filter activity to filter out the needed file formats.
• Use ForEach activity to iterate through the files
• Inside foreach, use copy activity and select wildcard option and provide '*' as the fileName . In the sink dataset, create a parameter for fileName and provide '@item().name' as the value for the parameter.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Answer 2

Hey,
Based on my understanding you cannot use multiple wildcard characters in copy activity.
You might have to create 3 separate copy activities or iterate over the wild card characters in for each.

@AnnuKumari-MSFT : Can you please confirm on this