Wild cards http

Question

I am creating an data factory pipeline to get file of same name through different http links. As the name of the http is almost same and only date is changed. Thus I am using wild card for that. But it isnt working. Is their any way to get these historical files. Thanks

HTTP: https://www.fsis.usda.gov/sites/default/files/media_file/2021-11/MPI_Directory_by_Establishment_Name_0.xls
with wildcard in source: https://www.fsis.usda.gov/sites/default/files/media_file/2021-??/MPI_Directory_by_Establishment_Name_0.xls

Answer 1

Hi @HassanWaseem-7729 ,

Welcome to Microsoft Q&A Forum and thanks for reaching out.

Unfortunately, you cannot use the wild card in HTTP connector URL.

Workaround may be you will have to parameterize the URL and pass the parameters values for dates dynamically. Basically you will have to get the list (array) of dates you need to pass to the URL and have a ForEach activity and pass the array list and loop through each item to get the desired data.

But if you have any feedback to improve the product, I would recommend you to please submit your request in Azure feedback forum here: https://feedback.azure.com/d365community

All the feedback shared in this forum are actively monitored and reviewed by relevant product team. Also please do share the link once the feedback is provided so that we can share it with relevant teams.

Hope this info helps. Do let us know if you have further query.

----------

• Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators