Copy file from one storage to another using file name timestamp (Specifically yesterday file)

Venkatesh Srinivasan 86

Nov 11, 2021, 6:08 PM

Hi,

I'm new to ADF, Just wondering how to copy file using filename (timestamp) especially yesterday timestamp basically previous date file.

My file name will be like : 21102531021_152fced6.xml

Please help me out here.

Thanks in advance.

Venkatesh Srinivasan 86 Reputation points

Nov 12, 2021, 10:13 AM

@HimanshuSinha-msft Could you please help me with this?

This is my dynamic content expression using to read the file name --- @markus.bohland@hotmail.de (formatDateTime(adddays(utcnow(),-1),'yymmddhhmmtt'),'_','.xml')

Note: Daily I will get the n numbers of file to my storage, I need to pick only yesterday's file.
ShaikMaheer-MSFT 38,516 Reputation points Microsoft Employee

Nov 23, 2021, 3:35 PM

Hi @Venkatesh Srinivasan ,

Just checking in to see if the below answer helped. If this answers your query, do click and upvote for the same. And, if you have any further query do let us know.
ShaikMaheer-MSFT 38,516 Reputation points Microsoft Employee

Nov 25, 2021, 9:00 AM

Hi @Venkatesh Srinivasan ,

Following to see if the below answer helped. If this answers your query, do click
Image is no longer available.
and upvote
Image is no longer available.
for the same. And, if you have any further query do let us know.

Accepted answer

ShaikMaheer-MSFT 38,516 Reputation points Microsoft Employee

Nov 12, 2021, 1:51 PM
Hi @Venkatesh Srinivasan ,

Thank you for posting query in Microsoft Q&A Platform.

You should consider having your wildcard file name as 2147110147_*.xml so that all files with that date will be copied.

Below expression helps you to get your wild file name as above.
@concat(formatDateTime(adddays(utcnow(),-1),'yymmddhhmm'),'_','*.xml')

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

Want a reminder to come back and check responses? Here is how to subscribe to a notification

If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
Please sign in to rate this answer.
Venkatesh Srinivasan 86 Reputation points

Nov 12, 2021, 1:59 PM

Hi @ShaikMaheer-MSFT thanks for your response.

I just want to clarify something more here. I need to ignore the minutes, hours and seconds from the expression. Because I cant validate the time.

Is there any way to skip only time in format expression? Now the expression is checking the utcnow() both date and time. so i cant fetch the file.

Please need your advice. Thanks in advance!

Venkatesh Srinivasan 86 Reputation points

Nov 12, 2021, 2:02 PM

please check my input format below

Input
{
"source": {
"type": "XmlSource",
"storeSettings": {
"type": "AzureBlobStorageReadSettings",
"recursive": true,
"wildcardFolderPath": "inews",
"wildcardFileName": "2111110154_*.xml",
"enablePartitionDiscovery": false
},

ShaikMaheer-MSFT 38,516 Reputation points Microsoft Employee

Nov 22, 2021, 5:08 AM

@Venkatesh Srinivasan , you can try modifying above answered expression as below and see.
@concat(formatDateTime(adddays(utcnow(),-1),'yymmdd'),'*_','*.xml')
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer

Share via

Copy file from one storage to another using file name timestamp (Specifically yesterday file)

0 additional answers

Your answer