How to autmatically copy the files to another folder in same storage account ?

Question

How to autmatically copy the files to another folder in same storage account ?

anil kumar 1,326

Hello,

We have a data lake with folders "Landing Zone" and "Target Zone". Whenever a new blob is added in "Landing Zone". we want that blob to be copied into "Target Zone" automatically. We know we can do that using Azure Data Factory - but is there any other way to do that ? Something like trigger on data lake/storage account to copy newly added file(s) to another container/folder. We are exploring Azcopy also.

Appreciate your insightful response. Thank you!!

HimanshuSinha-msft 18,536 Reputation points Microsoft Employee

2022-02-01T05:29:38.687+00:00

Hi @anil kumar ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
anil kumar 1,326 Reputation points

2022-02-05T11:23:45.75+00:00

Sure @HimanshuSinha-msft

I got it working today only - Will share what worked for me and mark @Samy Abdul 's response as answer.

Thank you !!
anil kumar 1,326 Reputation points

2022-02-05T11:34:05.257+00:00

Hello,

I got it working in two ways - was having issues in passing parameters.

Solution 1

Solution 2

HimanshuSinha-msft 18,536 Reputation points Microsoft Employee

2022-02-01T05:29:38.687+00:00

Hi @anil kumar ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
anil kumar 1,326 Reputation points

2022-02-05T11:23:45.75+00:00

Sure @HimanshuSinha-msft

I got it working today only - Will share what worked for me and mark @Samy Abdul 's response as answer.

Thank you !!
anil kumar 1,326 Reputation points

2022-02-05T11:34:05.257+00:00

Hello,

I got it working in two ways - was having issues in passing parameters.

Solution 1

Solution 2

Answer 1

Samy Abdul 3,016

You can schedule event based trigger as explained below:

https://www.youtube.com/watch?v=RXEHrET9dUc

https://www.cathrinewilhelmsen.net/triggers-azure-data-factory/

Logic Apps: Please go through series of videos on logic apps here:

https://www.youtube.com/watch?v=KxkiE2JC0RU&list=PLMWaZteqtEaIWwpz64BwOBytNDPka700J Thanks

anil kumar 1,326 Reputation points

2022-02-05T11:25:13.837+00:00

Thank you @Samy Abdul for your valuable time to help !!

I got it working now.

StayBlessednHappy

Answer 2

Samy Abdul 3,016

Hi @anil kumar , do you mean datafile added in to the landing zone blob? If that is the case you can use event based trigger so that as soon as file

being arrived in landing zone blob , the event based trigger can be kicked off. You can also explore logic apps to monitor the change and eventually

pipeline gets trigger when the change being takes place. Thanks

anil kumar 1,326 Reputation points

2022-01-25T12:41:33.61+00:00

Thank you @Samy Abdul for helpful response !!

Did you mean leveraging following azure services based on certain events like new blob file addition ? Exploring Logic app...

How to autmatically copy the files to another folder in same storage account ?

StayBlessednHappy

1 additional answer

Activity