Copy Data From Azure Blob Storage to AWS S3 using Data Factory

Question

Copy Data From Azure Blob Storage to AWS S3 using Data Factory

Imran Mondal 246

I am new to Azure Data Factory and have an interesting requirement.

I need to move files from Azure Blob storage to Amazon S3, ideally using Azure Data Factory.

However, S3 isn't supported as a sink;

I also understand from a variety of comments I've read on here that you cannot directly copy from Blob Storage to S3 - you would need to download the file locally and then upload it to S3. is that understanding correct.

Does anyone know of any examples, in the Data Factory that can do such a thing?

1 answer

Your answer

Answer 1

HimanshuSinha-msft 19,486 Microsoft Employee Moderator

Hello @Imran Mondal ,

Thanks for the ask and using the Microsoft Q&A platform .
Just wanted you to point you to this thread , i think its the exact ask .

Please do let me know how it goes .
Thanks
Himanshu
Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

Imran Mondal 246 Reputation points

2021-05-26T09:05:40.877+00:00

Hi @HimanshuSinha-msft

Thank you for your reply, unfortunately, I am unable to open this link you shared. Facing Page not found error.

Please suggest
HimanshuSinha-msft 19,486 Reputation points Microsoft Employee Moderator

2021-05-26T17:54:37.057+00:00

@Imran Mondal : Sorry about that , here is the link . https://stackoverflow.com/questions/52989698/copy-data-from-azure-blob-storage-to-aws-s3
Imran Mondal 246 Reputation points

2021-05-27T04:41:28.007+00:00

Hi, @HimanshuSinha-msft Thank you for sharing this. However, I have seen this earlier and kind of copied the question from there.

I was hoping If apart from the Azure Function app if there is any other way to transfer data to AWS and if it is a good idea to transfer data to AWS or not?

Share via

Copy Data From Azure Blob Storage to AWS S3 using Data Factory

1 answer

Your answer