ADF connector for file transfer

Question

Hello,

We need to transfer files between azure ,on-prem and aws. Is it possible to use ADF file system connector as the source (on-prem server or Lan location) with SFTP as the sink on AWS ? Should we use SHIR or Azure IR we have private connection over express route to on-prem but to AWS we might have VPC.

What is the best possible approach to transfer files from azure to on-prem lan location or on-prem servers (assuming we don't use an SFTP on -premise) ?

Thanks,

Answer 1

I would like to add some points in addition what Azar mentioned.

Hi @Sourav
Welcome to Microsoft Q&A platform and thanks for posting your question here.

Yes, it is possible to use ADF file system connector as the source (on-prem server or Lan location) with SFTP as the sink on AWS. To achieve this, you can use Azure Data Factory to transfer files between Azure, on-prem, and AWS. ADF provides a file system connector that can connect to your on-prem server or LAN location as the source, and an SFTP connector that can connect to your AWS SFTP server as the sink.

The choice between SHIR and Azure IR depends on your specific requirements and infrastructure. If you have a private connection over Express Route to on-prem, using SHIR might be a better option as it allows you to run the integration runtime on your own infrastructure. However, if you have a VPC connection to AWS, using Azure IR might be more suitable as it provides a managed integration runtime that can handle the connectivity to AWS.

When it comes to transferring files from Azure to on-prem LAN location or on-prem servers without using SFTP on-premises, there are alternative options to consider. One approach is to use Azure File Share to transfer files from Azure to on-prem. Azure File Share provides a cloud-based file share that can be accessed from both Azure and on-prem environments.

Azure File Share is a convenient option because it eliminates the need for SFTP on-premises. Instead, you can simply mount the Azure File Share on your on-prem servers or LAN location, allowing you to access and transfer files seamlessly. This approach also provides a secure and reliable way to transfer files between Azure and on-prem environments.

Overall, Azure Data Factory and Azure File Share provide flexible and secure solutions for transferring files between Azure, on-prem, and AWS environments. By choosing the right connector and integration runtime, you can ensure efficient and reliable file transfers that meet your specific business needs.

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 2

Hi there Sourav

Thanks for using QandA platform

Use SHIR to connect to your on-premises LAN or servers over ExpressRoute. Configure the ADF pipeline with the file system connector as the source.

Use Azure Data Factory with an SFTP linked service as the sink. Ensure proper network configuration between Azure and AWS, Use Azure Data Factory with a file system connector for on-premises sources.

Configure an SFTP sink for AWS.

Use SHIR for on-premises and Azure IR for AWS, ensuring proper connectivity via ExpressRoute and possibly VPC for AWS.

If this helps kindly accept the answer thanks much.