Azure to Linux file transfer

Question

Azure to Linux file transfer

Niren Adhikary 96

We want to transfer the files from Azure to Linux on- prem? How should we do it? There may be multiple ways but I am thinking we need to setup below 1.Express route connection - what ports or configuration needed from azure and Linux on-Prem vm to setup the connectivity ? 2. AZcopy on the destination Linux vm. I assume we need write a script and schedule it on Linux vm and install the a copy tool on Linux. If the above approach is correct can I have more detail steps to implement this? Is there a better way to send the files from azure to Linux considering secure transfer.

PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2023-07-13T05:03:33.7366667+00:00

@Niren Adhikary - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2023-07-13T05:03:33.7366667+00:00

@Niren Adhikary - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

PRADEEPCHEEKATLA 91,656 Moderator

@Niren Adhikary - Thanks for the question and using MS Q&A paltform.

To transfer files from Azure to a Linux on-premises server, you have a few options. One common approach is to use Azure ExpressRoute to establish a private network connection between Azure and your on-premises environment. Here's a step-by-step guide on how to set up the connectivity and transfer files securely:

Set up ExpressRoute:

Determine your bandwidth requirements and select an ExpressRoute connectivity provider.
Configure ExpressRoute circuit with the provider, following their specific instructions.
Ensure that you have the necessary hardware, such as a router or a network appliance, to connect your on-premises network to the ExpressRoute circuit.
Establish the ExpressRoute circuit by configuring the necessary settings, including the connection type, bandwidth, and routing.

Configure connectivity between Azure and Linux on-premises VM:

Set up a virtual network (VNet) in Azure if you haven't already done so. Ensure that the VNet has a virtual network gateway configured.
Configure a site-to-site VPN connection between the Azure VNet and your on-premises network using the ExpressRoute circuit.
Configure the necessary network settings on your Linux on-premises VM, including IP addressing and routing, to establish connectivity with the Azure VNet.

Install and configure AZCopy on the Linux VM:

SSH into your Linux on-premises VM and ensure that it has internet connectivity.
Download the AZCopy binary for Linux from the official Microsoft download page.
Extract the AZCopy binary and move it to a directory accessible from the command line.
Set up the required access credentials, such as storage account name and account key or SAS token, for the Azure storage account that contains the files you want to transfer.
Write a script using AZCopy to specify the source and destination locations, and any additional options such as recursive copying or preserving file attributes.
Test the script to ensure it transfers files as expected.

Schedule the file transfer:

Use the cron utility on Linux to schedule the execution of your AZCopy script at specific intervals.
Set the appropriate frequency for the transfer, such as hourly, daily, or weekly, depending on your requirements.

By following the above steps, you can establish a secure file transfer mechanism between Azure and your Linux on-premises VM. ExpressRoute ensures a private and dedicated connection, and AZCopy enables efficient and reliable file transfers.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Niren Adhikary 96 Reputation points

2023-07-07T04:37:39.5733333+00:00

For express route connection what port I need to open on Azure and Linux?
Niren Adhikary 96 Reputation points

2023-07-07T05:00:31.35+00:00

What port needs to be open on Azure and Linux both is it 443 on both the side?
Niren Adhikary 96 Reputation points

2023-07-07T05:02:06.0566667+00:00

We cannot use ADF SHIR to copy the files right because destination is a Linux location and it is not supported for Linux?
PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2023-07-07T05:45:47.18+00:00

@Niren Adhikary - To establish an ExpressRoute connection between Azure and an on-premises network, you need to open the following ports:

Port 179: This port is used for Border Gateway Protocol (BGP) traffic. BGP is used to exchange routing information between the on-premises network and Azure.

Port 12000: This port is used for ExpressRoute Direct traffic. ExpressRoute Direct is a dedicated, high-speed connection between Azure and an on-premises network.

Port 443: This port is used for HTTPS traffic. HTTPS is used to establish a secure connection between Azure and the on-premises network.

Port 12001: This port is used for ExpressRoute Premium traffic. ExpressRoute Premium provides a higher level of reliability and performance than ExpressRoute Standard.

You need to open these ports on the on-premises network firewall and configure the ExpressRoute circuit to allow traffic on these ports.

On the Azure side, you don't need to open any ports as Azure automatically allows traffic on these ports for ExpressRoute connections. However, you need to configure the ExpressRoute circuit to allow traffic on these ports.

Note that the specific port requirements may vary depending on the specific ExpressRoute configuration and the network topology of the on-premises network. It's recommended to consult the ExpressRoute documentation and work with your network administrator to ensure that the correct ports are opened and configured for your specific scenario.
PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2023-07-07T05:48:08.6866667+00:00

@Niren Adhikary -

ASK: We cannot use ADF SHIR to copy the files right because destination is a Linux location and it is not supported for Linux?

Answer: Azure Data Factory Integration Runtime (self hosted) is currently only available on windows.

For more details, refer to https://www.microsoft.com/en-us/download/details.aspx?id=39717 and https://learn.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime?tabs=data-factory#prerequisites

Hope this helps. Do let us know if you any further queries.
Niren Adhikary 96 Reputation points

2023-07-07T05:55:53.5133333+00:00

So on-prem network firewall we need to open port 443 I believe
PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2023-07-10T05:39:58.38+00:00

@Niren Adhikary - As I said above, if HTTPS is used to establish a secure connection between Azure and the on-premises network - then you need to open port 443.

Hope this helps. Do let us know if you any further queries.
PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2023-07-14T06:31:15.91+00:00

@Niren Adhikary - Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

Azure to Linux file transfer

1 answer

Your answer