Share via

Moving files using Azure Web jobs - high level advice

mij2020 366 Reputation points
2020-09-08T10:28:31.687+00:00

Hi,
We have a scenario where we wish to use an Azure Web Job to move files which are manually dumped into an Azure File Share. We want the files moved to SPO on a schedule a couple of times a day (15GB approx data) based on an input file in the same location.

We have read that port 445 is blocked from Azure Web jobs, so potentially the connection to Azure file share will not work.

If we use Storage Account blob containers instead – could we have our Web job code connect to the Storage Account using a SAS
signature or connection string and have the code move the files from a SA?

Or are there any better workarounds or alternatives we can use?
Thanks

Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,207 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,857 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
7,252 questions
0 comments
Accepted answer
  1. ajkuma 24,076 Reputation points Microsoft Employee
    2020-09-10T19:04:45.04+00:00

    @mij2020 , This a good question, thanks for posting this scenario.

    Adding to Sumanth’s suggestions, from App Service standpoint. Based on your requirement, you could leverage Azure Functions.

    The recommendation- scenarios where you want to run code snippets for integrating Azure or third-party services, choose Azure Functions over WebJobs with the WebJobs SDK. Azure Functions offers more developer productivity than Azure App Service WebJobs does.

    If you wish to use Blob container- you could use a connection string or SAS signature for authentication. It just depends on how you wish to use the specific SDK.

    Yes. 445 is blocked by the Azure App Service sandbox.

    The following docs would help you get started on this:

    Quickstart: Create your first function in Azure using Visual Studio

    Connect functions to Azure Storage using Visual Studio

1 additional answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sumarigo-MSFT 44,816 Reputation points Microsoft Employee
    2020-09-09T06:41:25.813+00:00

    @mij2020 Let me provide information on storage part data transfer. If you have ever been blocked using Azure Files due to your ISP's port 445, you can setup a Point to Site VPN to your Azure Files. Refer to the suggestions mentioned in the GitHub article.

    You can also use Azcopy tool to move the data, you may also refer few suggestion's provided in the MSDN and SO forum. Which gives some idea on your query.

    Different ways of Transferring data to and from Azure

    Hope this helps! Kindly let us know if the above helps or you need further assistance on this issue.

    ----------------------------------------------------------------------------------------------------------------------------------------

    Please don’t forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments