Best way to transfer ADLS Gen2 files to Media Services

Anonymous
2021-03-02T10:54:18.947+00:00

Hello,
I have around 2 TB of archive videos that I would like to upload to Azure Media Services.
I'm afraid I'm unable to find in the documentation the best way to connect the two together.
Could someone point me to the right direction ?
Thank you, regards.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,371 questions
Azure Media Services
Azure Media Services
A group of Azure services that includes encoding, format conversion, on-demand streaming, content protection, and live streaming services.
307 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Xavier Pouyat 591 Reputation points Microsoft Employee
    2021-03-02T12:06:54.81+00:00

    Hello,
    There are multiple options for large uploads. It depends if you want to write code or not.
    Azure Media Services rely on Azure storage to store the video files in the assets.

    From your code, one way is to create empty assets and then upload the blobs to each asset container using the Azure Storage SDK or (better) the Data Movement Library. This library implements robust mechanisms for the upload of large content.

    If you don't want to upload files using your own code, you can use use Azure Storage Explorer or AzCopy.

    A simple way would be to use Azure Media Services Explorer (https://aka.ms/amse) which relies on Azure Media Services SDK and the Azure Data Movement Library for the transfers (uploads/downloads). You can drag and drop a file to the asset grid to trigger the creation of an asset and upload of the file. There is a "batch upload" wizard (in upload/batch upload) to import a large number of files as assets. You can use subfolders on your disk to organize your content and create associated assets in AMS.

    Aspera or Signiant can also be used to upload massive data to Azure Storage.

    If you don't want to upload each video as a new asset, but want to do a bulk upload, you can proceed in two steps :

    1. upload all your files into one storage container in Azure
    2. then, create each asset and copy the file (blob SAS url) from the source container to the asset asset container.
      If the storage account is the same for source container and for the assets, copy will be instantaneous. Remember to delete the files from the upload container once the assets are created to avoid paying twice for storage.