How to backup Datalake Gen1 Storage to local storage using Powershell or CLI

Accounts 0 Reputation points
2023-08-04T07:11:32.68+00:00

We need to download /backup blobs (files) stored in Azure Data Lage Gen1 storage onto an Azure VM mount point. since the data in approx. 10 TB we want a programmatical option like Azure CLI or equivalent option to perform this task. Please suggest if this is possible.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,553 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
8,713 questions
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA 90,601 Reputation points
    2023-08-04T09:21:25.9933333+00:00

    @Accounts - Thanks for the question and using MS Q&A platform.

    Yes, it is possible to backup blobs stored in Azure Data Lake Gen1 storage onto an Azure VM mount point (Data Disks) using Azure CLI or Powershell.

    For more details, checkout How to move data from azure data lake to windows virtual machine addressing similar issue.

    These are the option available to load or move data from Azure Data Lake Storage:

    User's image

    The following visual illustrates the guidelines to choose the various Azure data transfer tools depending upon the network bandwidth available for transfer, data size intended for transfer, and frequency of the transfer.

    Azure data transfer tools

    For more details, refer to Choose an Azure solution for data transfer.
    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.