Share via

ADLS gen2 size limitation

Shah, Gaurang 1 Reputation point
2021-07-16T18:51:29.077+00:00

is there any limitation of the ADLS gen2 size if I have hierarchical namespace enabled?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,562 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. SUNOJ KUMAR YELURU 15,491 Reputation points MVP Volunteer Moderator
    2021-07-17T04:19:27.49+00:00

    Hi @Shah, Gaurang

    The document says "No limits on account sizes or number of files. File size limited to 5TB." for Data lake gen 2, while Data lake gen2 landing page says "Your Data Lake Store can store trillions of files where a single file can be greater than a petabyte in size which is 200x larger than other cloud stores"
    https://github.com/MicrosoftDocs/azure-docs/issues/47313

    The hierarchical namespace (HNS), coupled with the DFS endpoint, is what enables the performance and security improvements. discussed in Section 3.
    https://www.bluegranite.com/blog/10-things-to-know-about-azure-data-lake-storage-gen2

    If the Answer is helpful, please click Accept Answer and up-vote, this can be beneficial to other community members.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.