Share via

Iterative Write Operation

grajee 371 Reputation points
2022-01-31T01:47:34.337+00:00

All,

Would a rename directory (Iterative Write Operation) on a directory containing 200 files be considered one single operation or would it be considered 200 operations because there are 200 files?

Thanks,
grajee

Azure Data Lake Storage
Azure Data Lake Storage

An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.

0 comments No comments

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,827 Reputation points Moderator
    2022-02-01T19:55:13.877+00:00

    Hello @grajee ,

    Thanks for the question and using MS Q&A platform.

    You would want to know if renaming an ADLS Gen2 directory containing x files will be considered a single operation or multiple ( x ) operations.

    Renames/moves as part of analytics job commit activities will end up with a lot of operations (proportional to object count) with Flat Namespace account while this would be a single transaction in Hierarchical Namespace account.

    If you would want to rename of a folder containing 200 files. The rename would be charged as a single metadata operation (iterative writes).

    For better understanding of ADLS Gen2 billing, please refer to please articles:
    1) Azure Data Lake Storage Gen2 Billing FAQs
    2) Azure Data Lake Storage pricing

    Here is another thread where a few additional details are shared related to iterative write operations and billing : Interative Write Operation vs Write Operation

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

    Was this answer helpful?


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.