How to anonymously access public azure storage gen2 files using abfs with "dfs.core.windows.net" without credentials

Question

I am trying to use azure-hadoop filesystem for azure gen2 storage account and want to create AzureBlobFileSystem object without credentials "anonymous access".
is it possible to create abfsClient without any credentials

Answer 1

Hello @Ankit Gehlot ,
Thanks for the question and using MS Q&A platform.

As I understand you want to use the hadoop driver for ADLS gen2 , anonymously, without credentials. I think you are using hadoop rather than any of the SDKs, yes?

Looking at hadoop documentation I do not see any option for this.

Given that the container you are trying to access is set to public, I suspect a valid Managed Identity could work even if that managed identity has no permissions on that storage. I'll have to test that. Unlike SAS or Storage account key, MSI isn't specific to the storage account. So I think it would just check what permissions you have, and since public doesn't need permissions, it should work. This would answer "what auth to use for public container" but not "how to do it anonymously".

Please do let me if you have any queries.

Thanks
Martin

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators