Mounting Azure Data Lake Store Gen 2 to Azure Synapse Analytics Spark Pool

Question

Azure Databricks allows ADLS2 to be mounted as a local drive. Does Azure Synapse Analytics allow mounting of ADLS2 in Spark Pool?

Answer 1

Hello @CheuEngYeow-5385,

Welcome to the Microsoft Q&A platform.

Currently, Azure Synapse Analytics doesn't allow mounting of ADLS2 in Spark Pool.

As per the conversation with product team, they are working on this feature and it will be available soon.

I will update the thread once it goes live.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Answer 2

BEWARE: The Spark Pool when shutdown will remove some working folders. Do at your own risk. Files may be removed when Spark Pool is shutting down.

Discover that blobfuse is installed in Spark Pool.
Follow the instructions here to mount your blob storage.
Use Python subprocess to run the command.

https://learn.microsoft.com/en-us/azure/storage/blobs/storage-how-to-mount-container-linux