how to ceate folders in ADLS gen2 by reading a csv file(particular column) stored in adls gen2 in Databrciks.

Question

how to ceate folders in ADLS gen2 by reading a csv file(particular column) stored in adls gen2 in Databrciks.

I am able to read csv file from gen2 using account key and sas token but not able to create folders in gen2 accordingly.

Answer 1

Hello @Smruti Prava Sahu ,

Welcome to the MS Q&A platform.

You can use dbutils to create the folders in gen2

You will need to mount the storage first and then create folders using dbutils.fs.mkdirs

dbutils.fs.mount( source = 'wasbs://<containername>@<gen2>.blob.core.windows.net/', mount_point = '/mnt/yourpath', extra_configs = {'fs.azure.account.key.<gen2>.blob.core.windows.net':'Accountkey'})  
  
dbutils.fs.mkdirs("/mnt/<mountName>path/folderName")  
  (or)  
dbutils.fs.mkdirs("dbfs:/mnt/<mountName>path/folderName")  

I hope this helps. Please let me know if you have any further questions.