Azure Databricks - MLflow and storage

Question

All,

I see that lot of the data that is saved by mlflow in Azure Databricks is stored in the dbfs file system. Is this the only place that is used for storage by mlflow?

Thanks,
Grajee

Answer 1

Hello @grajee ,

Thanks for the question and using MS Q&A platform.

Azure Databricks MLFlow legacy storage location (dbfs:/databricks/mlflow/) that can be accessed by all users of your workspace.

Each MLflow Experiment has an Artifact Location that is used to store artifacts logged to MLflow runs. Starting in MLflow 1.11, artifacts are stored in an MLflow-managed subdirectory of the Databricks File System (DBFS) by default. MLflow experiment permissions apply to artifacts stored in these managed locations, which have the prefix dbfs:/databricks/mlflow-tracking. To download or log an artifact, you must have the appropriate level of access to its associated MLflow experiment.

For more details, refer to Log, load, register, and deploy MLflow Models.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a junotification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators