Azure Databricks, mlflow and artifacts

Question

All,

I'm testing the MLflow deployment in Azure Databricks.

I see the location of the metrics source='dbfs:/databricks/mlflow-tracking/459312242396379/9baac7952b8f46b89435976bf2e4fd01/artifacts/random_forest_model"

Any idea where all these are stored? I'm not able to locate these directories in the dbfs folder.

Thanks,
grajee

Answer 1

Hello @Gopinath Rajee ,

Thanks for the question and using MS Q&A platform.

In the Create MLflow Experiment dialog, enter a name for the experiment and an optional artifact location. If you do not specify an artifact location, artifacts are stored in dbfs:/databricks/mlflow-tracking/<experiment-id>.

Azure Databricks supports DBFS and Azure Blob storage artifact locations.

To store artifacts in Azure Blob storage, specify a URI of the form wasbs://<container>@<storage-account>.blob.core.windows.net/<path>. Artifacts stored in Azure Blob storage do not appear in the MLflow UI; you must download them using a blob storage client.

Note: When you store an artifact in a location other than DBFS, the artifact does not appear in the MLflow UI. Models stored in locations other than DBFS cannot be registered in Model Registry.

For more details, refer to Track machine learning training runs.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a junotification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators