Azure Databricks - Sharing notebook across workspaces

Question

All,

I have two workspaces - One for Jobcluster and the other for HighConcurrency cluster used interactively by the data scientists. Suppose if a notebook is created by the data scientist in the highconcurrency cluster how can this notebook be executed in a schedule in the JobCluster. Note that these two clusters are in two different workspaces.

Thanks,
grajee

Answer 1

Hello @Gopinath Rajee ,

Thanks for the question and using MS Q&A platform.

Unfortunately, there is no feature that helps you to share the notebooks across workspaces.

Appreciate if you could share the feedback on our Azure Databricks feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

There are couple of options to share the notebooks across workspaces.

Option1: Repos for Git integration

Databricks Repos provides repository-level integration with Git providers. You can develop code in an Azure Databricks notebook and sync it with a remote Git repository. Databricks Repos lets you use Git functionality such as cloning a remote repo, managing branches, pushing and pulling changes, and visually comparing differences upon commit.

Databricks Repos also provides an API that you can integrate with your CI/CD pipeline.

For more information about best practices for code development using Databricks Repos, see Best practices for integrating Databricks Repos with CI/CD workflows.

Option2: Continuous integration and delivery on Azure Databricks using Azure DevOps that moves the code from one Workspace to the other Workspace.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators