Azure Databricks

Question

Hi,

Can anybody provide list of Azure Databricks Best Practices?

Answer 1

Hello @Vijay Kumar ,

Here are the some of the resources which explains Azure Databricks best practices:

MS Learn: Describe Azure Databricks best practices helps to learn best practices for workspace administration, security, tools, integration, databricks runtime, HA/DR, and clusters in Azure Databricks.

Here is the Azure Databricks Best Practices published by the product team.

Here is a webinar on Azure Databricks – Security Best practices, which helps to learn:

• Use Platform Security features for networking and storage with Azure Databricks, such as VNET Injection, No Public IPs and Encryption
• Deploy, Operate and Govern at Scale for Authentication and Authorization with Azure Databricks using Azure Active Directory single sign-on, Azure Data Lake Storage Gen2 credential passthrough and integration with Azure Key Vault

Hope this helps. Do let us know if you any further queries.

----------------------------------------------------------------------------------------

Do click on "Accept Answer" and Upvote on the post that helps you, this can be beneficial to other community members.

Answer 2

Hello @Vijay Kumar ,

The accepted answer is good enough. However, since we run Spark code in Azure Databricks, I also follow some of the Spark Best practices. I found this link pretty informative if not all at least covers some basics.