I don't get Databricks Logs by "Log Analytics workspace".

Question

Hi,

I have configured "Diagnostic logging in Azure Databricks" following the documentation.

I created a Databricks workspace with a Premium pricing tier.

Also, I created a "Log Analytics workspace", Pay-as-you-go pricing tier.

In Databricks workspace, I added diagnostics settings. I selected all logs as can be seen below:

According to the documentation, once logging is enabled for the account, Azure Databricks automatically starts sending diagnostic logs to your delivery location. Logs are available within 15 minutes of activation.

However, I have not got any table in the "Log Analytics workspace":

---

When I open "Activity Log", the only operation that I can see is "Creae Workspace".

However, after creating a workspace, I created a cluster and a notebook. And I created a few Delta tables by running a notebook.

I have not enabled Unity Catalogue for the Databricks workspace. Does it have anything to do with the Unity Catalogue?

Also, the "verbose audit logs" is disabled as it is for sending additional logs (not needed for my case).

Is there anything I have missed?

Answer 1

Hello @Mohammad Saber

Thanks for the question and using MS Q&A platform.

Once logging is enabled for your account, Azure Databricks automatically starts sending diagnostic logs to your delivery location. Logs are available within 15 minutes of activation. Azure Databricks auditable events typically appear in diagnostic logs within 15 minutes in Azure Commercial regions.

You should able to see the "LogManagement" in the logs with 15 minutes after enabeling the diagnostics logs for the Azure Databricks workspace.

Log Analytics => Logs => LogManagement => Query

Nothing to do with enabling unity Catalogue and verbose audit logs.

In case, if you are not able to view the logs by now, I would suggest you to delete the diagnostic setting which is configured and re-configure again.

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.