Databricks Audit Logs, What is "dataSourceId"?

Mohammad Saber 591 Reputation points
2023-02-22T22:45:02.64+00:00

Hi,

 

I want to access the Databricks Audit Logs to check user activity.

 

I created a Databricks workspace on the premium pricing tier.

I configured Audit logs to be sent to Azure Diagnostic log delivery. What I got in the "Log Analytics Workspace":

User's image

I have two questions.

  1. What is the difference between "DatabricksSQL" & "DatabricksDatabricksSQL"?
  2. When I open "DatabricksSQL" or "DatabricksDatabricksSQL", and select "executeFastQuery" & "executeAdhocQuery" for ActionName:

User's image

I get "dataSourceId" in the column "Requestparams".

User's image

I was wondering what "dataSourceId" is. Is it the TableID or CatalogID?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,534 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA 90,651 Reputation points Moderator
    2023-02-24T08:23:31.9266667+00:00

    @Mohammad Saber Thanks for the question and using MS Q&A platform.

    What is the difference between "DatabricksSQL" & "DatabricksDatabricksSQL"?

    As per the repro both DatabricksSQL and DatabricksDatabricksSQL gives the same results. Why it has named differently - I had raised a concern with the internal team to get more information on the naming convention.

    DatabricksSQL - Audit logs for events related to creation, modification etc. of Databricks SQL endpoints.

    User's image

    DatabricksDatabricksSQL - Databricks databrickssql audit logs.

    User's image

    What is "dataSourceId"?

    data_source_id is an another identifier of the SQL Endpoint. It's not the same as the SQL endpoint ID that is used for operations on SQL Endpoint.
    User's image

    The data_sourceid field specifies the id of the SQL warehouse against which this query will run.

    Example: I had two sql waarehouses named Test with dataSourceId: 0cd* and chepra with dataSourceId:2d7* - when a run any query with SQL warehouse named Test - it will return dataSourceId:0cd*.
    User's image

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.