Share via

Synapse Spark Delta - VACUUM

Ryan Abbey 1,181 Reputation points
2021-09-01T03:19:43.22+00:00

Is there any way to log the VACUUM stats within Synapse Spark 2.4?

Databricks has "spark.databricks.delta.vacuum.logging.enabled" which I tried but did not get any success in logging the vacuum call

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,061 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. PRADEEPCHEEKATLA 90,266 Reputation points
    2021-09-01T11:19:54.233+00:00

    Hello @Ryan Abbey ,

    Thanks for the using MS Q&A platform.

    Azure Databricks & Azure Synapse - VACUUM commits to the Delta transaction log contain audit information.

    You can query the audit events using DESCRIBE HISTORY as shown below.

    128180-image.png

    For more details, refer to Audit information.

    Hope this helps. Do let us know if you any further queries.

    ---------------------------------------------------------------------------

    Please "Accept the answer" if the information helped you. This will help us and others in the community as well.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.