Synapse Spark Delta - VACUUM

Ryan Abbey 1,176 Reputation points
2021-09-01T03:19:43.22+00:00

Is there any way to log the VACUUM stats within Synapse Spark 2.4?

Databricks has "spark.databricks.delta.vacuum.logging.enabled" which I tried but did not get any success in logging the vacuum call

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,553 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA-MSFT 82,196 Reputation points Microsoft Employee
    2021-09-01T11:19:54.233+00:00

    Hello @Ryan Abbey ,

    Thanks for the using MS Q&A platform.

    Azure Databricks & Azure Synapse - VACUUM commits to the Delta transaction log contain audit information.

    You can query the audit events using DESCRIBE HISTORY as shown below.

    128180-image.png

    For more details, refer to Audit information.

    Hope this helps. Do let us know if you any further queries.

    ---------------------------------------------------------------------------

    Please "Accept the answer" if the information helped you. This will help us and others in the community as well.