Azure Synapse ExecuteChangeWithValidation API: Multiple Processes Interfering with Each Other?

Vaitkevicius, Aurelijus 0 Reputation points
2024-03-21T18:20:11.59+00:00

We recently encountered an issue with Azure Synapse where we made multiple calls to the POST {endpoint}/databases/ExecuteChangeWithValidation?validationType={validationType}&api-version=2021-04-01 API. Some of the DDL payloads were to delete entities, and others were for creation. We suspect that we inadvertently created several processes that are preventing each other from completing.

This suspicion arises from the fact that when we call the GET {endpoint}/databases/{databaseName}/Tables?api-version=2021-04-01 API, we consistently receive different counts and sets of tables, even though no one is actively pushing changes to that Synapse workspace.

We’ve encountered an issue across multiple workspaces. We’re seeking insights on whether there’s an API endpoint or another method to monitor ongoing operations. While we’re aware of the API endpoint for retrieving the status of a specific operation, we’re curious if there’s one that can provide a comprehensive list of all operations. This information would be instrumental in validating our theory. Furthermore, we’re interested in understanding how to terminate these operations if they’re found to be still running.

Any guidance or suggestions would be greatly appreciated. Thank you!

Links to endpoints that we used:

  1. For publishing entities
  2. Get Sy MS Operation Status
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,372 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,546 questions
{count} votes