Always get AVAILABLE_WORKSPACE_CAPACITY_EXCEEDED issue when I run jobs in one Synapse workspace

Shao Peng Sun 31 Reputation points
2022-08-29T14:39:59.707+00:00

We have one Synapse workspace and running well for months. But recently it got error like below when we run any job in it. We have checked and there is not any active jobs are running there. Could you please let me know how could I release resources in the workspace and let or jobs could run again?

AVAILABLE_WORKSPACE_CAPACITY_EXCEEDED: Livy session has failed. Session state: Error. Error code: AVAILABLE_WORKSPACE_CAPACITY_EXCEEDED. Your job requested 24 vcores. However, the workspace only has 2 vcores available out of quota of 50 vcores for node size family [MemoryOptimized]. Try ending the running job(s), reducing the numbers of vcores requested or increasing your vcore quota. Source: User.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,849 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Vidya Narasimhan 2,186 Reputation points Microsoft Employee
    2022-08-29T18:11:23.043+00:00

    Hi shaopengsun,

    Can you try monitoring the spark pools as described in the link to understand the currently allocated cores?
    https://learn.microsoft.com/en-us/azure/synapse-analytics/monitoring/how-to-monitor-spark-pools#view-details-about-a-specific-apache-spark-pool

    As described in below link, the job seems to be requesting more vcore than currently available as per workspace quota. You can try releasing the capacity or requesting more cores.
    https://github.com/https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/synapse-analytics/spark/apache-spark-concepts.md#workspace-level MicrosoftDocs/azure-docs/blob/main/articles/synapse-analytics/spark/apache-spark-concepts.md#workspace-level