Always get AVAILABLE_WORKSPACE_CAPACITY_EXCEEDED issue when I run jobs in one Synapse workspace

Question

We have one Synapse workspace and running well for months. But recently it got error like below when we run any job in it. We have checked and there is not any active jobs are running there. Could you please let me know how could I release resources in the workspace and let or jobs could run again?

AVAILABLE_WORKSPACE_CAPACITY_EXCEEDED: Livy session has failed. Session state: Error. Error code: AVAILABLE_WORKSPACE_CAPACITY_EXCEEDED. Your job requested 24 vcores. However, the workspace only has 2 vcores available out of quota of 50 vcores for node size family [MemoryOptimized]. Try ending the running job(s), reducing the numbers of vcores requested or increasing your vcore quota. Source: User.

Answer 1

Hi shaopengsun,

Can you try monitoring the spark pools as described in the link to understand the currently allocated cores?
https://learn.microsoft.com/en-us/azure/synapse-analytics/monitoring/how-to-monitor-spark-pools#view-details-about-a-specific-apache-spark-pool

As described in below link, the job seems to be requesting more vcore than currently available as per workspace quota. You can try releasing the capacity or requesting more cores.
https://github.com/https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/synapse-analytics/spark/apache-spark-concepts.md#workspace-level MicrosoftDocs/azure-docs/blob/main/articles/synapse-analytics/spark/apache-spark-concepts.md#workspace-level