This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 27%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBG%3C/text%3E%3C/svg%3E)
Hi all, I am trying to read some data from storage accounts we have in PRD in our product and we are doing a POC on that data which doesn't work so good I can't even start a basic spark session that just print to the console "test".
this is the basic command I am trying to run which after about 12 minutes of starting session it fails and I get this error message.
AggregateException: Failed to recover livy session in RecoverLivySessionAsync. (Livy session has failed. Session state: Error. Error code: CLUSTER_CREATION_TIMED_OUT. [plugins.dtc-poc-can-canc.dataPoolTest.b10e540f-aeee-4345-8ac9-a00b689898bc WorkspaceType:<Synapse> CCID:<>] MaxClusterCreationAttempts=[3] Attempt=[0] ComputeNodeSize=[Large] ClusterId=[d03f06b4-76c2-4ebd-b27c-6397cb1ba5c4] AdlaResourceId=[] [Creation] -> [Cleanup]. The cluster creation has failed more than the [3] of times. IsTimeout=[True] IsTerminal=[False] IsRetryable=[True] ErrorType=[None] ErrorMessage=[] Source: Dependency.)
--> CLUSTER_CREATION_TIMED_OUT: Livy session has failed. Session state: Error. Error code: CLUSTER_CREATION_TIMED_OUT. [plugins.dtc-poc-can-canc.dataPoolTest.b10e540f-aeee-4345-8ac9-a00b689898bc WorkspaceType:<Synapse> CCID:<>] MaxClusterCreationAttempts=[3] Attempt=[0] ComputeNodeSize=[Large] ClusterId=[d03f06b4-76c2-4ebd-b27c-6397cb1ba5c4] AdlaResourceId=[] [Creation] -> [Cleanup]. The cluster creation has failed more than the [3] of times. IsTimeout=[True] IsTerminal=[False] IsRetryable=[True] ErrorType=[None] ErrorMessage=[] Source: Dependency.
also I can see the message in the manage tab which look like this:
sparkPool:
anyone has any suggestion?
Thanks.
Hi @Ben Gabay ,
Thank you for posting query in Microsoft Q&A Platform.
Could you please confirm Is this subscription type is "Pay-as-yo-go"? If yes, it may be because of vCore quote for synapse on subscription level. Hence, I request you to raise support request to increase quota. Please check below link for details on raising request quota.
Request quota increases and get support for Azure Synapse Analytics
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 9%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERW%3C/text%3E%3C/svg%3E)
Hello, we started seeing this error for the first time today as well. Has anyone found an answer yet?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 90%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECK%3C/text%3E%3C/svg%3E)
I am also seeing this error. I'm trying to upload a requirements.txt to my spark pool and it's failing with CLUSTER_CREATION_TIMED_OUT.
Hi ShaikMaheer. as you suggested I requested an increase in quota but I have been told that we already have a 1000 vCore quota for that specific workspace under this subscription. so this looks like it is not a quota issue after all since we don't need more than 1000 vCores for sure to run that piece of code. do you have any suggestions on what it could be other than qouta?
Thanks a lot for the help.
Ben Gabay.
this is the email I received from support regarding the quota increase:
I think that @ShaikMaheer-MSFT is correct. I reduced my number of nodes back to the default of 3 and everything is working now. I assume this was caused by the quota limit that he mentions.