Azure Synapse Error: CANNOT_QUEUE_UNQUEUEABLE_JOB

Question

I sometimes get the following error when running a cell in a Synapse notebook:

CANNOT_QUEUE_UNQUEUEABLE_JOB: Livy session has failed. Session state: Error. Error code: CANNOT_QUEUE_UNQUEUEABLE_JOB. The job is unqueueable, so could not queue the job behind other jobs which are currently queued. Source: User.
Referenced notebook stacktrace:
at Notebook config, cell 1

This happens regardless of the cell I choose to run - the spark session refuses to start with this error each time. What's the source of the error and how can I prevent its occurrence? It usually resolves itself after some time, but it's not feasible for me to wait an hour or more to be able to run my code.

Answer 1

Hi @Hanna Moazam ,

Thankyou for using Microsoft Q&A platform and posting your query.

My understanding about your query is that you are trying to run a notebook in Azure Synapse analytics but it's failing with the error: 'CANNOT_QUEUE_UNQUEUEABLE_JOB: Livy session has failed.'

This is an expected behavior . If there is not enough capacity to run a notebook, the Job is rejected right away as notebook jobs are not queueable.

For mitigation of this issue, please try creating another spark pool with increased node size and use it to run the notebook.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators