Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,245 questions
Synapse doesn't deploy because of spark pool reference
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 25%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELB%3C/text%3E%3C/svg%3E)
L.B
0
Reputation points
Iam deploying Azure Synapse with Terraform. The problem is deployment fail because of notebook reference. That's normal because in Synapse we can't use a notebook without attaching spark pool. I have the following error (with Terraform, or even when trying to delete the spark pool through the Azure portal).
Error: waiting for the deletion of Spark Pool: (Big Data Pool Name "synsp01" / Workspace Name "X" / Resource Group "rg-X"): Future#WaitForCompletion: the number of retries has been exceeded: StatusCode=400 -- Original Error: Code="DeleteSparkComputeAdfError" Message="The document cannot be deleted since it is referenced by X."`
I know I can create a new spark pool and attach notebooks to the new one. But no the final solution with terraform, I guess the error will come again. What can I do (in Synapse or Terraform) to avoid this error? UPDATE : I deleted all my notebooks and pipelines on Synapse. I published, and I still have the error when deploying with Terraform.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 38%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EQ%3C/text%3E%3C/svg%3E)
QuantumCache 20,346 Reputation points2024-01-26T21:16:44.67+00:00 Hello @L.B Welcome to Q&A forum!
You can try searching for these resources like Linked services: Datasets or Triggers: and removing the references before deleting the Spark pool.
If you find any resources that reference the Spark pool, you should remove the references before deleting the Spark pool. You may want to try to use the
depends_onargument to specify the order in which resources are created or deleted!! -
L.B 0 Reputation points
2024-01-29T10:54:00.56+00:00 Thank you for your message, I removed notebooks / pipelines and triggers. Even manually it's impossible for me to delete the spark pool, the error remains the same
-
QuantumCache 20,346 Reputation points
2024-01-29T17:45:22.61+00:00 Hello @L.B I appreciate your patience on this matter! Do you have any support plans to contact the technical team on this matter? Please do let me know if you need any help regarding this and we will help you with the support ticket!
-
QuantumCache 20,346 Reputation points
2024-02-09T06:56:35.09+00:00 Hello @L.B Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!
Sign in to comment
Sign in to answer