pipelines stuck on preparing stage forever.

Antara Das 376 Reputation points
2021-09-01T06:42:02.8+00:00

Unable to execute pipelines on the STANDARD_D16S_V3. It is stuck on the prepare stage forever. But the same pipeline executed without trouble 2 weeks ago.
Also now AutoML are stuck on 'Not Started' stage.
The compute instances and compute clusters were again recreated, just to ensure if there were some issues with our previous computes. We have faced the issue where suddenly the computes have slowed down but this time they just dont get ahead of the prepare stage.
To be noted, this occurs only in case of pipelines and automl.
At the same time we are getting billed for the compute resources.
What can be possibly wrong here?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,667 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,409 questions
{count} votes