A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Unable to start VM in South Central US
Failed to start virtual machine 'VM-name Redacted'. Error: Allocation failed. VM(s) with the following constraints cannot be allocated, because the condition is too restrictive. Please remove some constraints and try again. Constraints applied are: -…
Azure CycleCloud
cyclecloud + cloud-init failures
Hello Team, We are experiencing intermittent issues with compute nodes where some required Python libraries fail to install correctly. When this issue occurs, we have identified that the tqdm Python library fails to load. As a result, although the node…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Cycle cloud - cloud init package failure
One of the cycle cloud cluster compute node packages are not working as expected. Either they are missing or crashed.
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Slurmctld service stopped with fatal glibc error
A cyclecloud cluster shows this error in cyclecloud GUI. The logs for slurmctld shows glib errors. Restarting the slrumctld, resolved temporatily, however the error occurs again. <redacted Logs PII info>
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Compute VM Machines are not being terminated after job completes.
One of our Slurm cluster using SpotVMs are able launch VMs on job excecution, however the VMs are keep running and not being terminated automatically even when the shutdown policy is specified.
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
azure cyclecloud start cluster errored
Hello team Created cluster from template with parameters. when trying to start cluster, getting below errors. managedidentity has full access, i can create same cluster manually from azure cc web console, but when i create from template, its throwing…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
azslurm scale fails with ModuleNotFoundError: No module named 'slurmcc' and NFS not mounted on scheduler VM
I’m trying to configure/use autoscaling on an Azure HPC Slurm cluster, but on the scheduler VM azslurm scale fails with a missing Python module, and it also looks like the expected NFS share(s) are not mounted. Environment: Node: compular-scheduler…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Standard_F64als_v6 on CycleCloud/PBS
We want to use Standard_F64als_v6 as an execute node of CycleCloud/PBS. <move to private message for security reasons > is selected as an image for execute node. The process creating an execute node seems to be stranded before 'configuring…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
How to fix image issue in cluster creation in azure cycle cloud
I am using default Centos 7 (OpenLogic:CentOS-HPC:7.7:latest) on cyclecloud 8.3 and Iam getting this error File…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
cant find /opt/cycle/slurm/cyclecloud_slurm.sh
Hi Support, I cant find /opt/cycle/slurm/cyclecloud_slurm.sh in my login node or schedule. I made some changes in my cluster and i wanted to run /opt/cycle/slurm/cyclecloud_slurm.sh apply_changes or cyclecloud_slurm.sh scale. Within my /opt/cycle, i…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Cyclecloud - Persistent connection Slurm accounting - connection refuse to my scheduler
hi Support, this is the error i am getting from my newly scheduler. I was able to deploy without any issue before to my new cluster but since the upgrade to cyclecloud 8, it seems newly created cluster has this issue whenever i enable the accounting. …
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Azure ML - Notebook - Jupyter Kernel Error - No Kernel connection
In ML Studio, when I create a notebook the top of my screen says "Jupyter kernel error" in red. I have a compute instance running (it's green), but it also says "No Kernel connected". To correct this matter, can you please…
Azure Machine Learning
An Azure machine learning service for building and deploying models.
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
CycleCloud unable to access storage locker after disabling "Allow storage account key access"
We have several CycleCloud/Slurm clusters running in Azure using Managed Identity. A recent security initiative has required us to disable the "Allow storage account key access" storage account configuration. After doing so, CycleCloud is…
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Issue with Autoscaling Nodes in Azure CycleCloud SLURM Cluster
I have created a SLURM cluster on Azure CycleCloud and enabled autoscaling with a maximum of 20 nodes for HPC. I have verified that there is enough quota for at least 10 HPC and 2 HTC nodes. However, upon booting the cluster, only 5 nodes are available…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
CycleCloud provisioning issue - storage_account_name
Hi everyone, Can you please help to check and advise below issue that provisioned for CycleCloud Version: 8.2.1-1733: CycleCloud Version: 8.2.1-1733 Cluster: HTCondor-Cluster01 (version 8.2.x) Status: Error [Virtual Machine] Start Time:…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
cycle cloud issue with accessing storage account
I am trying to bring up cycle cloud using the storage account "cycleclouddata", all resources are on the same vnet/sub-net and there should not be any access problems as the setup of the locker all looks fine as well. And I can see files being…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Parallel cyclecloud slrum process stacked while reading input file
I am running a parallel job, using openmpi, on cycle cloud, using slrum (batch) on 5 nodes, 120 cores in each. The job starts with reading the computational mesh, by each core. While reading, a mesh lock file appears for each core and disappears when it…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
How to update scheduler and execute nodes with latest OS updates?
Hi, We need to ensure that both our Scheduler and Execute nodes are fully patched and up to date, including kernel packages and others that require a reboot after installation. We are running the Microsoft HPC Ubuntu 22.04 image, and I know it is…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
How to make groups from the CycleCloud (file) Server accessible to the Scheduler and Execute nodes?
Hi, I have a CycleCloud Server which is also configured as an NFS fileserver which presents home, data and apps directories via NFS to the CycleCloud scheduler and execute nodes. It seems that CycleCloud adds users and groups to the scheduler &…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.
Azure cyclecloud
Hi Team, I want to automate the azure cyclecloud deployment process through terraform or other tool can anyone help me in this? I am able to create the cycle cloud server but unable to do azure cyclecloud setup through terraform or in any other language…
Azure CycleCloud
A Microsoft tool for creating, managing, operating, and optimizing high-performance computing (HPC) and big compute clusters in Azure.