How to create CI/CD pipelines for scripts that run on Azure Batch
Hello, I was going thru Azure Batch and thought this would be a good fit for one of my solutions. I have thousands of python scripts with some dependencies on pegasus which takes in some file as input and generates a report(pdf or txt) as an output. I…
Azure Batch
Using Azure Batch my task ends seconds after starting, with the error that the container used is invalid?
Not able to use a uploaded Docker image. The Docker image is tested locally and is able to reach the Azure storage and preform and save back into Azure storage as expected. But when trying to use the uploaded image to ACR the task is interrupted…
Azure Batch
Not able to identify / activate NVIDIA drivers on the node hosts
My tasks fails due to missing GPU support in the pools node host machines. I use the microsoft-dsvm ubuntu-hpc 2204 (latest) Standard_NV6ads_A10_v5 I have managed to get my docker image to be started but it failed at the GPU test from torch …
Azure Batch
Azure Batch Docker container doesn't have access to GPU when running task
I have setup a pool on my Azure Batch account with the following settings: Operating system/image: microsoft-dsvm ubuntu-hpc 2204 VM Size: Standard_NV12s_v3 Extensions: NvidiaGpuDriverLinux, version 1.4, publisher Microsoft.HpcCompute The nodes are set…
Azure Batch
Batch account stuck in deleting state
Hi, We've got another batch account stuck in deleting state. (see also my previous request ; I wonder if it's the same issue). In this case, I provisioned the batch account with a pool with one node through terraform and about half an hour later tried to…
Azure Batch
Azure error creating a batch pool with spot virtual machines.
I can not create a batch pool with spot virtual machines. I used UserSubscription for poolAllocationMode. I tried Australia East, Australia Central, UK South and different VMSizes. Dedicated node works but Spot/low-priority nodes do not work. Always get…
Azure Batch
Validation failed while moving resource group from 2 subscriptions within same tenant id and same region
I have to move a single resource group from one subscription to another. The 2 subscriptions are within the same EntraID tenant and on the same region. This is error I get while validating resources: { "message": "Resource move validation…
Azure Batch
When adding more tasks to a job with a JobManagerTask, it seems to me that those other tasks inherit the "AllowLowPriorityNode: false" flag I have set on the job manager
Has anyone else experienced this? I set "AllowLowPriorityNode: false" on my JobManagerTask, but when I create other tasks under the same job, they refuse to run on low priority nodes. The field is only available on the job manager task.
Azure Batch
Batch account stuck in deleting state
Hi, We've got a batch account that's been stuck in deleting state for a while now. Retrying the delete through the cli informs me that the pool is already in a deleting state, and through the portal shows an "error deleting Batch account"…
Azure Batch
Does Azure Batch support Arm64 VMs?
Hi, does Azure Batch support Arm64 VMs? I don't see any "D2pds" listed in "az batch location list-skus".
Azure Batch
Questions related to Retirement Notice: Transition to Batch Spot VMs before 30 September 2025
Hello, Following the recent notice, we transitioned our Azure Batch service from using low-priority VMs to Spot VMs by re-creating the Batch account with the 'pool allocation mode' configured to 'User Subscription'. Following this activity we have three…
Azure Batch
Difference between Spot and Low-priority nodes in Azure Batch – how to identify my pool type
I haven’t really understood whether the nodes in my pool are Spot or Low-priority. How can I check it?
Azure Batch
Our account's MSA left and need to contact replacement
We've been in contact with our MSA for our account for many months; He mentioned that he's leaving that position and we should be contacted by a replacement but that never happened. We are currently paying for Standard support for our account but also…
Azure Batch
Hosted Agent with Azure-cli 2.77: ERROR: The specified blob already exists
Since Tuesday, the Hosted Agent updated the version of azure-cli to 2.77 and I get this error since then: ERROR: The specified blob already…
Azure Batch
Does Azure Batch support Azure Data Lake Gen2?
Hello, Azure Batch during configuration requires specifying a storage account from which to read and write the outputs of its tasks. It supports as a Storage Account an Azure Blob Storage with Hierarchical Namespace enabled, and therefore an Azure Data…
Azure Batch
doAzureParallel package support seems to be removed from MS site starting June 2023 - Is there any replacement for this we can look into?
Hi, We have a model in R/RStudio, and we have been using the doAzureParallel R package to execute Azure cloud computing task for our model. We realized that starting this June the package is no longer supported, and we run into issues when trying to…
Azure Batch
Renaming Scale Sets created by Azure Batch under User Subscription Allocation
When using Batch accounts with user subscription allocation, is it possible to rename or add a custom prefix/suffix to the scale sets or nodes created by Batch? By default the name of scale sets and nodes has the following structure:…
Azure Batch
Pool Nodes in "Unusable" state and then leaving the pool
Since 2 hours ago, pool nodes that are automatically created become "Unusable" and then leave the pool, despite no recent changes made. All tasks are stuck in the active state because of this looping issue. No errors are visible that would…
Azure Batch
Azure Batch Transcription is not completing running jobs
Hello, My Azure Batch Transcription jobs are not completing. I am using the eastus location. This started on 9/4/25. Any suggestions? williamj
Azure Batch
Issue- Install framework .NET core 8.0 while running Console Batch job in azure portal
Facing issue while running batch job in azure portal, Uploaded application package zip file. Job and Task created. Command line provided and run it job application, issue came for install framework 8.0 core. Create task start in pool for install…