Unable to Create Azure Batch Pool Due to "Pool Quota Reached" Error Despite Having Zero Pools
I'm encountering an issue with Azure Batch where I'm unable to create a new batch pool. The error message I'm receiving is: poolquotaReached: pool quota for the account has been reached. However, when I check the quota, it shows that my current pool size…
The costing for the Batch services and I have trouble running my Python job in Azure Batch because the required directories are not present on the Batch node.
I would like to know how Batch service is charged. When I run my Python jobs through ADF's Batch service, I get som troubles. For example: My test.py script and the utils folder are located in the run_python folder. The test.py script calls the…
How to Schedule Azure Batch Jobs to Run Only on Weekdays and Skip Weekends?
Hi, I'm looking to configure an Azure Batch job schedule to run only on weekdays and skip weekends. From my research and forum interactions, I understand that the Weekdays attribute has been deprecated in the latest version. Any guidance or examples…
How to set up ADF Python script to access an external SFTP with Firewall Exceptions (whitelist)?
I am working on an ADF pipeline. One of the steps will include a Python script that connects to an external SFTP, download some files and upload them to my Storage Account. The SFTP owner asked to share the IP that he should add to Firewall exceptions so…
Attempting to add Storage Account to Batch Account using managed identity fails with 'InvalidAutoStorageAuthenticateMode' error?
We've got an Azure Batch account we'd like to setup with an existing storage account. We want to use managed identity to handle authentication. The storage account in question is within the same subscription and we have a user managed identity which…
Azure Batch Job Schedule Configuration Issue
I've been working with the Python SDK to set up an Azure Batch job schedule, and I've encountered an issue with the scheduling configuration. Here’s the scenario: I need to schedule a job to run only on Mondays and Fridays at 9 AM IST, which corresponds…
The specified account has reached core quota
we are reaching issue "reached core quota", but our subscription shows we do have quota and 0 of 100 usesed. we are not able to create vm pool for batchaccount. West US 2 Quota Usage New limit Delete quota Standard Dv3 Family vCPUs 0 of 100
Ubuntu 24.04 image on Azure Batch node - when it will be available?
Hi, I've noticed that it is already available in Azure Virtual Machines image marketplace, but it's not yet in Azure Batch. Is there a known date for the release of this SKU on Azure Batch nodes?
How to fix Cannot find a VM for task 'NFCORE_RNASEQ:RNASEQ:PREPARE_GENOME:UNTAR_SALMON_INDEX (salmon.tar.gz)' matching these requirements: type=Standard_E20ads_v5, cpus=1, mem=6 GB, location=germanywestcentral ?
Bug report I am trying to use Azure batch with Nextflow and Seqera, but I cant initiate any job because of wrong VM name, location name or not matching any VM of this name at the specific region. Expected behavior and actual behavior I am running this…
Azure Batch - Nodes will not leave the pool (stuck in leaving pool state)
We have had a batch system running for years. Recently we have seen issues where our node pools will scale up no problem, but will fail to scale down for hours stuck in 'leaving' state. This is currently happening and I have no way to remove the nodes…
Azure Batch better handle Unusable nodes
We have an Azure Batch pool with this Scale script: startingNumberOfVMs = 10; minVms = 0; maxNumberofVMs = 1200; maxAdditionalPerInterval = 200; pendingTaskSamplePercent = $PendingTasks.GetSamplePercent(180 * TimeInterval_Second); pendingTaskSamples =…
PoolAddParameter - python add user assigned identity
I am creating Azure Batch Pool using the Python Batch SDK. How can I add user assigned identity when creating the PoolAddParameter? I've tried using BatchPoolIdentity. I've found a workaround, but it is not optimal. Scale down Pool nodes after…
Azure batch Job schedule issue
I need to create a Azure batch job schedule, this schedule should run everyday between 9 AM to 6 PM with recurrence interval of 1 hour, is there any option to achieve this
Batch jobs need to schedule in between specific time
Hi Team, I want schedule azure - batch job between between 6 pm to 10 pm.
Alternative for Azure Batch CLI extensions
Is there any alternative for below https://azure.microsoft.com/en-us/updates/azure-batch-cli-extensions-will-be-retired-on-30-september-2024/ Azure Batch CLI extensions will be retired on 30 September 2024 The Azure Batch CLI extensions override the “az…
On Azure Batch for long running tasks the user submitting the task should be notified
Azure Monitor gives alert rules and actions but those are not dynamic enough for this use case. We have multiple users that use Batch to create pools and submit tasks. These jobs can take a long time to run and it would be nice to have a way to get…
Creating Azure Batch Pools using Azure.ResourceManager.Batch package
Is there any sample code available for creating Azure Batch Pools using Azure.ResourceManager.Batch package? https://learn.microsoft.com/en-us/dotnet/api/azure.resourcemanager.batch.batchaccountpoolresource.createresourceidentifier?view=azure-dotnet
How to recover when an Azure batch pool fails to allocate nodes
Our application uses several types of batch pools. There are two fixed pools (for tasks with and w/o MPI) and a continuous web job that manages scaling every minute. For larger tasks, we create a new pool with up to 20 nodes. Occasionally batch fails…
Error in getCluster(clusterName = "myPoolName") : Code: AccountCoreQuotaReached - Message: The specified account has reached core quota Code: AccountLowPriorityCoreQuotaReached - Message: The specified account has reached low priority core quota
In R programming, I am trying doAzureParallel for the first time and I encountered this cluster quota error: Error in getCluster(clusterName = "myPoolName") : Code: AccountCoreQuotaReached - Message: The specified account has reached core…
The request to update workflow failed. The trigger 'Batch-Trigger' of type 'Batch' cannot be deleted from existing workflow
I have created a Batch Trigger in azure logic apps and named a trigger "Batch-Trigger" , i am trying to change the name of the trigger since it's so generic, but not able to update the trigger name it gives below error. Workflow 'workflow…