Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
321 questions
2 answers
Azure Batch better handle Unusable nodes
We have an Azure Batch pool with this Scale script: startingNumberOfVMs = 10; minVms = 0; maxNumberofVMs = 1200; maxAdditionalPerInterval = 200; pendingTaskSamplePercent = $PendingTasks.GetSamplePercent(180 * TimeInterval_Second); pendingTaskSamples =…
asked 2024-06-17T17:56:35.3433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 7.000000000000001%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELS%3C/text%3E%3C/svg%3E)
Lucas Sabalka
0
Reputation points
answered 2024-07-19T19:41:13.3933333+00:00
Lucas Sabalka
0
Reputation points
0 answers
Are task logs deleted when the node is deleted due to autoscaling?
Hello, I am trying to access the logs (stdout.txt and stderr.txt) of the tasks run. As soon as the task is completed I lose access to those files. Looking at the browser console, if I search a file in the path field I get a 404 error, NodeNotFound, The…
asked 2024-07-16T09:52:11.57+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 90%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
Juan Manuel Pérez [Modelical]
0
Reputation points
commented 2024-07-19T10:03:24.4333333+00:00
Prrudram-MSFT
23,051
Reputation points
1 answer
Attempting to add Storage Account to Batch Account using managed identity fails with 'InvalidAutoStorageAuthenticateMode' error?
We've got an Azure Batch account we'd like to setup with an existing storage account. We want to use managed identity to handle authentication. The storage account in question is within the same subscription and we have a user managed identity which…
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,911 questions
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,068 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
321 questions
Azure Startups
Azure Startups
Azure: A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.Startups: Companies that are in their initial stages of business and typically developing a business model and seeking financing.
239 questions
asked 2024-05-02T14:46:43.3966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 52%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Samuel Taylor-Hansen
0
Reputation points
commented 2024-07-18T08:35:29.9866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 5%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EOV%3C/text%3E%3C/svg%3E)
Oriol Varela Fernandez
0
Reputation points Microsoft Employee
0 answers
Task fails with FileUploadMiscError
I have an Azure batch task that executes a custom application I've added as an application package. It's a single exe, but every time the task fails with the following error: Error loading Python DLL 'C:\batch\bin\python38.dll'. LoadLibrary: Not…
asked 2022-11-10T12:45:41.127+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 91%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHS%3C/text%3E%3C/svg%3E)
Heine Skov Kristensen
6
Reputation points
commented 2024-07-17T08:05:11.4033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 56.00000000000001%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJB%3C/text%3E%3C/svg%3E)
Jan Bielecki
0
Reputation points
3 answers
One of the answers was accepted by the question author.
Unable to Create Azure Batch Pool Due to "Pool Quota Reached" Error Despite Having Zero Pools
I'm encountering an issue with Azure Batch where I'm unable to create a new batch pool. The error message I'm receiving is: poolquotaReached: pool quota for the account has been reached. However, when I check the quota, it shows that my current pool size…
asked 2024-06-12T12:48:18.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 74%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Stanley Ramakrishnan
40
Reputation points
commented 2024-07-16T13:51:55.6366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 79%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3END%3C/text%3E%3C/svg%3E)
Nikhil Duserla
985
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
What can I do when I got error message "PoolQuotaReached" on the Azure portal to create a Batch account.
I tried to create a batch account and run a job, referring to https://learn.microsoft.com/en-us/azure/batch/quick-create-portal. I got a error message "PoolQuotaReached: Pool quota for the account has been reached" at 7th of "Create a pool…
asked 2023-06-05T07:15:19.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 45%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
ma2jun
35
Reputation points
commented 2024-07-16T00:35:52.1366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 57.00000000000001%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEZ%3C/text%3E%3C/svg%3E)
Eric Zhang
0
Reputation points
2 answers
The costing for the Batch services and I have trouble running my Python job in Azure Batch because the required directories are not present on the Batch node.
I would like to know how Batch service is charged. When I run my Python jobs through ADF's Batch service, I get som troubles. For example: My test.py script and the utils folder are located in the run_python folder. The test.py script calls the…
asked 2024-06-20T05:46:01.7566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 9%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZX%3C/text%3E%3C/svg%3E)
谢志青 Zhiqing Xie
40
Reputation points
commented 2024-07-04T05:28:31.0933333+00:00
谢志青 Zhiqing Xie
40
Reputation points
1 answer
How to Schedule Azure Batch Jobs to Run Only on Weekdays and Skip Weekends?
Hi, I'm looking to configure an Azure Batch job schedule to run only on weekdays and skip weekends. From my research and forum interactions, I understand that the Weekdays attribute has been deprecated in the latest version. Any guidance or examples…
asked 2024-07-03T03:05:20.13+00:00
Stanley Ramakrishnan
40
Reputation points
commented 2024-07-04T05:23:39.0966667+00:00
vipullag-MSFT
25,866
Reputation points
2 answers
How to set up ADF Python script to access an external SFTP with Firewall Exceptions (whitelist)?
I am working on an ADF pipeline. One of the steps will include a Python script that connects to an external SFTP, download some files and upload them to my Storage Account. The SFTP owner asked to share the IP that he should add to Firewall exceptions so…
asked 2024-06-24T12:08:45.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 20%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E14%3C/text%3E%3C/svg%3E)
11-4688
111
Reputation points
answered 2024-07-03T09:34:35.56+00:00
Pinaki Ghatak
3,110
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Azure Batch Job Schedule Configuration Issue
I've been working with the Python SDK to set up an Azure Batch job schedule, and I've encountered an issue with the scheduling configuration. Here’s the scenario: I need to schedule a job to run only on Mondays and Fridays at 9 AM IST, which corresponds…
asked 2024-07-02T07:51:10.66+00:00
Stanley Ramakrishnan
40
Reputation points
accepted 2024-07-02T17:39:14.4733333+00:00
Stanley Ramakrishnan
40
Reputation points
1 answer
The specified account has reached core quota
we are reaching issue "reached core quota", but our subscription shows we do have quota and 0 of 100 usesed. we are not able to create vm pool for batchaccount. West US 2 Quota Usage New limit Delete quota Standard Dv3 Family vCPUs 0 of 100
asked 2024-06-28T14:06:44.4733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 7.000000000000001%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGH%3C/text%3E%3C/svg%3E)
George Hu
16
Reputation points Microsoft Employee
answered 2024-06-28T14:46:41.0033333+00:00
deherman-MSFT
35,481
Reputation points Microsoft Employee
1 answer
Ubuntu 24.04 image on Azure Batch node - when it will be available?
Hi, I've noticed that it is already available in Azure Virtual Machines image marketplace, but it's not yet in Azure Batch. Is there a known date for the release of this SKU on Azure Batch nodes?
asked 2024-06-24T11:45:54.3366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 62%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
Sobczyk Maciej
0
Reputation points
commented 2024-06-28T05:39:46.08+00:00
Deepanshukatara-6769
7,905
Reputation points
0 answers
How to fix Cannot find a VM for task 'NFCORE_RNASEQ:RNASEQ:PREPARE_GENOME:UNTAR_SALMON_INDEX (salmon.tar.gz)' matching these requirements: type=Standard_E20ads_v5, cpus=1, mem=6 GB, location=germanywestcentral ?
Bug report I am trying to use Azure batch with Nextflow and Seqera, but I cant initiate any job because of wrong VM name, location name or not matching any VM of this name at the specific region. Expected behavior and actual behavior I am running this…
asked 2024-06-19T14:04:55.2133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 71%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELA%3C/text%3E%3C/svg%3E)
Lampros Androutsos
0
Reputation points
commented 2024-06-20T04:42:04.8333333+00:00
vipullag-MSFT
25,866
Reputation points
0 answers
Azure Batch - Nodes will not leave the pool (stuck in leaving pool state)
We have had a batch system running for years. Recently we have seen issues where our node pools will scale up no problem, but will fail to scale down for hours stuck in 'leaving' state. This is currently happening and I have no way to remove the nodes…
asked 2024-06-17T16:24:15.8433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 87%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBB%3C/text%3E%3C/svg%3E)
Brian Bertrand
21
Reputation points
commented 2024-06-19T08:30:13.9233333+00:00
Nikhil Duserla
985
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
PoolAddParameter - python add user assigned identity
I am creating Azure Batch Pool using the Python Batch SDK. How can I add user assigned identity when creating the PoolAddParameter? I've tried using BatchPoolIdentity. I've found a workaround, but it is not optimal. Scale down Pool nodes after…
asked 2024-06-17T14:13:24.0033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 57.00000000000001%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEO%3C/text%3E%3C/svg%3E)
Emil Obrestad
20
Reputation points
accepted 2024-06-18T10:16:08.93+00:00
Emil Obrestad
20
Reputation points
1 answer
Azure batch Job schedule issue
I need to create a Azure batch job schedule, this schedule should run everyday between 9 AM to 6 PM with recurrence interval of 1 hour, is there any option to achieve this
asked 2024-05-21T11:04:45.9633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Sreenidhi Palimar
0
Reputation points
commented 2024-05-21T16:27:07.5733333+00:00
Sreenidhi Palimar
0
Reputation points
1 answer
Batch jobs need to schedule in between specific time
Hi Team, I want schedule azure - batch job between between 6 pm to 10 pm.
asked 2022-12-06T15:04:20.577+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 83%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJB%3C/text%3E%3C/svg%3E)
Juturu Bhargav Reddy
1
Reputation point
edited a comment 2024-05-20T09:28:10.4033333+00:00
Sreenidhi Palimar
0
Reputation points
1 answer
Alternative for Azure Batch CLI extensions
Is there any alternative for below https://azure.microsoft.com/en-us/updates/azure-batch-cli-extensions-will-be-retired-on-30-september-2024/ Azure Batch CLI extensions will be retired on 30 September 2024 The Azure Batch CLI extensions override the “az…
asked 2024-05-14T04:43:16.3533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 40%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIS%3C/text%3E%3C/svg%3E)
I, Sathavahana SBOBNG-PTIY/CMJ
0
Reputation points
commented 2024-05-15T15:28:55.3133333+00:00
vipullag-MSFT
25,866
Reputation points
0 answers
On Azure Batch for long running tasks the user submitting the task should be notified
Azure Monitor gives alert rules and actions but those are not dynamic enough for this use case. We have multiple users that use Batch to create pools and submit tasks. These jobs can take a long time to run and it would be nice to have a way to get…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 52%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
1 answer
Creating Azure Batch Pools using Azure.ResourceManager.Batch package
Is there any sample code available for creating Azure Batch Pools using Azure.ResourceManager.Batch package? https://learn.microsoft.com/en-us/dotnet/api/azure.resourcemanager.batch.batchaccountpoolresource.createresourceidentifier?view=azure-dotnet
asked 2024-05-08T21:57:03.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 52%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZS%3C/text%3E%3C/svg%3E)
ZIA SAEED
0
Reputation points
answered 2024-05-09T02:41:37.4466667+00:00
vipullag-MSFT
25,866
Reputation points