Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
339 questions
1 answer
Databricks vs Batch pool
Hi, I have Googled the difference between using Azure Databrick and Batch pool to run python pipelines and ETL. But I haven’t found a clear difference between them two. Based on what I have Googled, Databrick can become very expensive, so cost matters a…
asked 2024-11-07T14:10:41.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 59%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Renan
40
Reputation points
commented 2024-11-13T07:14:56.1766667+00:00
Prrudram-MSFT
25,471
Reputation points
1 answer
Error creating pool node
I've converted my pool creation code from Microsoft.Azure.Batch to Azure.ResourceManager.Batch (in order to set the certificate in the key vault instead of in the batch account). The pool is being created with the expected node, and all configuration…
asked 2024-11-08T22:15:24.1866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 77%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGJ%3C/text%3E%3C/svg%3E)
Green, Jim
50
Reputation points
commented 2024-11-13T00:51:44.22+00:00
vipullag-MSFT
26,396
Reputation points
1 answer
Unable to Submit Quote Increase Request for Microsoft Azure Batch
Hi everyone, I’m currently setting up an Azure Batch account, but I encountered an error indicating insufficient quota. I'm in the process of requesting a quota increase for my subscription; however, when I enter the location details, the process seems…
asked 2024-10-28T21:19:10.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 42%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
RaviTeja
0
Reputation points
commented 2024-11-12T06:27:53.02+00:00
Prrudram-MSFT
25,471
Reputation points
1 answer
One of the answers was accepted by the question author.
Define azure batch pool certificate in CloudPool with c#
I'm following the instructions in https://learn.microsoft.com/en-us/azure/batch/automatic-certificate-rotation#create-a-batch-pool-with-a-user-assigned-managed-identity to change from defining certificates in CloudPool.CertificateReferences to…
asked 2024-11-01T21:45:56.56+00:00
Green, Jim
50
Reputation points
edited a comment 2024-11-09T14:58:51.34+00:00
Prrudram-MSFT
25,471
Reputation points
1 answer
One of the answers was accepted by the question author.
increase batch pool quota
I tried to created a batch pool but I got the message saying the quota has been reached. How do I increase my pool quotas ? I tried to go in quotas>computer> there is an option for New quota request. But I can't see my resource group there. How…
1 answer
how to order sequence of python scrip using batch pool
I have stored three python scripts in Blob Storage and I have created a Batch account and I am about to create the “pool”. But these python scripts has to be run in particular order. Hence my question: how do I order the sequence of the python script to…
asked 2024-10-23T12:18:34.8+00:00
Renan
40
Reputation points
edited the question 2024-11-05T04:39:08.57+00:00
Sumarigo-MSFT
47,101
Reputation points Microsoft Employee
0 answers
MPI error in Azure Batch
In MPI-enabled tasks, occasionally we will get this error: Aborting: smpd on a3315966100000A failed to communicate with child smpd manager If we restart the exact same task it will complete. This seems to suggest that a node has terminated and is no…
asked 2024-10-31T15:30:54.37+00:00
Green, Jim
50
Reputation points
commented 2024-11-04T18:45:08.86+00:00
deherman-MSFT
37,496
Reputation points Microsoft Employee
1 answer
batch pool: PoolQuotaReached
I have upgrade my account in Azure. I am trying to create a batch pool but it says "The error message "PoolQuotaReached: Pool quota for the account has been reached" indicates that the number of pools in your Azure Batch account has…
asked 2024-11-02T08:26:36.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 85%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERA%3C/text%3E%3C/svg%3E)
Renan Almeida
0
Reputation points
answered 2024-11-04T04:16:25.8033333+00:00
Prrudram-MSFT
25,471
Reputation points
0 answers
i cannot download my bathc jobs - timeout
Hi, I'm on a slow internet connection and struggling to download my batch jobs. The output file is several tens of MB, and I keep getting the error: "Unable to load file. Timeout of 600000ms exceeded." Any suggestions on how to work around…
asked 2024-10-20T16:28:14.2466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 49%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIQ%3C/text%3E%3C/svg%3E)
Ivo Q
0
Reputation points
commented 2024-11-01T18:45:04.1933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 3%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMG%3C/text%3E%3C/svg%3E)
Mahesh Goud Juvvadi
1,240
Reputation points Microsoft Vendor
2 answers
Combine Excel Template with csv data
Hi - I'm trying to combine data generated in the form of .csv file with an existing excel template. Excel template contains a sheet with data table that needs to be populated to contents of .csv file and also have some of the cells written with…
asked 2022-01-28T09:47:29.82+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 9%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Rakesh Singh
26
Reputation points
commented 2024-10-09T01:19:26.7466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 61%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHB%3C/text%3E%3C/svg%3E)
Hollie Becker
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Is it possible to update the autoscaling formula and replace the Blob containers mounted in an existing Azure batch pool?
I have created an Azure batch pool with 2 containers (Container1, Container2). I want to update the autoscaling formula in this pool. Additionally, I also want to map 2 different containers (Container3, Container4) in the same pool.
asked 2024-09-17T13:04:57.45+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 75%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFR%3C/text%3E%3C/svg%3E)
Fawad Rafi
20
Reputation points
accepted 2024-09-20T13:04:13.3533333+00:00
Fawad Rafi
20
Reputation points
1 answer
Azure Batch Pool Deployment in VNet with Batch-Service and User Subscription Modes
I'm trying to understand how Azure Batch deploys pools to a Virtual Network (VNet) in both Batch-Service mode and User subscription mode. I successfully created a Batch pool in Batch-Service mode and deployed it into a VNet in my own Azure subscription…
asked 2024-09-10T16:20:36.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 4%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA8%3C/text%3E%3C/svg%3E)
AzureKnwGt-8579
20
Reputation points
commented 2024-09-14T01:55:24.45+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 3%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sai Krishna Katakam
810
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Will AutoScale formula remove node that is running a task
I am new to Azure Batch and I understand that it uses VMSS to create pools in the background. If I define an auto scale formula, can it result in a node being removed while a task is running?
asked 2024-09-09T09:06:05.27+00:00
AzureKnwGt-8579
20
Reputation points
accepted 2024-09-12T07:35:21.1466667+00:00
AzureKnwGt-8579
20
Reputation points
1 answer
How to Schedule Azure Batch Jobs to Run Only on Weekdays and Skip Weekends?
Hi, I'm looking to configure an Azure Batch job schedule to run only on weekdays and skip weekends. From my research and forum interactions, I understand that the Weekdays attribute has been deprecated in the latest version. Any guidance or examples…
asked 2024-07-03T03:05:20.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 74%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Stanley Ramakrishnan
40
Reputation points
commented 2024-09-09T09:12:12.41+00:00
AzureKnwGt-8579
20
Reputation points
1 answer
Issue with resourceFiles Property in Azure Data Factory Pipeline: "Total size of resourceFiles is using 141% of available space after processing"
Hello, I'm encountering an issue with Azure Batch related to the resourceFiles property in one of my pipelines. Despite verifying that the File Storage Size in the associated App Service Plan is only 7% of the available 10 GB, I'm receiving an error…
asked 2024-08-27T12:51:25.7833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 79%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sandeep Kumar Valluri
0
Reputation points
answered 2024-08-28T16:18:18.6433333+00:00
Pinaki Ghatak
4,685
Reputation points Microsoft Employee
5 answers
Azure Function and Azure Batch
I have created a function that creates a node in a batch Azure account. The node has certain characteristics and adds an .exe plus a Python script to it from the storage account to run. Everything was fine until then, the node was created and everything…
asked 2024-08-22T19:09:26.7166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 18%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Sebastian Pacheco
221
Reputation points
commented 2024-08-26T22:11:28.55+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 4%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Sina Salam
12,086
Reputation points
1 answer
How to mount an Azure file share to an Azure Batch pool
I need to make a log file available at any time by attaching the file share as the mount configuration while creating a new batch pool. Can someone provide me with the steps to attach a mount configuration and explain what mount options are…
asked 2024-08-09T11:41:38.48+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Sreenidhi Palimar
20
Reputation points
commented 2024-08-16T07:18:08.06+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 64%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
Nehruji R
8,146
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
What is Elevation level in Azure batch jobs, what is the use of creating a custom user in elevation level
What is Elevation level in Azure batch jobs, what is the use of creating a custom user in elevation level
asked 2024-08-09T07:51:43.3866667+00:00
Sreenidhi Palimar
20
Reputation points
accepted 2024-08-14T10:50:55.26+00:00
Sreenidhi Palimar
20
Reputation points
2 answers
One of the answers was accepted by the question author.
How to mount connect file share folder in Azure Batch container
I have created a batch pool/jobs/tasks, uploaded container image and connected to an Azure File Share. The container image, is a python program which should read data from ./data/inputs ...and output everything in ./data/outputs. In my connected storage…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 3%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECM%3C/text%3E%3C/svg%3E)
0 answers
How to modify the start task of an Azure Batch Pool started from HPC Pack 2019
I have an On-Premises HPC Pack 2019 Update 2 head node and Windows workstation nodes environment from which my organisation would like to burst to Linux VMs on Azure Batch. I have followed correctly this…
asked 2024-08-03T23:35:26.7966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 60%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECQ%3C/text%3E%3C/svg%3E)
Christopher Quenneville
0
Reputation points
commented 2024-08-08T03:31:50.9733333+00:00
vipullag-MSFT
26,396
Reputation points