Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
309 questions
1 answer
One of the answers was accepted by the question author.
ADF Batch : Bacth Activty starts but never ends
My pipeline is working until it reaches a certain batch activity where process continues but never ends and throws no error message or warning so it has been not possible for me to figure out the problem. The python file to run is very simple (reads a…
asked 2020-09-29T20:23:54.727+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 97%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
javier
921
Reputation points
commented 2020-09-30T04:57:00.777+00:00
PRADEEPCHEEKATLA-MSFT
79,141
Reputation points Microsoft Employee
1 answer
Accelerate Azure VM start time in Azure Batch pool
We are developing a service which is supposed to interact with Azure Batch and create pool of Virtual Machines (i.e."worker nodes"). The Virtual machines will be created from custom image (from a shared image gallery) with some installed…
asked 2020-09-01T06:15:52.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 97%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKV%3C/text%3E%3C/svg%3E)
Kale, Vaibhav
41
Reputation points
commented 2020-09-28T11:38:21.267+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee
1 answer
Azure Batch Smalldisk custom image
Hello, We are trying to build an application which will use custom images in Azure Batch Pool. In Azure Batch, the 'Marketplace' Image type has provision to deploy 'smalldisk' worker nodes for 2016/2019 Datacenter. Currently as part of Image…
asked 2020-09-14T18:10:28.13+00:00
Kale, Vaibhav
41
Reputation points
commented 2020-09-28T11:25:01.86+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Account Core Quota being reached on FSv2 VMs
I recently updated my Pool size for my FSv2 VMs to 500 instances. But when I run a Batch service job, the resizing fails after reaching a count of 62 nodes (when I could use 180 nodes as per the way my job is structured) with the error…
asked 2020-09-09T21:10:54.753+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 83%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
Daniyal Mirza
41
Reputation points
accepted 2020-09-24T02:02:05.623+00:00
Daniyal Mirza
41
Reputation points
2 answers
One of the answers was accepted by the question author.
Azure Batch Render Xgen path error
Hi, When I do Azure batch render with Vray & Maya my Xgen search paths changes back to relative paths resulting in missing files. I always set the Xgen paths to use absolute paths using Xgen path editor but somehow when rendering in the cloud it…
asked 2020-09-10T06:46:36.993+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 45%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
Pasan Madusanka
21
Reputation points
commented 2020-09-18T05:49:42.8+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee
0 answers
creating batch pool from captured vm image
setting up batch compute nodes in the correct way for some given software stack seems to be rather cumbersome. this is also difficult to test and develop - since even with no startup task - pool nodes sometimes take hours to be available. one…
asked 2020-09-06T03:56:32.807+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 0%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AJG
436
Reputation points
commented 2020-09-16T19:17:49.157+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Account Core Quota details
Is there a way to access details about "How many Cores are available for my subscription"? I recently asked for an increase in Compute-VM (cores-vCPUs) subscription limit. After being granted the increase this still resizes my jobs to about…
asked 2020-09-08T22:06:45.997+00:00
Daniyal Mirza
41
Reputation points
commented 2020-09-10T10:17:22.37+00:00
Sam Cogan
10,322
Reputation points MVP
0 answers
How can I see who ENDED a WORK ORDER/BATCH ORDER
How do i trace a user who ENDED a Work Order because it always picks up the user who created the WO
asked 2020-09-01T13:02:57.477+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 43%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Siphamandla Soci
1
Reputation point
commented 2020-09-04T23:21:33.453+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 98%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KarishmaTiwari-MSFT
18,627
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
azure batch samples for python - sample 2
I am looking at azure batch sample 2 for python: https://github.com/Azure-Samples/azure-batch-samples/blob/master/Python/Batch/sample2_pools_and_resourcefiles.py As far as I can see, the 'command line' for the pool StartTask simply executes a python…
1 answer
One of the answers was accepted by the question author.
azure MPI inter node communications limit ?
I have just seen this page: https://learn.microsoft.com/en-us/azure/batch/batch-quota-limit#pool-size-limits does this really mean that you can only run batch jobs that require inter-node communications on pools of no more than 80/100 nodes ? …
1 answer
Azure Batch - Using Python with MPI
Does anyone know what is the best way to set things up to run parallel Python programs that use MPI on Azure Batch? There are obviously a number of things to consider - such as the mix of packages, how to deploy in a simple way, etc It looks like…
1 answer
How do I get an Azure Batch pool to resubmit after more cores become available?
I'm using AutoPools with Jobs in Azure Batch, therefore I have a 1-to-1 ratio of Pools to Jobs. If I submit a few jobs at the same time, one of them may be prevented from starting by the core quota on the Azure Batch account, i.e. the AutoPool would…
asked 2020-08-24T16:23:30.44+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 28.999999999999996%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
Adam Talbot
1
Reputation point
commented 2020-09-01T15:22:59.803+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee
2 answers
All Pools added to Azure Batch are stuck in resizing
Every pool I add to my Azure Batch account becomes stuck in "resizing". This happens whether I use an autoscale formula or fixed size. It doesn't seem to matter what image or VM size I select. The error is as follows: Code:…
asked 2020-08-26T18:25:38.797+00:00
Adam Talbot
1
Reputation point
commented 2020-08-27T20:39:23.397+00:00
KarishmaTiwari-MSFT
18,627
Reputation points Microsoft Employee
0 answers
Batch account deleting pool
Hi We have a batchaccount pool (it have to idle nodes) witch have had state "Deleting" since 06-08-2020 (18 days). None off the nodes is busy (have no pending jobs) and I can’t delete nodes while the pool is deleting. The pool have an…
asked 2020-08-24T09:50:40.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 87%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
Henrik Madsen
1
Reputation point
commented 2020-08-25T08:06:54.18+00:00
vipullag-MSFT
24,711
Reputation points
2 answers
How to solve the error message when executing bat automation batch file? B A T C H R E C U R S I O N exceeds STACK limits
How to solve the error message when executing bat automation batch file? B A T C H R E C U R S I O N exceeds STACK limits I wrote a series of automated scripts, but after executing them, error messages will jump. How can I solve him? ****** B A T C…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 98%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERR%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 73%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESQ%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Where could i find the stdout.txt and stderr.txt log files for the Start Task operation when the pool node reboots?
I am trying to install some R packages globally on a Azure -> Batch Account -> Pool -> Node. I have the following lines in the Pool -> Start Task textarea: cmd /c RScript.exe -e "install.packages('rpart',…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 9%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
1 answer
Azure Batch : AzureFileShareConfiguration mount drive disconnected
Hello, I am trying to create a Pool using Azure Batch . I have uploaded content to Azure Storage using File Shares. I would like my Pool to mount this Azure File Share as virtual file system (ref:…
asked 2020-06-29T14:36:12.08+00:00
Kale, Vaibhav
41
Reputation points
commented 2020-08-06T10:44:44.917+00:00
Sumarigo-MSFT
44,001
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Determining free tier usage rights
Hi everyone, I went through https://azure.microsoft.com/en-us/free/free-account-faq/ and I can see that Batch service has been provided for free (always free) as per: I tried following all links, but couldn't really see how limited such…
asked 2020-07-22T13:42:05.537+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 93%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPD%3C/text%3E%3C/svg%3E)
Pedro Diogo
21
Reputation points
accepted 2020-07-23T11:32:12.61+00:00
Pedro Diogo
21
Reputation points
1 answer
Azure Batch equivalent of FILE.AppendAllText
Hi, Could you please let me know the Azure Batch Service (Storage Account blob processing) equivalent of C# FILE.AppendAllText? Basically, I have an input file. I need to read it line by line with Stream Reader. Do transformation. Write the output…
asked 2020-06-26T16:01:24.083+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 85%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
etl2016
1
Reputation point
commented 2020-07-13T11:04:57.847+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee
1 answer
Azure Batch Service - splitting or partitioning resource files
hi, Is there a way to split or partition Azure Batch Service's Resource Files (input files) so that the burden of input file processing is load-balanced and distributed among all available compute nodes? For instance, if I have an input file with 100k…
asked 2020-07-06T00:17:37.02+00:00
etl2016
1
Reputation point
commented 2020-07-13T10:58:14.943+00:00
prmanhas-MSFT
17,891
Reputation points Microsoft Employee