Error creating pool node
I've converted my pool creation code from Microsoft.Azure.Batch to Azure.ResourceManager.Batch (in order to set the certificate in the key vault instead of in the batch account). The pool is being created with the expected node, and all configuration…
Databricks vs Batch pool
Hi, I have Googled the difference between using Azure Databrick and Batch pool to run python pipelines and ETL. But I haven’t found a clear difference between them two. Based on what I have Googled, Databrick can become very expensive, so cost matters a…
Define azure batch pool certificate in CloudPool with c#
I'm following the instructions in https://learn.microsoft.com/en-us/azure/batch/automatic-certificate-rotation#create-a-batch-pool-with-a-user-assigned-managed-identity to change from defining certificates in CloudPool.CertificateReferences to…
increase batch pool quota
I tried to created a batch pool but I got the message saying the quota has been reached. How do I increase my pool quotas ? I tried to go in quotas>computer> there is an option for New quota request. But I can't see my resource group there. How…
Unable to Submit Quote Increase Request for Microsoft Azure Batch
Hi everyone, I’m currently setting up an Azure Batch account, but I encountered an error indicating insufficient quota. I'm in the process of requesting a quota increase for my subscription; however, when I enter the location details, the process seems…
how to order sequence of python scrip using batch pool
I have stored three python scripts in Blob Storage and I have created a Batch account and I am about to create the “pool”. But these python scripts has to be run in particular order. Hence my question: how do I order the sequence of the python script to…
MPI error in Azure Batch
In MPI-enabled tasks, occasionally we will get this error: Aborting: smpd on a3315966100000A failed to communicate with child smpd manager If we restart the exact same task it will complete. This seems to suggest that a node has terminated and is no…
batch pool: PoolQuotaReached
I have upgrade my account in Azure. I am trying to create a batch pool but it says "The error message "PoolQuotaReached: Pool quota for the account has been reached" indicates that the number of pools in your Azure Batch account has…
i cannot download my bathc jobs - timeout
Hi, I'm on a slow internet connection and struggling to download my batch jobs. The output file is several tens of MB, and I keep getting the error: "Unable to load file. Timeout of 600000ms exceeded." Any suggestions on how to work around…
Combine Excel Template with csv data
Hi - I'm trying to combine data generated in the form of .csv file with an existing excel template. Excel template contains a sheet with data table that needs to be populated to contents of .csv file and also have some of the cells written with…
Is it possible to update the autoscaling formula and replace the Blob containers mounted in an existing Azure batch pool?
I have created an Azure batch pool with 2 containers (Container1, Container2). I want to update the autoscaling formula in this pool. Additionally, I also want to map 2 different containers (Container3, Container4) in the same pool.
Azure Batch Pool Deployment in VNet with Batch-Service and User Subscription Modes
I'm trying to understand how Azure Batch deploys pools to a Virtual Network (VNet) in both Batch-Service mode and User subscription mode. I successfully created a Batch pool in Batch-Service mode and deployed it into a VNet in my own Azure subscription…
Will AutoScale formula remove node that is running a task
I am new to Azure Batch and I understand that it uses VMSS to create pools in the background. If I define an auto scale formula, can it result in a node being removed while a task is running?
How to Schedule Azure Batch Jobs to Run Only on Weekdays and Skip Weekends?
Hi, I'm looking to configure an Azure Batch job schedule to run only on weekdays and skip weekends. From my research and forum interactions, I understand that the Weekdays attribute has been deprecated in the latest version. Any guidance or examples…
Issue with resourceFiles Property in Azure Data Factory Pipeline: "Total size of resourceFiles is using 141% of available space after processing"
Hello, I'm encountering an issue with Azure Batch related to the resourceFiles property in one of my pipelines. Despite verifying that the File Storage Size in the associated App Service Plan is only 7% of the available 10 GB, I'm receiving an error…
Azure Function and Azure Batch
I have created a function that creates a node in a batch Azure account. The node has certain characteristics and adds an .exe plus a Python script to it from the storage account to run. Everything was fine until then, the node was created and everything…
How to mount an Azure file share to an Azure Batch pool
I need to make a log file available at any time by attaching the file share as the mount configuration while creating a new batch pool. Can someone provide me with the steps to attach a mount configuration and explain what mount options are…
What is Elevation level in Azure batch jobs, what is the use of creating a custom user in elevation level
What is Elevation level in Azure batch jobs, what is the use of creating a custom user in elevation level
How to mount connect file share folder in Azure Batch container
I have created a batch pool/jobs/tasks, uploaded container image and connected to an Azure File Share. The container image, is a python program which should read data from ./data/inputs ...and output everything in ./data/outputs. In my connected storage…
How to modify the start task of an Azure Batch Pool started from HPC Pack 2019
I have an On-Premises HPC Pack 2019 Update 2 head node and Windows workstation nodes environment from which my organisation would like to burst to Linux VMs on Azure Batch. I have followed correctly this…