Content
Azure batch autoscale formula
I'm trying to create a pool that always starts with 1 node. After 3 minutes of having more than 70% CPU usage the pool should generate another machine, and repeat. I'm using the current formula: initialPoolSize = 1; $TargetDedicatedNodes =…
how could I change the date format from this yyyy/mm/dd to this dd/mm/yyyy in a ADF dataflow?. And I needed the date without timestamp
I want to change a date that I have in this format 'yyyy/mm/dd' to this other format 'dd/mm/yyyy' and I don't want the date with timestamp. Important: the date source will come as a string field and I want convert it to date field This task will be in a…


Quota Calculation for Azure Batch Service
I have raised a request to increase the quota for Azure Batch service (Dedicated vCPUs per VM Series for Av2 series to 20 and Dsv2 series to 20). Once the quota is increased my understanding is that my Total dedicated vCPUs should show as 40. However, I…




Azure Data Factory Pipeline Queued status even when batch node is idle
Hi, I have multiple triggers for my data factory jobs, which use integration runtime and run on a dedicated single node. Sometimes, even when the node is idle, the pipeline stays in queued stayed for an hour and then fails due to runtime error. The…


Can I run a Blender script as an Azure Batch?
I would like to run Blender w/ my input script and input file in Azure Batch just as I do from the command line. My Python script (Python is the built-in scripting language of Blender) takes the input file, does some manipulations and saves a few images…


How to force docker to pull image with every batch task execution?
The documentation for the container_run_options input for the TaskContainerSettings class [link] describe it as These additional options are supplied as arguments to the "docker create" command, in addition to those controlled by the Batch…
Hi Team, How can I use azure batch to process a large json ,I want to chuck that data and want to process it .
I have a rest end point where I am getting a large json as a request body , I want to process that json using azure batch.


Azure Batch Job Creation using az batch job create --template argument not recgonise
Hi, I try to create task using the job template but the following command no longer supported: az batch job create --template job.json This command will prompt for pool id and job id, but instead the command is now "az batch job…


Azure CLI DevOps deploy fails with exit code: 1
Hi Q&A, Im having issues with deploying Azure CLI scrips in DevOps. And the only error that im getting is “2023-04-27T07:15:49.8277936Z ##[error]Script failed with exit code: 1” The script I’m trying to initiate is to change the tier on app service…
Need to understand difference between Total Dedicated vCPUs and Dedicated vCPUs in Azure Batch
Hello All, I am new to Azure and currently in a learning phase. I wanted to know what is the difference between Total Dedicated vCPUs and Dedicated vCPUs in Azure Batch. I have created a Batch account and I see the Total Dedicated vCPUs shows as 10 and…


Hi Team, Try to upload large file > 10 gb on azure blob storage in chunk using rest API from salesfroce using LWC.
Hi Team, Try to upload large file > 10 GB on azure blob storage in chunk using rest API from salesforce using LWC. How to resolve the issues of upload file in chunks in Azure from Salesforce to Azure through Lighting Web Components.


Retirement Notice: Transition to Simplified compute node communication pools without public IP addresses before 31 March 2023 ???
Hello. I keep getting notices about "Retirement Notice: Transition to Simplified compute node communication pools without public IP addresses before 31 March 2023" (TRACKING ID: BNJ7-HC8 ) and when I go to the portal that exact ID and date…
Batch using docker image in python
Hi, I'm looking for an example for Azure batch using a docker image. I've found the example below, but I just can't get the syntax right to deploy multiple docker images and the example does not cover…


Python | Azure Batch
Hi I am trying to run python scripts inside azure batch accounts. I have provided managed identitiy access to batch accounts with permissions to storage in my python scripts, I am accessing azure storage account to list blobs in a container …


Is anyone else having problems with resizing pools?
Hello There, I have 4 pools all stuck in resizing... is anyone else having this issue? Thanks Greg


How to access _azbatch user created files in azure batch from non batch user ?
I have my files from storage account copied to this path in azure batch /mnt/batch/tasks/workitems/job-test/job-1/task-4/wd. But, im in a non batch user and unable to access the files created by the _azure batch user. I have elevatedlevel admin…


How to find the Azure Batch Python client library in Conda packaging
I've started working with Azure Batch and use Python, with my Python environment managed by Anaconda. I'd like to install the Azure Batch Client Library and Azure Batch Management Client Library from the Azure SDK for Python in my Anaconda environments,…


Python in ADF: How to choose the best approach?
I have a simple python script that does some data processing that I want to run from within an ADF pipeline. I can see that there are multiple ways to do this: Azure Function Azure Batch Pool Databricks Python runbook I am starting from scratch as…


How to stop an Azure Batch service
Hi, To offload a lot of data processing we have started to use Azure Batch services by creating a dedicated vm for this purpose. This service is going to start the Batch service and process the data for us. But we are not sure how to stop the…

