Can you explain Snapshots versus generalized images for custom image batch pools
According to the docs for Batch custom images (https://learn.microsoft.com/en-us/azure/batch/batch-custom-images#prepare-a-managed-image) it says that only snapshots are recommended: In Azure, you can prepare a managed image from: Snapshots of…
Azure Batch SKU upgrade Ubuntu 18.04
Hi, I am in the process of upgrading our Batch SKU from Ubuntu 16.04 (LTS) to 18.04 (LTS). I see that there are currently 2 images available, one by canonical and one by microsoft-dsvm Sku Agent Id[batch.node.ubuntu 18.04], Image…
Azure Batch: Support for Public Ip Prefix
Azure Batch now supports the assignment of public ip at pool creation time. This seems to work for statically created ip. Although this is a great feature, it is still very cumbersome. I have tried to give it an Public IP Prefix, but it failed with…
How can I record a unique client / project identifier when using batch?
Hi, we have a single batch account and want to use it for a number of different client engagements so when we set jobs off we would like to somehow tag the Azure costs associated with that job to a specific client / engagement so that when we extract the…
Need to process SSAS on prem Model using ADF v2
Hi, We have created SSAS tabular model and we are processing using agent jobs . we have adf v2 for ETL process . Problem :- we have to trigger manually agent job post adf pipeline finish . and we need to automate cube processing using adf v2 …
Azure Batch Error. The certificate chain was issued by an authority that is not trusted.
I am trying to use the R package doazureparallel from Windows. When I run the command cluster <- makeCluster("cluster.json"). I get an error that says Error in curl::curl_fetch_memory(url, handle = handle) : schannel: next…
Import Reader module or pass Azure storage queried values in Batch Execution (BES) with python for retraining
Currently I have a machine learning model and I'm retraining it with Python BES code. I need to pass the input directly to the input parameters. It's accepting only CSV file (Or may be other files). I don't want to use any file. I have fetched the rows…
Programmatically set task slots per node in Azure Batch Python SDK
Hi Azure Batch Team, I am setting up container tasks on Azure Batch using Python SDK client. I borrowed a small snippet from the GitHub, as shared here and modified it slightly to run for container tasks. def create_pool(batch_service_client,…
Troubleshoot 'The specified resource does not exist. ' from Azure Data Factory Custom Batch Run
I have a simple "Rscript test.r" batch Command that runs a R script which just prints the message "greetings". When i trigger the pipeline manually and look at the output. It says: <Error> …
Azure runbooks or Azure batch for using Python 3 as part of data pipelines in Azure data factory?
Hello, We have some scenario's where we need to include Python 3 in our ADF pipelines. Workloads are small (under 1 GB of data). Now I have a few requirements. From within the Python script I must be able to access my azure sql database (so do…
How to collect all network Hostnames , IPs and MAC addresses inside text file Using Batch scripting and Using an external file?
Hi all I'm a beginner in batch scripting and I want to create a batch script to collect All needed data in one row for each workstation inside my domain into a text file using hostnames located in a text file named 'hosts.txt' by a batch scripting…
Need help trying to install Azure CLI on pfSense CE 2.4.5 but getting ERROR: Command errored out with exit status 1: /root/lib/azure-cli/bin/python
I was able to download the script and save locally (installAzureCliPython.py), set permission (+x) and ran. I completed adding packages and fails after message "Building dependencies". Here is a screen shot of the command issue and prompt…
Python script not being executed in azure batch using azure data factory
Hello, I have tried reproducing below's tutorial from the microsoft website. Unfortunately the pipeline status remains "in progress". https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory …
Zipping and UnZipping files for Batch limitation in ADF
Hello, I recently encountered the following error while running a Custom Activity on Azure Data Factory: "Total size of resourceFiles cannot be more than 32768 characters" For this error, I found many blog posts that state you must zip…
Mount File share to Azure Batch Pool using Node.js SDK or Azure CLI
Hello, We are trying to mount a File share to the Azure Batch pool using Node.js by referencing the syntax from this blog; https://learn.microsoft.com/en-us/azure/batch/virtual-file-mount. The pool configuration…
Error when creating batch pool in azure batch, task doesn't finish in azure data factory
Hello, I try to set up a batch pool in order to run some python scripts that clean complex datasets orchestrated by azure data factory. Upon creating a pool I get the following error: AccountVMSeriesCoreQuotaReached. Ignoring the error and…
Applying tags to VM scalesets of Azure Batch
Is there a way to apply tags to the virtual machine scale sets associated with a batch account ? I've looked at the Metadata property of Job Prep task and Cloud Pool class, but these values do not show up as tags on the underlying vm ss.
where is the page with my available msdn download licenses
I have a MSDN subscription c/o my employer NCR. I am signed into my account. I can't find the page of licenses that are available/are already used. Thanks, Keith
Service costs
Is it possible to somehow track service costs for a specific subscription? (Azure Batch in my case) I'm looking for a solution to somehow informs me in the middle of the month if service costs are abnormally high before I'll get my bills at the end of…
Azure Batch Service billing
Hi, I have several questions about Azure Batch Service billing. Is there any way to get a price for VM I want to create, programmatically, through Azure SDK? The price for VM I want is 5$ per hour. If I'll remove VM after 20 minutes of using it,…