303 questions with Azure Batch tags

Sort by: Updated
Updated Created Answers
1 answer

Key vault configuration in azure data factory

Hi What is the Key vault in azure data factory and how to do configuration and what are the benefits of that Can anyone help me please, Regards, Eshwar

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-02-25T06:34:29.57+00:00
Eshwar Nakkala 106 Reputation points
commented 2021-03-01T08:13:17.83+00:00
prmanhas-MSFT 17,891 Reputation points Microsoft Employee
3 answers

Custom .NET Activity: The request was aborted: Could not create SSL/TLS secure channel. Unable to download API data.

Under the Batch Service option, we are running a custom dot net activity, and that .NET tool downloads data from some APIs. It was working fine without any issues until Yesterday(for more than 2/3 years). Now we are facing the below error while…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
asked 2020-07-09T06:16:04.973+00:00
KathiresanSubramaniam-1168 1 Reputation point
answered 2021-02-23T16:41:00.14+00:00
17NBhoodoo 1 Reputation point
0 answers

Can you explain Snapshots versus generalized images for custom image batch pools

According to the docs for Batch custom images (https://learn.microsoft.com/en-us/azure/batch/batch-custom-images#prepare-a-managed-image) it says that only snapshots are recommended: In Azure, you can prepare a managed image from: Snapshots of…

Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,157 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-02-19T19:48:24.427+00:00
Matt Kotsenas 1 Reputation point
commented 2021-02-20T02:49:05.143+00:00
TravisCragg-MSFT 5,676 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Batch SKU upgrade Ubuntu 18.04

Hi, I am in the process of upgrading our Batch SKU from Ubuntu 16.04 (LTS) to 18.04 (LTS). I see that there are currently 2 images available, one by canonical and one by microsoft-dsvm Sku Agent Id[batch.node.ubuntu 18.04], Image…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-02-05T16:06:09.6+00:00
Laurent Meister 66 Reputation points
commented 2021-02-16T14:27:53.587+00:00
Monalla-MSFT 11,646 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Batch: Support for Public Ip Prefix

Azure Batch now supports the assignment of public ip at pool creation time. This seems to work for statically created ip. Although this is a great feature, it is still very cumbersome. I have tried to give it an Public IP Prefix, but it failed with…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-02-12T15:09:39.23+00:00
Laurent Meister 66 Reputation points
accepted 2021-02-13T09:45:44.88+00:00
Laurent Meister 66 Reputation points
1 answer

How can I record a unique client / project identifier when using batch?

Hi, we have a single batch account and want to use it for a number of different client engagements so when we set jobs off we would like to somehow tag the Azure costs associated with that job to a specific client / engagement so that when we extract the…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-01-27T07:22:38.737+00:00
Chris 1 Reputation point
commented 2021-02-12T16:58:57.03+00:00
prmanhas-MSFT 17,891 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Need to process SSAS on prem Model using ADF v2

Hi, We have created SSAS tabular model and we are processing using agent jobs . we have adf v2 for ETL process . Problem :- we have to trigger manually agent job post adf pipeline finish . and we need to automate cube processing using adf v2 …

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
SQL Server Analysis Services
SQL Server Analysis Services
A Microsoft online analytical data engine used in decision support and business analytics, providing the analytical data for business reports and client applications such as Power BI, Excel, Reporting Services reports, and other data visualization tools.
1,245 questions
asked 2021-02-05T14:05:38.967+00:00
Ravi Shukla 21 Reputation points
accepted 2021-02-08T13:11:32.977+00:00
Ravi Shukla 21 Reputation points
1 answer

Azure Batch Error. The certificate chain was issued by an authority that is not trusted.

I am trying to use the R package doazureparallel from Windows. When I run the command cluster <- makeCluster("cluster.json"). I get an error that says Error in curl::curl_fetch_memory(url, handle = handle) : schannel: next…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-01-29T09:18:12.663+00:00
Eric 146 Reputation points
answered 2021-02-05T06:03:18.02+00:00
Eric 146 Reputation points
1 answer

Import Reader module or pass Azure storage queried values in Batch Execution (BES) with python for retraining

Currently I have a machine learning model and I'm retraining it with Python BES code. I need to pass the input directly to the input parameters. It's accepting only CSV file (Or may be other files). I don't want to use any file. I have fetched the rows…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,571 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-02-02T06:37:11.417+00:00
Rakesh R G 1 Reputation point
answered 2021-02-04T07:15:08.323+00:00
romungi-MSFT 42,206 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Programmatically set task slots per node in Azure Batch Python SDK

Hi Azure Batch Team, I am setting up container tasks on Azure Batch using Python SDK client. I borrowed a small snippet from the GitHub, as shared here and modified it slightly to run for container tasks. def create_pool(batch_service_client,…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-01-25T10:29:22.767+00:00
Chintan Rajvir 426 Reputation points Microsoft Employee
commented 2021-01-25T15:44:11.89+00:00
vipullag-MSFT 24,206 Reputation points Microsoft Employee
0 answers

Troubleshoot 'The specified resource does not exist. ' from Azure Data Factory Custom Batch Run

I have a simple "Rscript test.r" batch Command that runs a R script which just prints the message "greetings". When i trigger the pipeline manually and look at the output. It says: <Error> …

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
asked 2020-07-01T21:30:20.023+00:00
Dan 21 Reputation points
commented 2021-01-20T22:03:21.417+00:00
Patrick GRANDJEAN 1 Reputation point
1 answer

Azure runbooks or Azure batch for using Python 3 as part of data pipelines in Azure data factory?

Hello, We have some scenario's where we need to include Python 3 in our ADF pipelines. Workloads are small (under 1 GB of data). Now I have a few requirements. From within the Python script I must be able to access my azure sql database (so do…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
Azure Automation
Azure Automation
An Azure service that is used to automate, configure, and install updates across hybrid environments.
1,124 questions
asked 2021-01-10T15:26:43.367+00:00
Luuk van Vliet 276 Reputation points
commented 2021-01-20T07:56:34.587+00:00
Luuk van Vliet 276 Reputation points
0 answers

How to collect all network Hostnames , IPs and MAC addresses inside text file Using Batch scripting and Using an external file?

Hi all I'm a beginner in batch scripting and I want to create a batch script to collect All needed data in one row for each workstation inside my domain into a text file using hostnames located in a text file named 'hosts.txt' by a batch scripting…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-01-16T01:31:22.537+00:00
Amin 1 Reputation point
commented 2021-01-18T13:43:22.713+00:00
prmanhas-MSFT 17,891 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Need help trying to install Azure CLI on pfSense CE 2.4.5 but getting ERROR: Command errored out with exit status 1: /root/lib/azure-cli/bin/python

I was able to download the script and save locally (installAzureCliPython.py), set permission (+x) and ran. I completed adding packages and fails after message "Building dependencies". Here is a screen shot of the command issue and prompt…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2020-12-30T23:11:32.29+00:00
CompusaurusRex 96 Reputation points
accepted 2021-01-15T14:47:09.423+00:00
CompusaurusRex 96 Reputation points
1 answer One of the answers was accepted by the question author.

Python script not being executed in azure batch using azure data factory

Hello, I have tried reproducing below's tutorial from the microsoft website. Unfortunately the pipeline status remains "in progress". https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory …

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
asked 2021-01-12T08:18:29.29+00:00
Luuk van Vliet 276 Reputation points
commented 2021-01-15T07:33:12.45+00:00
Luuk van Vliet 276 Reputation points
1 answer One of the answers was accepted by the question author.

Zipping and UnZipping files for Batch limitation in ADF

Hello, I recently encountered the following error while running a Custom Activity on Azure Data Factory: "Total size of resourceFiles cannot be more than 32768 characters" For this error, I found many blog posts that state you must zip…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,714 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
asked 2021-01-12T15:09:45.593+00:00
Sampat, Varun 231 Reputation points
accepted 2021-01-14T19:25:29.923+00:00
Sampat, Varun 231 Reputation points
1 answer

Mount File share to Azure Batch Pool using Node.js SDK or Azure CLI

Hello, We are trying to mount a File share to the Azure Batch pool using Node.js by referencing the syntax from this blog; https://learn.microsoft.com/en-us/azure/batch/virtual-file-mount. The pool configuration…

Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,169 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-01-07T14:09:54.077+00:00
Owais 1 Reputation point
commented 2021-01-12T00:26:32.737+00:00
TravisCragg-MSFT 5,676 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Error when creating batch pool in azure batch, task doesn't finish in azure data factory

Hello, I try to set up a batch pool in order to run some python scripts that clean complex datasets orchestrated by azure data factory. Upon creating a pool I get the following error: AccountVMSeriesCoreQuotaReached. Ignoring the error and…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions
asked 2021-01-07T09:24:18.383+00:00
Luuk van Vliet 276 Reputation points
commented 2021-01-12T00:14:10.457+00:00
TravisCragg-MSFT 5,676 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Applying tags to VM scalesets of Azure Batch

Is there a way to apply tags to the virtual machine scale sets associated with a batch account ? I've looked at the Metadata property of Job Prep task and Cloud Pool class, but these values do not show up as tags on the underlying vm ss.

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2021-01-05T21:01:00.733+00:00
Ambarish S N 21 Reputation points
accepted 2021-01-06T06:29:58.117+00:00
Ambarish S N 21 Reputation points
1 answer

where is the page with my available msdn download licenses

I have a MSDN subscription c/o my employer NCR. I am signed into my account. I can't find the page of licenses that are available/are already used. Thanks, Keith

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
303 questions
asked 2020-12-23T17:53:05.09+00:00
Woodall, Keith S 1 Reputation point
commented 2020-12-31T08:27:51.543+00:00
prmanhas-MSFT 17,891 Reputation points Microsoft Employee