Batch using docker image in python

Question

Hi,

I'm looking for an example for Azure batch using a docker image. I've found the example below, but I just can't get the syntax right to deploy multiple docker images and the example does not cover docker

https://learn.microsoft.com/en-us/azure/batch/tutorial-parallel-python

Thank you

Answer 1

Hello, @Jose Agraz !

How do I run a Docker container on Azure Batch?

This is now an outdated practice. The current recommendation is to run container applications natively in Batch or by using Batch Shipyard.

Run container applications on Azure Batch

https://learn.microsoft.com/en-us/azure/batch/batch-docker-container-workloads

Batch tasks can run directly on virtual machines (nodes) in a Batch pool, but you can also set up a Batch pool to run tasks in Docker-compatible containers on the nodes. This article shows you how to create a pool of compute nodes that support running container tasks, and then run container tasks on the pool. The code examples here use the Batch .NET and Python SDKs. You can also use other Batch SDKs and tools, including the Azure portal, to create container-enabled Batch pools and to run container tasks.

Batch Shipyard

https://github.com/Azure/batch-shipyard

Batch Shipyard is a tool to help provision, execute, and monitor container-based batch processing and HPC workloads on Azure Batch. Batch Shipyard supports both Docker and Singularity containers. No experience with the Azure Batch SDK is needed; run your containers with easy-to-understand configuration files. All Azure regions are supported, including non-public Azure regions.

Hopefully one of those provides what you are looking for. If you are looking for something else, please let me know in the comments and I'd be happy to help.