Azure Batch - Using Python with MPI

AJG 416 Reputation points
2020-09-01T05:05:21.193+00:00

Does anyone know what is the best way to set things up to run parallel Python programs that use MPI on Azure Batch?

There are obviously a number of things to consider - such as the mix of packages, how to deploy in a simple way, etc

It looks like this technology combination is used in Azure ML - but I dont know if this uses customized libraries - rather than a standard toolset.

are there any examples that show the best way to do this?

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
237 questions
No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Winston 2,756 Reputation points
    2020-09-01T18:10:34.403+00:00

    Hi @AJG ,

    I'd advise you to take a look at this sample here. This tutorial is a python application that uses Azure Batch to run a simple python program that submits a job to the pool, and then submits a task which performs a simple MPI pingpong command. If this is a good example for you please mark this answer as accepted to help other community members. Thanks!