azure MPI inter node communications limit ?

Question

I have just seen this page:

https://learn.microsoft.com/en-us/azure/batch/batch-quota-limit#pool-size-limits

does this really mean that you can only run batch jobs that require inter-node communications on pools of no more than 80/100 nodes ?

if that is true - then it means that very high concurrency can be achieved for the trivial case where the processing on all nodes are completely independent of each other (eg graphics rendering), but not for the more normal HPC use cases - where there are workflow dependencies between compute nodes - eg via MPI.

If the limit is 80/100 nodes - then in the case where there is one effective core per node - that is not really much more than can now be achieved today on a single multi-core CPU (I am aware of all the caveats)

A

Answer 1

Hi @AJG ,

Yes, the default pool size limits are as you stated (80/100) for subscription and service allocation modes respectively. That being said if your running production workloads in Azure batch and need to increase one or more of the quotas above the default you can open an online customer support request at no charge. If this answers your question please mark it as accepted. Thanks!